-- Logs begin at Mon 2022-10-31 11:55:10 UTC, end at Mon 2022-10-31 12:49:54 UTC. -- Oct 31 12:24:19.566125 dv-cinder-796170-6-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Oct 31 12:24:19.574959 dv-cinder-796170-6-iscsi devstack@n-api.service[103774]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 31 12:24:19.577067 dv-cinder-796170-6-iscsi devstack@n-api.service[103774]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Oct 31 12:24:19 2022] *** Oct 31 12:24:19.577067 dv-cinder-796170-6-iscsi devstack@n-api.service[103774]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 31 12:24:19.577067 dv-cinder-796170-6-iscsi devstack@n-api.service[103774]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 31 12:24:19.577067 dv-cinder-796170-6-iscsi devstack@n-api.service[103774]: nodename: dv-cinder-796170-6-iscsi Oct 31 12:24:19.577067 dv-cinder-796170-6-iscsi devstack@n-api.service[103774]: machine: x86_64 Oct 31 12:24:19.577067 dv-cinder-796170-6-iscsi devstack@n-api.service[103774]: clock source: unix Oct 31 12:24:19.577067 dv-cinder-796170-6-iscsi devstack@n-api.service[103774]: pcre jit disabled Oct 31 12:24:19.577067 dv-cinder-796170-6-iscsi devstack@n-api.service[103774]: detected number of CPU cores: 4 Oct 31 12:24:19.577067 dv-cinder-796170-6-iscsi devstack@n-api.service[103774]: current working directory: / Oct 31 12:24:19.577067 dv-cinder-796170-6-iscsi devstack@n-api.service[103774]: detected binary path: /usr/bin/uwsgi-core Oct 31 12:24:19.577067 dv-cinder-796170-6-iscsi devstack@n-api.service[103774]: your processes number limit is 47680 Oct 31 12:24:19.577688 dv-cinder-796170-6-iscsi devstack@n-api.service[103774]: your memory page size is 4096 bytes Oct 31 12:24:19.577688 dv-cinder-796170-6-iscsi devstack@n-api.service[103774]: detected max file descriptor number: 2048 Oct 31 12:24:19.577688 dv-cinder-796170-6-iscsi devstack@n-api.service[103774]: lock engine: pthread robust mutexes Oct 31 12:24:19.577688 dv-cinder-796170-6-iscsi devstack@n-api.service[103774]: thunder lock: enabled Oct 31 12:24:19.577688 dv-cinder-796170-6-iscsi devstack@n-api.service[103774]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 31 12:24:19.577688 dv-cinder-796170-6-iscsi devstack@n-api.service[103774]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 31 12:24:19.616928 dv-cinder-796170-6-iscsi devstack@n-api.service[103774]: Python main interpreter initialized at 0x55be80d3a9c0 Oct 31 12:24:19.616928 dv-cinder-796170-6-iscsi devstack@n-api.service[103774]: python threads support enabled Oct 31 12:24:19.616928 dv-cinder-796170-6-iscsi devstack@n-api.service[103774]: your server socket listen backlog is limited to 100 connections Oct 31 12:24:19.616928 dv-cinder-796170-6-iscsi devstack@n-api.service[103774]: your mercy for graceful operations on workers is 90 seconds Oct 31 12:24:19.617259 dv-cinder-796170-6-iscsi devstack@n-api.service[103774]: mapped 403077 bytes (393 KB) for 2 cores Oct 31 12:24:19.617333 dv-cinder-796170-6-iscsi devstack@n-api.service[103774]: *** Operational MODE: preforking *** Oct 31 12:24:19.617584 dv-cinder-796170-6-iscsi devstack@n-api.service[103774]: *** uWSGI is running in multiple interpreter mode *** Oct 31 12:24:19.617584 dv-cinder-796170-6-iscsi devstack@n-api.service[103774]: spawned uWSGI master process (pid: 103774) Oct 31 12:24:19.617781 dv-cinder-796170-6-iscsi systemd[1]: Started Devstack devstack@n-api.service. Oct 31 12:24:19.618528 dv-cinder-796170-6-iscsi devstack@n-api.service[103774]: spawned uWSGI worker 1 (pid: 103775, cores: 1) Oct 31 12:24:19.618664 dv-cinder-796170-6-iscsi devstack@n-api.service[103774]: spawned uWSGI worker 2 (pid: 103776, cores: 1) Oct 31 12:24:19.618816 dv-cinder-796170-6-iscsi devstack@n-api.service[103774]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 31 12:24:20.277148 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 31 12:24:20.278743 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 31 12:24:21.357141 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 31 12:24:21.357141 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: from cryptography.utils import int_from_bytes Oct 31 12:24:21.357706 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 31 12:24:21.357706 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: from cryptography.utils import int_from_bytes Oct 31 12:24:21.358082 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 31 12:24:21.358082 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: from cryptography.utils import int_from_bytes Oct 31 12:24:21.358194 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 31 12:24:21.358194 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: from cryptography.utils import int_from_bytes Oct 31 12:24:23.865079 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 31 12:24:23.865748 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 31 12:24:23.865840 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 31 12:24:23.866200 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 31 12:24:23.866466 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 31 12:24:23.866844 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.867192 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.867509 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.867828 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.868156 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.868467 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.868786 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.869103 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.869428 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.869690 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.869968 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 31 12:24:23.870341 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.870425 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 31 12:24:23.870503 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-796170-6-iscsi {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.870624 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.870755 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 31 12:24:23.870928 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.871112 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 31 12:24:23.871268 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.871390 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 31 12:24:23.871585 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.871774 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.871890 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.872099 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.872211 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.872416 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.872510 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.872731 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.872983 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.873082 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.873354 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.873444 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.873671 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.873764 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.873987 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.874071 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.874308 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.874392 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.874568 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.874671 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.874876 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.874958 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.875213 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-796170-6-iscsi {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.875300 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.875532 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.875622 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.875836 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.875928 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.876141 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.876230 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.876452 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.876577 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-796170-6-iscsi {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.876754 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.876843 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.877069 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.877148 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.877371 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.877462 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.877848 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.877929 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.878211 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.878436 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.878518 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.878643 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.878831 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.878927 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.879153 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.879288 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.879484 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.879602 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.879812 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.879902 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.880129 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.880217 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.880447 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.880539 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.880767 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.880850 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.881068 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.881154 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.881377 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.881490 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-796170-6-iscsi {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.881684 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.881806 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.882003 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.882110 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.882328 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.882440 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.882606 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.882807 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.882906 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.883115 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.883223 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.883444 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.883527 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.883762 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.883859 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.884096 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.884180 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.884346 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.884428 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.884597 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.884714 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.884915 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.885029 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.885237 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.885345 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.885545 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.885660 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.885852 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.885961 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.886159 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.886250 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.886468 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.886551 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.886771 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.886859 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.887078 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.887190 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.887406 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.887504 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.887688 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.887771 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.887994 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.888086 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.888315 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.888405 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.888633 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.888714 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.888938 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.889029 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.889188 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.889270 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.889436 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.889639 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.15 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.889810 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.889896 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.15 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.890055 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.890188 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.890361 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.890524 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.890665 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.890841 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.891040 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.891135 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.891293 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.891495 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.891638 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.891798 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.891881 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.892103 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.892280 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.892429 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.892592 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.892705 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.892909 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.893259 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.893472 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.893580 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.893814 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.893980 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.894226 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.894325 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.894530 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.894637 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.894837 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.894928 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.15 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.895155 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.895266 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.15 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.895483 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.895610 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.895789 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.895882 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.896097 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.896189 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.896397 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.896495 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.896707 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.896798 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.897012 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.897103 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.897314 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.897403 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.897614 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.897706 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.897916 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.898016 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.898220 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.898310 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.898524 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.898616 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.898831 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.898922 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.899078 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.899230 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.899398 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.899484 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.899698 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.899796 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.900010 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.900096 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.900311 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.900402 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.900611 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.900702 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.900911 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.901003 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.901210 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.901293 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.901510 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.901601 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.901818 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.901912 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.902109 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.902192 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.902411 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.902553 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.902715 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.902814 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.903017 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.903108 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.903340 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.903446 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.903644 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.903736 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.903943 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.904041 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.904243 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.904343 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.904542 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.904639 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.904848 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.904939 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.905147 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.905250 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.905447 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.905549 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.905747 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.905852 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.906045 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.906144 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.906345 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.906439 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.906647 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.906736 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.906947 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.907038 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.907267 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.907359 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.907570 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.907672 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.907869 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.907958 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.908182 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.908273 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.908484 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.908574 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.908790 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.908881 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.909093 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.909182 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.909920 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.910021 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.910239 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.910330 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.910645 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.910735 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.910951 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.911050 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.911282 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.911406 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.911582 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.911689 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.911883 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.911987 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.912184 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.912275 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.912486 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.912618 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.912823 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.912932 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.913082 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.913178 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.913377 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.913464 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.913688 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.913782 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.914004 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.914089 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.914310 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.914395 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.914614 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.914700 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.914916 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.915000 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.915248 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:24:23.915338 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.915582 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.915675 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.915910 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.916000 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.916228 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.916313 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.916538 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.916631 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.916875 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.916970 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.917180 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.917358 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.917494 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.917580 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.917801 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.917891 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.918110 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.918200 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.918433 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.918519 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.918740 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.918833 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.919053 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.919141 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.919382 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.919472 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.919696 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.919782 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.920009 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.920101 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.920322 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.920407 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.920631 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.920715 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.920944 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.921039 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.921258 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.921343 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.921565 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.921660 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.921875 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.921971 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.922194 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.922307 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.922507 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.922590 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.922810 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.922904 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.923119 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.923233 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.923455 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.923542 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.923764 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.923850 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.924096 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.924181 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.924409 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.924492 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.924717 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.924803 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.925717 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.926115 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.926199 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.926278 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.926425 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.926512 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.926739 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.926831 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.927052 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.927146 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.927387 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.927483 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.927692 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.927778 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.927998 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.928092 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.928303 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.928399 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.928607 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.928691 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.928909 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.929001 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.929215 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.929300 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.929522 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.929607 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.929838 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.929930 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.930158 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.930243 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.930463 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.930546 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.930772 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.930871 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.931077 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.931198 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.931410 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.931494 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.931713 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.931821 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.932018 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.932102 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.932326 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.932410 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.932624 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.932705 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.932924 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.933003 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.933223 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.933308 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.933526 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.933612 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.933825 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.933909 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.934135 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.934218 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.934442 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.934528 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.934745 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.934828 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.935052 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.935135 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.935386 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.935472 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.935693 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.935777 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.935999 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.936092 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.936306 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.936399 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.936608 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.936693 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.936914 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.937025 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.937220 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.937312 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.937520 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.937605 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.937838 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.937936 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.938143 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.938228 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.938446 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.938531 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.938765 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.938857 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.939064 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.939147 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.939387 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.939472 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.939688 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.939774 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.939995 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.940089 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.940298 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.940389 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.940630 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.941118 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.941213 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.941294 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.941385 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.941466 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.941553 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.941633 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.941830 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.941916 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.942167 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.942279 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.942505 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.942598 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.942894 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.942987 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.943111 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.943225 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.943442 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.943536 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.943747 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.943840 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.944047 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.944147 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.944353 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.944444 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.944652 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.944742 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.944954 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.945053 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.945256 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.945346 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.945559 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.945650 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.945859 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.945958 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.946162 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.946250 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.946470 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.946559 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.946769 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.946855 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.947067 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.947200 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.947406 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.947498 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.947710 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.947802 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.948010 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.948108 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.948310 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.948409 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.948608 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.948700 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.948944 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.949034 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.949245 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.949334 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.949559 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.949655 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.949861 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.949952 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.950174 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.950274 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.950506 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.950596 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.950812 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.950903 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.951123 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.951248 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.951451 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.951549 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.951760 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.951851 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.952067 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.952177 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.952372 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.952469 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.952682 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.952773 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.953004 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.953103 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.953295 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.953381 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.953589 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.953671 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.953902 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.954000 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.954206 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.954296 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.954510 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.954600 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.954808 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.954898 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.955117 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.955229 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.955467 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.955556 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.955771 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.955870 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.956084 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.956182 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.956540 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.956623 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.956778 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.956953 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.957069 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.957281 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.957367 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.957599 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.957694 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.957923 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.958017 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.958233 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.958325 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.958543 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.958636 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.958848 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.958938 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.959149 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.959272 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.959477 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.959568 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.959785 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.959874 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.960089 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.960185 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.960396 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.960487 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.960695 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.960785 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.960997 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.961087 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.961309 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.961407 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.961616 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.961708 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.961922 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.962022 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.962226 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.962316 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.962531 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.962620 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.962834 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.962933 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.963147 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.963272 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.963459 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.963563 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.963761 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.963866 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.964061 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.964165 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.964363 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.964456 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.964670 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.964779 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.964975 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.965076 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.965277 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.965371 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.965588 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.965681 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.965876 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.965968 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.966175 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.966266 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.966478 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.966577 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.966779 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.966884 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.967123 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.967264 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.967452 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.967541 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.967730 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.967821 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.968043 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.968141 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.968356 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.968461 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.968654 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.968743 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.968954 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.969052 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.969304 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.969391 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.969571 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.969656 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.969869 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.969970 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.970163 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.970259 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.970464 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.970555 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.970772 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.970878 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.971094 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.971214 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.971421 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.971512 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.971734 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.972347 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.972573 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.972672 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.972881 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.972986 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.973302 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.973406 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.973477 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.973543 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.973782 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.974094 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.974197 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.974404 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.974493 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.974709 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.974801 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.975016 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.975121 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.975352 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.975433 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.975641 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.975741 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.975946 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.976045 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.976266 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.976364 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.976572 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.976664 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.976878 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.976969 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.977232 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.977323 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.977475 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.977572 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.977770 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.977876 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.978082 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.978178 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.978383 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.978634 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.978729 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.978963 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.979058 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.979295 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.979392 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.979596 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.979693 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.979903 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.979989 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.980207 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.980305 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.980511 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.980597 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.980824 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.980917 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.981127 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.981221 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.981437 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.981523 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.981739 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.981833 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.982039 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.982124 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.982342 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.982435 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.982644 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.982738 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.982945 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.983029 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.983335 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.983438 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.983574 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.983678 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.983880 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.983966 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.984178 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.984263 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.984481 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.984568 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.984782 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.984867 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.985083 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.985168 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.985392 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.985478 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.985693 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.985777 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.986000 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.986084 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.986299 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.986385 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.986616 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.986702 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.986921 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.987019 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.987240 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.987340 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.988112 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.988270 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.988425 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.988736 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.988831 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.989045 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.989138 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.989352 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.989437 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.989656 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.989786 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.989965 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.990093 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.990268 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.990396 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.990582 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.990710 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.990889 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.991016 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.991200 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.991376 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.991504 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.991626 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.991799 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.991934 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.992107 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.992244 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.992409 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.992544 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.992718 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.992845 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.993020 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.993156 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.993379 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.993588 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.993709 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.993831 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.993954 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.994152 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.994281 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.994404 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.994527 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.994649 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.994803 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.994931 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.995103 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.995253 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.995449 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.995581 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.995755 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.995882 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.996049 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.996176 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.996354 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.996481 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.996660 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.996793 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.996964 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.997089 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.997263 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.997467 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.997604 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.997727 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.997850 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.997972 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.998153 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.998289 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.998456 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.998583 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.998757 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.998883 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.999057 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.999240 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.999369 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.999500 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.999675 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.999808 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:23.999980 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.000114 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.000277 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.000409 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.000580 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.000707 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.000881 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.001016 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.001181 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.001314 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.001479 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.001605 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.001779 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.001924 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.002079 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.002206 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.002378 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.002510 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.002679 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.002807 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.002980 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.003341 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.003718 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.003913 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.004056 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.004189 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.004189 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.004430 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.004553 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.004675 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.004811 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.004936 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.005058 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.005180 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.005303 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.005434 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.005558 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.005680 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.005804 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.005939 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.006063 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.006198 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.006323 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.006456 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.006580 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.006704 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.006867 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.007002 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.007184 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.007314 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.007517 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.007667 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.007794 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.007928 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.008112 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.008240 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.008413 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.008539 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.008768 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.008903 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.009072 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.009198 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.009384 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.009510 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.009685 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.009811 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.009993 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.010120 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.010299 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.010423 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.010603 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.010729 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.010903 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.011029 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.011228 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.011355 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.011538 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.011666 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.011848 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.011981 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.012153 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.012276 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.012453 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.012587 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.012757 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.012881 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.013060 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.013195 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.013364 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.013489 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.013694 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.013818 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.013949 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.014144 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.014273 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.014396 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.014559 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.014687 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.014861 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.015001 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.015193 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.015334 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.015491 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.015623 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.015794 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.015928 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.016095 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.016219 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.016398 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.016530 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.016706 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.016841 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.017011 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.017144 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.017317 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.017444 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.017660 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.017796 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.017919 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.018285 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.018463 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.018589 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.018831 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.019007 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.019136 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.019272 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.019477 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.019650 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.019788 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.019961 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.020095 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.020271 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.020804 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.020938 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.021053 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.021160 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.021265 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.021371 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.021475 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.021589 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.021695 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.021799 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.021940 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.022055 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.022246 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.022471 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.022583 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.022702 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.022840 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.022959 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.023145 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.023305 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.023473 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.023586 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.023779 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.023950 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.024073 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.024267 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.024480 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.024593 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.024788 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.024945 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.025095 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.025255 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.025400 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.025563 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.025699 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.025883 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.026003 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.026203 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.026315 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.026523 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.026638 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.026830 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.026951 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.027143 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.027277 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.027471 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.027582 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.027787 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.027910 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.028088 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.028214 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.028403 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.028524 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.028715 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.028834 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.029478 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.029596 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.029704 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.029822 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.029930 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.030044 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.030181 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.030308 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.030432 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.030557 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.030688 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.030829 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.030965 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.031090 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.031264 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.031395 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.031589 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.031727 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.031897 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.032023 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.032202 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.032334 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.032533 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.032667 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.032804 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.032929 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.033087 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.033214 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.033390 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.033519 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.033702 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.033843 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.034034 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.034162 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.034310 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.035007 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.035136 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.035303 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.035456 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.035593 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.035788 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.035923 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.036094 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.036223 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.036416 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.036553 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.036721 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.036848 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.037042 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.037169 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.037352 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.037488 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.037665 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.037798 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.038001 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.038129 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.038253 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.038387 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.038557 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.038685 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.038852 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.038981 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.039154 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.039313 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.039478 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.039605 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.039782 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.039909 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.040090 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.040217 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.040392 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.040520 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.040695 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.040824 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.041014 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.041143 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.041315 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.041444 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.041636 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.041763 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.041943 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.042071 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.042264 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.042391 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.042580 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.042708 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.042881 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.043017 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.043215 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.043347 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.043522 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.043671 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.043807 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.043938 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.044138 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.044266 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.044389 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.044523 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.044696 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.044824 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.045050 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.045188 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.045313 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.045456 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.045581 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.045716 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.045872 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.046000 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.046174 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.046310 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.046475 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.046602 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.046794 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.046921 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.047097 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.047278 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.047442 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.047569 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.047747 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.047877 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.048092 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.048228 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.048352 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.048475 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.048640 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.048768 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.048927 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.049056 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.049226 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.049362 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.049528 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.049662 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.049826 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.050003 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.050681 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.050814 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.050984 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.051250 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.051384 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.051580 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.051708 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.051899 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.052029 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.052197 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.052323 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.052514 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.052641 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.052817 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.052951 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.053120 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.053247 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.053421 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.053548 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.053721 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.053857 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.054032 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.054181 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.054372 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.054498 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.054654 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.054863 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.054998 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.055256 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.055395 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.055520 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.055656 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.055819 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.055957 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.056130 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.056258 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.056442 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.056570 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.056753 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.056881 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.057062 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.057190 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.057371 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.057496 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.057677 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.057804 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.057983 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.058109 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.058320 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.058457 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.058584 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.058751 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.059027 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.059196 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.059338 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.059475 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.059608 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.059723 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.059888 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.060025 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.060200 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.060340 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.060512 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.060640 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.060867 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.060997 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.061181 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.061310 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.061483 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.061611 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.061792 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.061921 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.062127 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.062255 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.062401 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.062527 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.062710 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.062846 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.063017 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.063144 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.063356 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.063495 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.063668 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.063803 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.063975 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.064110 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.064281 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.064492 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.064621 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.064754 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.064880 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.065002 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.065200 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.065349 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.065514 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.065663 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.065830 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.065957 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.066142 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.066392 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.066529 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.066710 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.066838 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.067026 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.067153 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.067357 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.067566 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.067697 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.067881 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.068007 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.068212 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.068367 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.068557 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.068688 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.068856 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.068983 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.069186 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.069331 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.069457 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.069579 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.069772 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.069909 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.070077 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.070214 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.070379 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.070507 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.070688 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.070816 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.070992 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.071217 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.071349 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.071531 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.071658 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.071860 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.072001 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.072180 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.072314 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.072500 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.072635 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.072806 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.072941 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.073118 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.073331 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.073458 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.073676 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.073804 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.073995 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.074133 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.074307 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.074434 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.074635 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.074771 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.074897 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.075021 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.075219 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.075349 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.075529 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.075673 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.075829 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.075957 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.076141 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.076268 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.076446 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.076582 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.076753 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.076966 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.077096 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.077307 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.077433 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.077621 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.077756 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.077931 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.078056 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.078233 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.078374 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.078606 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.078745 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.078910 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.079037 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.079208 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.079422 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.079571 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.079709 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.079835 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.079949 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.080072 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.080204 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.080330 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.080455 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.080626 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.080752 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.080926 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.081060 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.081305 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.081447 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.081695 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.081833 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.081973 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.082099 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.082223 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.082355 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.082512 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.082640 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.082833 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.082962 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.083134 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.083281 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.083465 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.083591 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.083764 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.083892 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.084071 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.084201 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.084370 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.084498 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.084711 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.084856 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.084983 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.085108 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.085232 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.085369 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.085543 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.085672 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.085841 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.085968 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.086143 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.086280 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.086439 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.086568 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.086744 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.086879 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.087088 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.087276 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.087405 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.087646 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.087776 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.087981 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.088109 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.088290 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.088416 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.088588 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.088801 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.088972 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.089114 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.089241 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.089364 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.089567 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.089695 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.089819 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.089952 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.090067 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.090190 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.090409 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.090544 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.090718 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.090918 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.091046 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.091256 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.091386 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.091587 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.091714 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.091905 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.092034 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.092232 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.092357 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.092541 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.092679 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.092844 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.092970 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.093146 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.093274 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.093446 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.093581 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.093749 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.093876 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.094057 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.094191 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.094364 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.094505 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.094674 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.094816 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.095005 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.095141 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.095339 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.095477 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.095655 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.095815 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.095961 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.096087 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.096266 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.096393 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.096571 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.096698 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.097392 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.097603 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.097726 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.097836 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.098003 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.098131 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.098317 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.098458 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.098645 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.098790 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.098980 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.099153 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.099335 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.099480 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.099690 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.099928 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.100054 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.100243 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.100376 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.100554 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.100681 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.100861 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.100988 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.101166 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.101304 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.101471 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.101599 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.101776 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.101903 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.102086 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.102226 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.102402 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.102529 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.102710 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.102835 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.103012 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.103149 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.103400 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.103704 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.103832 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.104020 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.104165 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.104327 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.104453 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.104632 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.104760 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.104934 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.105148 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.105277 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.105402 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.105533 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.105665 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.105838 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.105974 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.106139 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.106267 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.106441 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.106577 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.106747 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.106884 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.107047 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.107226 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.107376 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.107505 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.107680 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.107809 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.107982 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.108109 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.108289 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.108416 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.108587 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.108714 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.108886 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.109129 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.109260 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.109385 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.109518 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.109647 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.109857 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.109987 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.110111 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.110244 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.110376 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.110501 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.110625 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.110749 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.110921 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.111058 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.111238 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.111366 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.111540 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.111665 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.111840 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.111979 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.112138 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.112267 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.112436 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.113358 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.113358 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.113690 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.113998 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.114320 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.114627 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.114947 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.115343 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.115587 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.115702 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.115895 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.116008 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.116212 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.116334 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.116518 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.116630 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.116828 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.116943 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.117137 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.117258 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.117444 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.117563 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.117751 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.117863 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.118055 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.118175 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.118358 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.118480 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.118688 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.118801 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.118992 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.119128 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.119366 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.119487 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.119658 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.119895 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.120048 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.120276 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.120443 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.120571 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.120889 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.121014 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.121211 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.121527 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.121660 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.121836 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.122161 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.122288 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.122515 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.122725 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.122849 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.122955 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.123107 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.123271 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.123452 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.123582 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.123770 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.123905 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.124092 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.124233 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.124406 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.124535 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.124721 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.124856 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.125024 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.125159 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.125372 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.125498 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.125648 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.125775 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.125967 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.126096 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.126276 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.126403 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.126581 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.126709 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.126904 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.127032 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.127233 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.127364 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.127540 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.127669 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.127847 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.127975 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.128175 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.128329 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.128479 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.128597 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.128876 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.129010 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.129181 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.129424 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.129555 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 31 12:24:24.129695 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.129821 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.130136 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.130455 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.130776 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.131083 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.131425 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.131744 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.132088 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.132404 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.132743 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.133066 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.133376 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.133685 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.133987 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:24:24.134228 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 31 12:24:24.284538 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: INFO dbcounter [None req-c3048402-ead2-4729-a1ac-e0ecdc27094d None None] Registered counter for database nova_api Oct 31 12:24:24.289617 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: INFO dbcounter [None req-4f3874f4-d70d-4bfc-bdde-1f0d3830fedc None None] Registered counter for database nova_api Oct 31 12:24:24.306979 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG oslo_db.sqlalchemy.engines [None req-c3048402-ead2-4729-a1ac-e0ecdc27094d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103775) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 31 12:24:24.309866 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG oslo_db.sqlalchemy.engines [None req-4f3874f4-d70d-4bfc-bdde-1f0d3830fedc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103776) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 31 12:24:24.313995 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG dbcounter [-] [103775] Writer thread running {{(pid=103775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 31 12:24:24.317031 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG dbcounter [-] [103776] Writer thread running {{(pid=103776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 31 12:24:24.372366 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.context [None req-4f3874f4-d70d-4bfc-bdde-1f0d3830fedc None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa(cell1) {{(pid=103776) load_cells /opt/stack/nova/nova/context.py:464}} Oct 31 12:24:24.373183 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.context [None req-c3048402-ead2-4729-a1ac-e0ecdc27094d None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa(cell1) {{(pid=103775) load_cells /opt/stack/nova/nova/context.py:464}} Oct 31 12:24:24.376167 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG oslo_concurrency.lockutils [None req-4f3874f4-d70d-4bfc-bdde-1f0d3830fedc None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:24:24.376639 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG oslo_concurrency.lockutils [None req-4f3874f4-d70d-4bfc-bdde-1f0d3830fedc None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:24:24.377053 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG oslo_concurrency.lockutils [None req-c3048402-ead2-4729-a1ac-e0ecdc27094d None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:24:24.377530 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG oslo_concurrency.lockutils [None req-c3048402-ead2-4729-a1ac-e0ecdc27094d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:24:24.378733 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG oslo_concurrency.lockutils [None req-4f3874f4-d70d-4bfc-bdde-1f0d3830fedc None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:24:24.379465 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG oslo_concurrency.lockutils [None req-4f3874f4-d70d-4bfc-bdde-1f0d3830fedc None None] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:24:24.379905 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG oslo_concurrency.lockutils [None req-4f3874f4-d70d-4bfc-bdde-1f0d3830fedc None None] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:24:24.380322 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG oslo_concurrency.lockutils [None req-c3048402-ead2-4729-a1ac-e0ecdc27094d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:24:24.381051 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG oslo_concurrency.lockutils [None req-c3048402-ead2-4729-a1ac-e0ecdc27094d None None] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:24:24.381503 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG oslo_concurrency.lockutils [None req-c3048402-ead2-4729-a1ac-e0ecdc27094d None None] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:24:24.381880 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG oslo_concurrency.lockutils [None req-4f3874f4-d70d-4bfc-bdde-1f0d3830fedc None None] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:24:24.383529 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG oslo_concurrency.lockutils [None req-c3048402-ead2-4729-a1ac-e0ecdc27094d None None] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:24:24.383855 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: INFO dbcounter [None req-4f3874f4-d70d-4bfc-bdde-1f0d3830fedc None None] Registered counter for database nova_cell0 Oct 31 12:24:24.385526 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: INFO dbcounter [None req-c3048402-ead2-4729-a1ac-e0ecdc27094d None None] Registered counter for database nova_cell0 Oct 31 12:24:24.388033 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: INFO dbcounter [None req-4f3874f4-d70d-4bfc-bdde-1f0d3830fedc None None] Registered counter for database nova_cell1 Oct 31 12:24:24.389579 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: INFO dbcounter [None req-c3048402-ead2-4729-a1ac-e0ecdc27094d None None] Registered counter for database nova_cell1 Oct 31 12:24:24.396287 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG oslo_db.sqlalchemy.engines [None req-4f3874f4-d70d-4bfc-bdde-1f0d3830fedc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103776) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 31 12:24:24.397692 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG oslo_db.sqlalchemy.engines [None req-4f3874f4-d70d-4bfc-bdde-1f0d3830fedc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103776) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 31 12:24:24.399392 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG oslo_db.sqlalchemy.engines [None req-c3048402-ead2-4729-a1ac-e0ecdc27094d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103775) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 31 12:24:24.401223 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG oslo_db.sqlalchemy.engines [None req-c3048402-ead2-4729-a1ac-e0ecdc27094d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103775) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 31 12:24:24.403825 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG dbcounter [-] [103776] Writer thread running {{(pid=103776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 31 12:24:24.407503 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG dbcounter [-] [103775] Writer thread running {{(pid=103775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 31 12:24:24.408966 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG dbcounter [-] [103775] Writer thread running {{(pid=103775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 31 12:24:24.409107 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG dbcounter [-] [103776] Writer thread running {{(pid=103776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 31 12:24:24.550220 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: INFO dbcounter [None req-4f3874f4-d70d-4bfc-bdde-1f0d3830fedc None None] Registered counter for database nova_cell0 Oct 31 12:24:24.553191 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: INFO dbcounter [None req-c3048402-ead2-4729-a1ac-e0ecdc27094d None None] Registered counter for database nova_cell0 Oct 31 12:24:24.559262 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG oslo_db.sqlalchemy.engines [None req-4f3874f4-d70d-4bfc-bdde-1f0d3830fedc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103776) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 31 12:24:24.561079 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG oslo_db.sqlalchemy.engines [None req-c3048402-ead2-4729-a1ac-e0ecdc27094d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103775) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 31 12:24:24.564137 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG dbcounter [-] [103776] Writer thread running {{(pid=103776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 31 12:24:24.566214 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG dbcounter [-] [103775] Writer thread running {{(pid=103775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 31 12:24:24.904179 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: WARNING keystonemiddleware.auth_token [None req-c3048402-ead2-4729-a1ac-e0ecdc27094d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 31 12:24:24.904814 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: WARNING keystonemiddleware.auth_token [None req-4f3874f4-d70d-4bfc-bdde-1f0d3830fedc None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 31 12:24:24.911472 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: WARNING keystonemiddleware.auth_token [None req-c3048402-ead2-4729-a1ac-e0ecdc27094d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 31 12:24:24.911933 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: WARNING keystonemiddleware.auth_token [None req-4f3874f4-d70d-4bfc-bdde-1f0d3830fedc None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 31 12:24:25.257529 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: WARNING keystonemiddleware.auth_token [None req-c3048402-ead2-4729-a1ac-e0ecdc27094d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 31 12:24:25.257984 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: WARNING keystonemiddleware.auth_token [None req-4f3874f4-d70d-4bfc-bdde-1f0d3830fedc None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 31 12:24:25.263610 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: WARNING keystonemiddleware.auth_token [None req-c3048402-ead2-4729-a1ac-e0ecdc27094d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 31 12:24:25.263961 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: WARNING keystonemiddleware.auth_token [None req-4f3874f4-d70d-4bfc-bdde-1f0d3830fedc None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 31 12:24:25.269863 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55be80d3a9c0 pid: 103775 (default app) Oct 31 12:24:25.270152 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55be80d3a9c0 pid: 103776 (default app) Oct 31 12:24:25.271976 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi [None req-c3048402-ead2-4729-a1ac-e0ecdc27094d None None] Calling method '>' {{(pid=103775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:24:25.273153 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: INFO nova.api.openstack.requestlog [None req-c3048402-ead2-4729-a1ac-e0ecdc27094d None None] 10.222.0.15 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001782 Oct 31 12:24:25.273546 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: [pid: 103775|app: 0|req: 1/1] 10.222.0.15 () {50 vars in 788 bytes} [Mon Oct 31 12:24:25 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 12:25:46.617363 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi [None req-4f3874f4-d70d-4bfc-bdde-1f0d3830fedc None None] Calling method '>' {{(pid=103776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:25:46.618515 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: INFO nova.api.openstack.requestlog [None req-4f3874f4-d70d-4bfc-bdde-1f0d3830fedc None None] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001969 Oct 31 12:25:46.618921 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: [pid: 103776|app: 0|req: 1/2] 10.222.0.15 () {54 vars in 931 bytes} [Mon Oct 31 12:25:46 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 12:25:46.634908 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG dbcounter [-] [103775] Writing DB stats nova_api:SELECT=3 {{(pid=103775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:25:46.636739 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG dbcounter [-] [103775] Writing DB stats nova_cell0:SELECT=3 {{(pid=103775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:25:46.637824 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG dbcounter [-] [103775] Writing DB stats nova_cell1:SELECT=3 {{(pid=103775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:25:46.639769 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG dbcounter [-] [103775] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:25:47.523107 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi [None req-f6d8763d-1496-4abc-a589-b0c0659d29d2 admin admin] Calling method '>' {{(pid=103775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:25:47.559855 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: INFO nova.api.openstack.requestlog [None req-f6d8763d-1496-4abc-a589-b0c0659d29d2 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.934985 Oct 31 12:25:47.560670 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: [pid: 103775|app: 0|req: 2/3] 10.222.0.15 () {60 vars in 1292 bytes} [Mon Oct 31 12:25:46 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:25:50.213386 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi [None req-4f3874f4-d70d-4bfc-bdde-1f0d3830fedc None None] Calling method '>' {{(pid=103776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:25:50.214416 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: INFO nova.api.openstack.requestlog [None req-4f3874f4-d70d-4bfc-bdde-1f0d3830fedc None None] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001438 Oct 31 12:25:50.215014 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: [pid: 103776|app: 0|req: 2/4] 10.222.0.15 () {54 vars in 931 bytes} [Mon Oct 31 12:25:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 12:25:50.712528 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi [None req-8d18cfa1-4b30-493c-a1a1-7010cf481171 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "vcpus": 1, "ram": 256, "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "c1", "name": "cirros256", "swap": 0, "rxtx_factor": 1.0}} {{(pid=103775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 12:25:50.760528 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: INFO nova.api.openstack.requestlog [None req-8d18cfa1-4b30-493c-a1a1-7010cf481171 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.539160 Oct 31 12:25:50.761305 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: [pid: 103775|app: 0|req: 3/5] 10.222.0.15 () {64 vars in 1283 bytes} [Mon Oct 31 12:25:50 2022] POST /compute/v2.1/flavors => generated 407 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 12:25:50.774956 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG dbcounter [-] [103776] Writing DB stats nova_api:SELECT=3 {{(pid=103776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:25:50.775796 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG dbcounter [-] [103776] Writing DB stats nova_cell0:SELECT=3 {{(pid=103776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:25:50.777708 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG dbcounter [-] [103776] Writing DB stats nova_cell1:SELECT=3 {{(pid=103776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:25:50.778452 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG dbcounter [-] [103776] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:25:50.991616 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi [None req-e33d180b-1fd3-472e-8514-aecdb7ddf735 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 12:25:51.062765 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: INFO nova.api.openstack.requestlog [None req-e33d180b-1fd3-472e-8514-aecdb7ddf735 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.292874 Oct 31 12:25:51.063662 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: [pid: 103776|app: 0|req: 3/6] 10.222.0.15 () {64 vars in 1336 bytes} [Mon Oct 31 12:25:50 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:25:53.709961 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi [None req-8d18cfa1-4b30-493c-a1a1-7010cf481171 admin admin] Calling method '>' {{(pid=103775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:25:53.711561 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: INFO nova.api.openstack.requestlog [None req-8d18cfa1-4b30-493c-a1a1-7010cf481171 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002117 Oct 31 12:25:53.711953 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: [pid: 103775|app: 0|req: 4/7] 10.222.0.15 () {54 vars in 931 bytes} [Mon Oct 31 12:25:53 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 12:25:54.385346 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi [None req-d4fc6448-b2c1-46cb-ac2b-c67d04604d76 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "swap": 0, "os-flavor-access:is_public": true, "name": "ds512M", "disk": 5, "rxtx_factor": 1.0, "id": "d1", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1}} {{(pid=103776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 12:25:54.429381 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: INFO nova.api.openstack.requestlog [None req-d4fc6448-b2c1-46cb-ac2b-c67d04604d76 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.710963 Oct 31 12:25:54.430024 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: [pid: 103776|app: 0|req: 4/8] 10.222.0.15 () {64 vars in 1283 bytes} [Mon Oct 31 12:25:53 2022] POST /compute/v2.1/flavors => generated 404 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 12:25:54.442419 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi [None req-6d40ba30-ead1-4b72-bdaa-cd0f1099c2e3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 12:25:54.483459 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: INFO nova.api.openstack.requestlog [None req-6d40ba30-ead1-4b72-bdaa-cd0f1099c2e3 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.044559 Oct 31 12:25:54.484066 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: [pid: 103775|app: 0|req: 5/9] 10.222.0.15 () {64 vars in 1336 bytes} [Mon Oct 31 12:25:54 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:25:57.095838 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi [None req-d4fc6448-b2c1-46cb-ac2b-c67d04604d76 admin admin] Calling method '>' {{(pid=103776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:25:57.096859 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: INFO nova.api.openstack.requestlog [None req-d4fc6448-b2c1-46cb-ac2b-c67d04604d76 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001534 Oct 31 12:25:57.097264 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: [pid: 103776|app: 0|req: 5/10] 10.222.0.15 () {54 vars in 931 bytes} [Mon Oct 31 12:25:57 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 12:25:57.516960 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi [None req-e96e4dd7-2631-48d6-b462-7b66ef5501e6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 1024, "id": "d2", "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds1G", "disk": 10}} {{(pid=103775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 12:25:57.536422 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: INFO nova.api.openstack.requestlog [None req-e96e4dd7-2631-48d6-b462-7b66ef5501e6 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.432210 Oct 31 12:25:57.537017 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: [pid: 103775|app: 0|req: 6/11] 10.222.0.15 () {64 vars in 1283 bytes} [Mon Oct 31 12:25:57 2022] POST /compute/v2.1/flavors => generated 404 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 12:25:57.549678 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi [None req-7e14377d-4705-4342-b595-8c9d4f2b0702 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 12:25:57.584765 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: INFO nova.api.openstack.requestlog [None req-7e14377d-4705-4342-b595-8c9d4f2b0702 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.039040 Oct 31 12:25:57.585349 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: [pid: 103776|app: 0|req: 6/12] 10.222.0.15 () {64 vars in 1336 bytes} [Mon Oct 31 12:25:57 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:26:00.274037 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi [None req-e96e4dd7-2631-48d6-b462-7b66ef5501e6 admin admin] Calling method '>' {{(pid=103775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:26:00.275060 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: INFO nova.api.openstack.requestlog [None req-e96e4dd7-2631-48d6-b462-7b66ef5501e6 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001454 Oct 31 12:26:00.275506 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: [pid: 103775|app: 0|req: 7/13] 10.222.0.15 () {54 vars in 931 bytes} [Mon Oct 31 12:26:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 12:26:00.689939 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi [None req-7ad1c755-24e0-4619-80a3-3a1fe2b5dfec admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "id": "d3", "vcpus": 2, "ram": 2048, "os-flavor-access:is_public": true, "name": "ds2G"}} {{(pid=103776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 12:26:00.714240 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: INFO nova.api.openstack.requestlog [None req-7ad1c755-24e0-4619-80a3-3a1fe2b5dfec admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.432380 Oct 31 12:26:00.719326 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: [pid: 103776|app: 0|req: 7/14] 10.222.0.15 () {64 vars in 1283 bytes} [Mon Oct 31 12:26:00 2022] POST /compute/v2.1/flavors => generated 404 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 31 12:26:00.728301 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi [None req-0d7cdd14-2a79-48cc-bd39-87ff0cc51575 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 12:26:00.758665 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: INFO nova.api.openstack.requestlog [None req-0d7cdd14-2a79-48cc-bd39-87ff0cc51575 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034260 Oct 31 12:26:00.759527 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: [pid: 103775|app: 0|req: 8/15] 10.222.0.15 () {64 vars in 1336 bytes} [Mon Oct 31 12:26:00 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 12:26:03.392753 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi [None req-7ad1c755-24e0-4619-80a3-3a1fe2b5dfec admin admin] Calling method '>' {{(pid=103776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:26:03.393617 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: INFO nova.api.openstack.requestlog [None req-7ad1c755-24e0-4619-80a3-3a1fe2b5dfec admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001733 Oct 31 12:26:03.394014 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: [pid: 103776|app: 0|req: 8/16] 10.222.0.15 () {54 vars in 931 bytes} [Mon Oct 31 12:26:03 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 12:26:03.893232 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi [None req-d89d9ceb-3fb1-4597-848e-c027d882817e admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "os-flavor-access:is_public": true, "id": "d4", "disk": 20, "ram": 4096, "swap": 0, "name": "ds4G", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0}} {{(pid=103775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 12:26:03.912260 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: INFO nova.api.openstack.requestlog [None req-d89d9ceb-3fb1-4597-848e-c027d882817e admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.510209 Oct 31 12:26:03.912816 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: [pid: 103775|app: 0|req: 9/17] 10.222.0.15 () {64 vars in 1283 bytes} [Mon Oct 31 12:26:03 2022] POST /compute/v2.1/flavors => generated 404 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 12:26:03.926632 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi [None req-38f10147-71e7-4396-b9b1-e852f5f2575d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 12:26:03.957048 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: INFO nova.api.openstack.requestlog [None req-38f10147-71e7-4396-b9b1-e852f5f2575d admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035773 Oct 31 12:26:03.957872 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: [pid: 103776|app: 0|req: 9/18] 10.222.0.15 () {64 vars in 1336 bytes} [Mon Oct 31 12:26:03 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:26:07.220522 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi [None req-d89d9ceb-3fb1-4597-848e-c027d882817e admin admin] Calling method '>' {{(pid=103775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:26:07.221579 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: INFO nova.api.openstack.requestlog [None req-d89d9ceb-3fb1-4597-848e-c027d882817e admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001716 Oct 31 12:26:07.221983 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: [pid: 103775|app: 0|req: 10/19] 10.222.0.15 () {54 vars in 931 bytes} [Mon Oct 31 12:26:07 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 12:26:07.651828 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi [None req-3a7f104f-770c-4d2f-a53b-74b0b74afa31 admin admin] Calling method '>' {{(pid=103776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:26:07.676708 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: INFO nova.api.openstack.requestlog [None req-3a7f104f-770c-4d2f-a53b-74b0b74afa31 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.448654 Oct 31 12:26:07.677281 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: [pid: 103776|app: 0|req: 10/20] 10.222.0.15 () {60 vars in 1292 bytes} [Mon Oct 31 12:26:07 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 12:26:10.260147 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi [None req-d89d9ceb-3fb1-4597-848e-c027d882817e admin admin] Calling method '>' {{(pid=103775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:26:10.261143 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: INFO nova.api.openstack.requestlog [None req-d89d9ceb-3fb1-4597-848e-c027d882817e admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001525 Oct 31 12:26:10.261537 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: [pid: 103775|app: 0|req: 11/21] 10.222.0.15 () {54 vars in 931 bytes} [Mon Oct 31 12:26:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 12:26:10.666003 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi [None req-cb5e054c-8993-4e95-a04d-5d9bd0fe9e46 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "name": "m1.tiny", "OS-FLV-EXT-DATA:ephemeral": 0, "id": "1", "os-flavor-access:is_public": true, "swap": 0, "rxtx_factor": 1.0, "disk": 1, "vcpus": 1}} {{(pid=103776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 12:26:10.689798 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: INFO nova.api.openstack.requestlog [None req-cb5e054c-8993-4e95-a04d-5d9bd0fe9e46 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.421567 Oct 31 12:26:10.690365 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: [pid: 103776|app: 0|req: 11/22] 10.222.0.15 () {64 vars in 1283 bytes} [Mon Oct 31 12:26:10 2022] POST /compute/v2.1/flavors => generated 402 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 12:26:10.702996 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi [None req-7f9da38d-ea81-4d41-8073-597833d3aedb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 12:26:10.732291 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: INFO nova.api.openstack.requestlog [None req-7f9da38d-ea81-4d41-8073-597833d3aedb admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033198 Oct 31 12:26:10.732866 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: [pid: 103775|app: 0|req: 12/23] 10.222.0.15 () {64 vars in 1333 bytes} [Mon Oct 31 12:26:10 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:26:13.314740 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi [None req-cb5e054c-8993-4e95-a04d-5d9bd0fe9e46 admin admin] Calling method '>' {{(pid=103776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:26:13.315783 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: INFO nova.api.openstack.requestlog [None req-cb5e054c-8993-4e95-a04d-5d9bd0fe9e46 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 Oct 31 12:26:13.316456 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: [pid: 103776|app: 0|req: 12/24] 10.222.0.15 () {54 vars in 931 bytes} [Mon Oct 31 12:26:13 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 12:26:13.742479 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi [None req-5a8d7701-bb9c-477b-b4ea-3467bbf59173 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.small", "swap": 0, "id": "2", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "disk": 20, "ram": 2048, "os-flavor-access:is_public": true}} {{(pid=103775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 12:26:13.761969 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: INFO nova.api.openstack.requestlog [None req-5a8d7701-bb9c-477b-b4ea-3467bbf59173 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.439624 Oct 31 12:26:13.762520 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: [pid: 103775|app: 0|req: 13/25] 10.222.0.15 () {64 vars in 1283 bytes} [Mon Oct 31 12:26:13 2022] POST /compute/v2.1/flavors => generated 405 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 12:26:13.774944 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi [None req-c4892793-476b-4c93-8189-482e49af0263 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 12:26:13.801959 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: INFO nova.api.openstack.requestlog [None req-c4892793-476b-4c93-8189-482e49af0263 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030623 Oct 31 12:26:13.802539 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: [pid: 103776|app: 0|req: 13/26] 10.222.0.15 () {64 vars in 1333 bytes} [Mon Oct 31 12:26:13 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:26:16.437076 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi [None req-5a8d7701-bb9c-477b-b4ea-3467bbf59173 admin admin] Calling method '>' {{(pid=103775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:26:16.438077 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: INFO nova.api.openstack.requestlog [None req-5a8d7701-bb9c-477b-b4ea-3467bbf59173 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 Oct 31 12:26:16.438998 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: [pid: 103775|app: 0|req: 14/27] 10.222.0.15 () {54 vars in 931 bytes} [Mon Oct 31 12:26:16 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 12:26:16.903136 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi [None req-8faaad2d-5341-4c4c-b210-02c96881787c admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "os-flavor-access:is_public": true, "disk": 40, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "swap": 0, "vcpus": 2, "name": "m1.medium", "id": "3"}} {{(pid=103776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 12:26:16.925101 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: INFO nova.api.openstack.requestlog [None req-8faaad2d-5341-4c4c-b210-02c96881787c admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.479295 Oct 31 12:26:16.925952 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: [pid: 103776|app: 0|req: 14/28] 10.222.0.15 () {64 vars in 1283 bytes} [Mon Oct 31 12:26:16 2022] POST /compute/v2.1/flavors => generated 406 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 12:26:16.937908 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi [None req-2a6f67c0-d1f0-4a69-a1f7-41f1d1890522 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 12:26:16.943310 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG dbcounter [-] [103775] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=7,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=103775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:26:16.972958 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: INFO nova.api.openstack.requestlog [None req-2a6f67c0-d1f0-4a69-a1f7-41f1d1890522 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.038653 Oct 31 12:26:16.973556 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: [pid: 103775|app: 0|req: 15/29] 10.222.0.15 () {64 vars in 1333 bytes} [Mon Oct 31 12:26:16 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 12:26:19.615584 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi [None req-8faaad2d-5341-4c4c-b210-02c96881787c admin admin] Calling method '>' {{(pid=103776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:26:19.617371 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: INFO nova.api.openstack.requestlog [None req-8faaad2d-5341-4c4c-b210-02c96881787c admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002214 Oct 31 12:26:19.618170 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: [pid: 103776|app: 0|req: 15/30] 10.222.0.15 () {54 vars in 931 bytes} [Mon Oct 31 12:26:19 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 12:26:20.049318 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi [None req-9764da6c-d706-48fa-9e47-bb5d0958c734 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 8192, "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true, "name": "m1.large", "rxtx_factor": 1.0, "id": "4", "disk": 80}} {{(pid=103775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 12:26:20.069845 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: INFO nova.api.openstack.requestlog [None req-9764da6c-d706-48fa-9e47-bb5d0958c734 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.445851 Oct 31 12:26:20.070388 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: [pid: 103775|app: 0|req: 16/31] 10.222.0.15 () {64 vars in 1283 bytes} [Mon Oct 31 12:26:19 2022] POST /compute/v2.1/flavors => generated 405 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 12:26:20.082255 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi [None req-b05b239a-20f3-484e-a53d-68246c97c3d3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 12:26:20.107439 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: INFO nova.api.openstack.requestlog [None req-b05b239a-20f3-484e-a53d-68246c97c3d3 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028769 Oct 31 12:26:20.111404 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: [pid: 103776|app: 0|req: 16/32] 10.222.0.15 () {64 vars in 1333 bytes} [Mon Oct 31 12:26:20 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:26:22.784766 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi [None req-9764da6c-d706-48fa-9e47-bb5d0958c734 admin admin] Calling method '>' {{(pid=103775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:26:22.786344 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: INFO nova.api.openstack.requestlog [None req-9764da6c-d706-48fa-9e47-bb5d0958c734 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002235 Oct 31 12:26:22.786931 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: [pid: 103775|app: 0|req: 17/33] 10.222.0.15 () {54 vars in 931 bytes} [Mon Oct 31 12:26:22 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 12:26:23.378708 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi [None req-ce1adde7-a818-4e68-823f-9dbe5c89d2fa admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 8, "rxtx_factor": 1.0, "id": "5", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 16384, "swap": 0, "name": "m1.xlarge", "disk": 160}} {{(pid=103776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 12:26:23.388476 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG dbcounter [-] [103776] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=103776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:26:23.403619 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: INFO nova.api.openstack.requestlog [None req-ce1adde7-a818-4e68-823f-9dbe5c89d2fa admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.610177 Oct 31 12:26:23.404174 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: [pid: 103776|app: 0|req: 17/34] 10.222.0.15 () {64 vars in 1283 bytes} [Mon Oct 31 12:26:22 2022] POST /compute/v2.1/flavors => generated 408 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 12:26:23.416977 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi [None req-b18a1c88-c8e0-42f6-bca1-766bf9e3ceb8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 12:26:23.443726 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: INFO nova.api.openstack.requestlog [None req-b18a1c88-c8e0-42f6-bca1-766bf9e3ceb8 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030460 Oct 31 12:26:23.452252 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: [pid: 103775|app: 0|req: 18/35] 10.222.0.15 () {64 vars in 1333 bytes} [Mon Oct 31 12:26:23 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 12:26:39.428181 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi [None req-ce1adde7-a818-4e68-823f-9dbe5c89d2fa admin admin] Calling method '>' {{(pid=103776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:26:39.429195 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: INFO nova.api.openstack.requestlog [None req-ce1adde7-a818-4e68-823f-9dbe5c89d2fa admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001463 Oct 31 12:26:39.429598 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: [pid: 103776|app: 0|req: 18/36] 10.222.0.15 () {54 vars in 931 bytes} [Mon Oct 31 12:26:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 12:26:39.440087 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG dbcounter [-] [103775] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=3,nova_api:RELEASE=2 {{(pid=103775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:26:39.818205 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi [None req-34a897be-a6b1-4ea7-94d6-1b4cb7c086ab admin admin] Calling method '>' {{(pid=103775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:26:39.835827 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: INFO nova.api.openstack.requestlog [None req-34a897be-a6b1-4ea7-94d6-1b4cb7c086ab admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.400304 Oct 31 12:26:39.836354 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: [pid: 103775|app: 0|req: 19/37] 10.222.0.15 () {60 vars in 1292 bytes} [Mon Oct 31 12:26:39 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 12:26:41.119251 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi [None req-ce1adde7-a818-4e68-823f-9dbe5c89d2fa admin admin] Calling method '>' {{(pid=103776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:26:41.120259 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: INFO nova.api.openstack.requestlog [None req-ce1adde7-a818-4e68-823f-9dbe5c89d2fa admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Oct 31 12:26:41.120664 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: [pid: 103776|app: 0|req: 19/38] 10.222.0.15 () {56 vars in 1074 bytes} [Mon Oct 31 12:26:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 12:26:41.644154 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi [None req-14e6264e-64d8-4cfd-9e15-2331cbaa10f5 admin admin] Calling method '>' {{(pid=103775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:26:41.649374 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: INFO nova.api.openstack.wsgi [None req-14e6264e-64d8-4cfd-9e15-2331cbaa10f5 admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 31 12:26:41.652697 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi [None req-14e6264e-64d8-4cfd-9e15-2331cbaa10f5 admin admin] Request method failure captured: Oct 31 12:26:41.652697 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 31 12:26:41.652697 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: Accept: application/json Oct 31 12:26:41.652697 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: Accept-Encoding: gzip, deflate Oct 31 12:26:41.652697 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: Connection: keep-alive Oct 31 12:26:41.652697 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: Content-Length: 0 Oct 31 12:26:41.652697 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: Host: 10.222.0.15 Oct 31 12:26:41.652697 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: Openstack-Api-Version: compute 2.92 Oct 31 12:26:41.652697 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: Openstack-System-Scope: None Oct 31 12:26:41.652697 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: User-Agent: python-novaclient Oct 31 12:26:41.652697 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: X-Auth-Token: gAAAAABjX78B2s5YuYc1mKBNzHFV0XJswYldaTRE_jermf6pfQn6-DKJ7daI6v6D7WwhoAQWcxxndkEZkuNckJpJ0cfWl3jsAyj07hUtFBBh-KDtbpwRmrD0m3M5v-VYeHRIguUtbigHgkMnW0XrfchLZocDv7wEBnZf7AESl0h53-YeZ2JXaJA Oct 31 12:26:41.652697 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: X-Domain-Id: None Oct 31 12:26:41.652697 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: X-Domain-Name: None Oct 31 12:26:41.652697 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: X-Identity-Status: Confirmed Oct 31 12:26:41.652697 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: X-Is-Admin-Project: True Oct 31 12:26:41.652697 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: X-Openstack-Nova-Api-Version: 2.92 Oct 31 12:26:41.652697 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: X-Project-Domain-Id: default Oct 31 12:26:41.652697 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: X-Project-Domain-Name: Default Oct 31 12:26:41.652697 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: X-Project-Id: 20cfeec04f5e4394b2ab5ceaa7d9c63a Oct 31 12:26:41.652697 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: X-Project-Name: admin Oct 31 12:26:41.652697 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: X-Role: reader,member,admin Oct 31 12:26:41.652697 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: X-Roles: reader,member,admin Oct 31 12:26:41.654303 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/20cfeec04f5e4394b2ab5ceaa7d9c63a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_20cfeec04f5e4394b2ab5ceaa7d9c63a", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/20cfeec04f5e4394b2ab5ceaa7d9c63a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/20cfeec04f5e4394b2ab5ceaa7d9c63a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Oct 31 12:26:41.654303 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: X-Tenant: admin Oct 31 12:26:41.654303 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: X-Tenant-Id: 20cfeec04f5e4394b2ab5ceaa7d9c63a Oct 31 12:26:41.654303 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: X-Tenant-Name: admin Oct 31 12:26:41.654303 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: X-User: admin Oct 31 12:26:41.654303 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: X-User-Domain-Id: default Oct 31 12:26:41.654303 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: X-User-Domain-Name: Default Oct 31 12:26:41.654303 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: X-User-Id: d2ddf15ba0c7488b8e49f974bba93de7 Oct 31 12:26:41.654303 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: X-User-Name: admin Oct 31 12:26:41.654303 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: method: > Oct 31 12:26:41.654303 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: exception: Flavor 42 could not be found. Oct 31 12:26:41.654303 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: action_args: {'id': '42'} Oct 31 12:26:41.654303 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: {{(pid=103775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 12:26:41.654303 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 12:26:41.655397 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 31 12:26:41.655397 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 31 12:26:41.655397 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 31 12:26:41.655397 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 31 12:26:41.655397 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 31 12:26:41.655397 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 31 12:26:41.655397 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 31 12:26:41.655397 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 31 12:26:41.655397 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 31 12:26:41.655397 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 12:26:41.655397 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 31 12:26:41.655397 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 31 12:26:41.655397 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 31 12:26:41.655397 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: ERROR nova.api.openstack.wsgi Oct 31 12:26:41.655397 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 12:26:41.655397 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: ERROR nova.api.openstack.wsgi Oct 31 12:26:41.655397 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 12:26:41.655397 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 12:26:41.655397 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 12:26:41.657051 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 12:26:41.657051 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 12:26:41.657051 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 12:26:41.657051 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 12:26:41.657051 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 31 12:26:41.657051 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 31 12:26:41.657051 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 31 12:26:41.657051 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: ERROR nova.api.openstack.wsgi Oct 31 12:26:41.657051 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 12:26:41.657051 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: ERROR nova.api.openstack.wsgi Oct 31 12:26:41.657051 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 12:26:41.657051 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 12:26:41.657051 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 12:26:41.657051 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 12:26:41.657051 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 12:26:41.657051 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 31 12:26:41.657051 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: ERROR nova.api.openstack.wsgi Oct 31 12:26:41.657051 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi [None req-14e6264e-64d8-4cfd-9e15-2331cbaa10f5 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103775) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 12:26:41.658278 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: INFO nova.api.openstack.requestlog [None req-14e6264e-64d8-4cfd-9e15-2331cbaa10f5 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.385354 Oct 31 12:26:41.658278 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: [pid: 103775|app: 0|req: 20/39] 10.222.0.15 () {60 vars in 1190 bytes} [Mon Oct 31 12:26:41 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 387 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 31 12:26:41.663705 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi [None req-e5022ed6-c852-44f9-893b-224a62e1f65a admin admin] Calling method '>' {{(pid=103776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:26:41.686946 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: INFO nova.api.openstack.requestlog [None req-e5022ed6-c852-44f9-893b-224a62e1f65a admin admin] 10.222.0.15 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026857 Oct 31 12:26:41.688116 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: [pid: 103776|app: 0|req: 20/40] 10.222.0.15 () {60 vars in 1210 bytes} [Mon Oct 31 12:26:41 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 12:26:41.698491 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi [None req-98fa2673-a453-49ff-bccc-bd4649ad862a admin admin] Calling method '>' {{(pid=103775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:26:41.721163 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: INFO nova.api.openstack.requestlog [None req-98fa2673-a453-49ff-bccc-bd4649ad862a admin admin] 10.222.0.15 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.027144 Oct 31 12:26:41.721694 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: [pid: 103775|app: 0|req: 21/41] 10.222.0.15 () {60 vars in 1210 bytes} [Mon Oct 31 12:26:41 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 12:26:41.730814 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi [None req-31dca3d8-7d27-4740-9c46-4106a25eaa7f admin admin] Calling method '>' {{(pid=103776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:26:41.736871 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: INFO nova.api.openstack.wsgi [None req-31dca3d8-7d27-4740-9c46-4106a25eaa7f admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 31 12:26:41.740127 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi [None req-31dca3d8-7d27-4740-9c46-4106a25eaa7f admin admin] Request method failure captured: Oct 31 12:26:41.740127 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 31 12:26:41.740127 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: Accept: application/json Oct 31 12:26:41.740127 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: Accept-Encoding: gzip, deflate Oct 31 12:26:41.740127 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: Connection: keep-alive Oct 31 12:26:41.740127 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: Content-Length: 0 Oct 31 12:26:41.740127 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: Host: 10.222.0.15 Oct 31 12:26:41.740127 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: Openstack-Api-Version: compute 2.92 Oct 31 12:26:41.740127 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: Openstack-System-Scope: None Oct 31 12:26:41.740127 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: User-Agent: python-novaclient Oct 31 12:26:41.740127 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: X-Auth-Token: gAAAAABjX78B2s5YuYc1mKBNzHFV0XJswYldaTRE_jermf6pfQn6-DKJ7daI6v6D7WwhoAQWcxxndkEZkuNckJpJ0cfWl3jsAyj07hUtFBBh-KDtbpwRmrD0m3M5v-VYeHRIguUtbigHgkMnW0XrfchLZocDv7wEBnZf7AESl0h53-YeZ2JXaJA Oct 31 12:26:41.740127 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: X-Domain-Id: None Oct 31 12:26:41.740127 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: X-Domain-Name: None Oct 31 12:26:41.740127 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: X-Identity-Status: Confirmed Oct 31 12:26:41.740127 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: X-Is-Admin-Project: True Oct 31 12:26:41.740127 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: X-Openstack-Nova-Api-Version: 2.92 Oct 31 12:26:41.740127 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: X-Project-Domain-Id: default Oct 31 12:26:41.740127 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: X-Project-Domain-Name: Default Oct 31 12:26:41.740127 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: X-Project-Id: 20cfeec04f5e4394b2ab5ceaa7d9c63a Oct 31 12:26:41.740127 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: X-Project-Name: admin Oct 31 12:26:41.740127 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: X-Role: reader,member,admin Oct 31 12:26:41.740127 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: X-Roles: reader,member,admin Oct 31 12:26:41.741704 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/20cfeec04f5e4394b2ab5ceaa7d9c63a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_20cfeec04f5e4394b2ab5ceaa7d9c63a", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/20cfeec04f5e4394b2ab5ceaa7d9c63a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/20cfeec04f5e4394b2ab5ceaa7d9c63a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Oct 31 12:26:41.741704 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: X-Tenant: admin Oct 31 12:26:41.741704 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: X-Tenant-Id: 20cfeec04f5e4394b2ab5ceaa7d9c63a Oct 31 12:26:41.741704 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: X-Tenant-Name: admin Oct 31 12:26:41.741704 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: X-User: admin Oct 31 12:26:41.741704 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: X-User-Domain-Id: default Oct 31 12:26:41.741704 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: X-User-Domain-Name: Default Oct 31 12:26:41.741704 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: X-User-Id: d2ddf15ba0c7488b8e49f974bba93de7 Oct 31 12:26:41.741704 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: X-User-Name: admin Oct 31 12:26:41.741704 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: method: > Oct 31 12:26:41.741704 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: exception: Flavor 42 could not be found. Oct 31 12:26:41.741704 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: action_args: {'id': '42'} Oct 31 12:26:41.741704 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: {{(pid=103776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 12:26:41.741704 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 12:26:41.742644 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 31 12:26:41.742644 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 31 12:26:41.742644 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 31 12:26:41.742644 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 31 12:26:41.742644 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 31 12:26:41.742644 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 31 12:26:41.742644 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 31 12:26:41.742644 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 31 12:26:41.742644 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 31 12:26:41.742644 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 12:26:41.742644 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 31 12:26:41.742644 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 31 12:26:41.742644 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 31 12:26:41.742644 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: ERROR nova.api.openstack.wsgi Oct 31 12:26:41.742644 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 12:26:41.742644 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: ERROR nova.api.openstack.wsgi Oct 31 12:26:41.742644 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 12:26:41.742644 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 12:26:41.742644 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 12:26:41.743908 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 12:26:41.743908 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 12:26:41.743908 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 12:26:41.743908 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 12:26:41.743908 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 31 12:26:41.743908 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 31 12:26:41.743908 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 31 12:26:41.743908 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: ERROR nova.api.openstack.wsgi Oct 31 12:26:41.743908 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 12:26:41.743908 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: ERROR nova.api.openstack.wsgi Oct 31 12:26:41.743908 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 12:26:41.743908 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 12:26:41.743908 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 12:26:41.743908 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 12:26:41.743908 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 12:26:41.743908 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 31 12:26:41.743908 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: ERROR nova.api.openstack.wsgi Oct 31 12:26:41.743908 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi [None req-31dca3d8-7d27-4740-9c46-4106a25eaa7f admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 12:26:41.745241 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: INFO nova.api.openstack.requestlog [None req-31dca3d8-7d27-4740-9c46-4106a25eaa7f admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.014230 Oct 31 12:26:41.745241 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: [pid: 103776|app: 0|req: 21/42] 10.222.0.15 () {60 vars in 1190 bytes} [Mon Oct 31 12:26:41 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 31 12:26:42.941669 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi [None req-98fa2673-a453-49ff-bccc-bd4649ad862a admin admin] Calling method '>' {{(pid=103775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:26:42.942705 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: INFO nova.api.openstack.requestlog [None req-98fa2673-a453-49ff-bccc-bd4649ad862a admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001478 Oct 31 12:26:42.943098 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: [pid: 103775|app: 0|req: 22/43] 10.222.0.15 () {56 vars in 1074 bytes} [Mon Oct 31 12:26:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 12:26:43.459207 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi [None req-d03b2db6-4a36-4a12-b23e-0ded3ac085df admin admin] Calling method '>' {{(pid=103776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:26:43.464188 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: INFO nova.api.openstack.wsgi [None req-d03b2db6-4a36-4a12-b23e-0ded3ac085df admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 31 12:26:43.465682 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi [None req-d03b2db6-4a36-4a12-b23e-0ded3ac085df admin admin] Request method failure captured: Oct 31 12:26:43.465682 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 31 12:26:43.465682 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: Accept: application/json Oct 31 12:26:43.465682 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: Accept-Encoding: gzip, deflate Oct 31 12:26:43.465682 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: Connection: keep-alive Oct 31 12:26:43.465682 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: Content-Length: 0 Oct 31 12:26:43.465682 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: Host: 10.222.0.15 Oct 31 12:26:43.465682 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: Openstack-Api-Version: compute 2.92 Oct 31 12:26:43.465682 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: Openstack-System-Scope: None Oct 31 12:26:43.465682 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: User-Agent: python-novaclient Oct 31 12:26:43.465682 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: X-Auth-Token: gAAAAABjX78CdPk5XBBUQuLQX2-1qePQd3cffF6yPEb4aV8UGiJF6nIeVAR48h-CRGaLAlKrftPUlrzMch7LADSK87Rmir6_zE34Iz-42jDQizuSxASdWp3vdiafdSQZ3ziEXtyFZV0fWrGkUZhUDZCVpRNPGuJQPannEfiGcbvfQdXcci81qxc Oct 31 12:26:43.465682 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: X-Domain-Id: None Oct 31 12:26:43.465682 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: X-Domain-Name: None Oct 31 12:26:43.465682 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: X-Identity-Status: Confirmed Oct 31 12:26:43.465682 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: X-Is-Admin-Project: True Oct 31 12:26:43.465682 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: X-Openstack-Nova-Api-Version: 2.92 Oct 31 12:26:43.465682 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: X-Project-Domain-Id: default Oct 31 12:26:43.465682 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: X-Project-Domain-Name: Default Oct 31 12:26:43.465682 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: X-Project-Id: 20cfeec04f5e4394b2ab5ceaa7d9c63a Oct 31 12:26:43.465682 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: X-Project-Name: admin Oct 31 12:26:43.465682 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: X-Role: reader,member,admin Oct 31 12:26:43.465682 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: X-Roles: reader,member,admin Oct 31 12:26:43.467000 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/20cfeec04f5e4394b2ab5ceaa7d9c63a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_20cfeec04f5e4394b2ab5ceaa7d9c63a", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/20cfeec04f5e4394b2ab5ceaa7d9c63a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/20cfeec04f5e4394b2ab5ceaa7d9c63a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Oct 31 12:26:43.467000 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: X-Tenant: admin Oct 31 12:26:43.467000 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: X-Tenant-Id: 20cfeec04f5e4394b2ab5ceaa7d9c63a Oct 31 12:26:43.467000 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: X-Tenant-Name: admin Oct 31 12:26:43.467000 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: X-User: admin Oct 31 12:26:43.467000 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: X-User-Domain-Id: default Oct 31 12:26:43.467000 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: X-User-Domain-Name: Default Oct 31 12:26:43.467000 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: X-User-Id: d2ddf15ba0c7488b8e49f974bba93de7 Oct 31 12:26:43.467000 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: X-User-Name: admin Oct 31 12:26:43.467000 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: method: > Oct 31 12:26:43.467000 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: exception: Flavor 84 could not be found. Oct 31 12:26:43.467000 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: action_args: {'id': '84'} Oct 31 12:26:43.467000 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: {{(pid=103776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 12:26:43.467000 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 12:26:43.467797 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 31 12:26:43.467797 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 31 12:26:43.467797 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 31 12:26:43.467797 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 31 12:26:43.467797 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 31 12:26:43.467797 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 31 12:26:43.467797 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 31 12:26:43.467797 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 31 12:26:43.467797 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 31 12:26:43.467797 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 12:26:43.467797 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 31 12:26:43.467797 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 31 12:26:43.467797 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 31 12:26:43.467797 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: ERROR nova.api.openstack.wsgi Oct 31 12:26:43.467797 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 12:26:43.467797 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: ERROR nova.api.openstack.wsgi Oct 31 12:26:43.467797 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 12:26:43.467797 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 12:26:43.467797 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 12:26:43.469222 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 12:26:43.469222 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 12:26:43.469222 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 12:26:43.469222 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 12:26:43.469222 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 31 12:26:43.469222 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 31 12:26:43.469222 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 31 12:26:43.469222 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: ERROR nova.api.openstack.wsgi Oct 31 12:26:43.469222 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 12:26:43.469222 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: ERROR nova.api.openstack.wsgi Oct 31 12:26:43.469222 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 12:26:43.469222 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 12:26:43.469222 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 12:26:43.469222 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 12:26:43.469222 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 12:26:43.469222 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 31 12:26:43.469222 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: ERROR nova.api.openstack.wsgi Oct 31 12:26:43.469222 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi [None req-d03b2db6-4a36-4a12-b23e-0ded3ac085df admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 12:26:43.470413 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: INFO nova.api.openstack.requestlog [None req-d03b2db6-4a36-4a12-b23e-0ded3ac085df admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.389668 Oct 31 12:26:43.470413 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: [pid: 103776|app: 0|req: 22/44] 10.222.0.15 () {60 vars in 1190 bytes} [Mon Oct 31 12:26:43 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 391 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 31 12:26:43.476735 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi [None req-a190391b-94b0-4b05-b3dd-a105fe2ec44f admin admin] Calling method '>' {{(pid=103775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:26:43.491426 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: INFO nova.api.openstack.requestlog [None req-a190391b-94b0-4b05-b3dd-a105fe2ec44f admin admin] 10.222.0.15 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018280 Oct 31 12:26:43.491967 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: [pid: 103775|app: 0|req: 23/45] 10.222.0.15 () {60 vars in 1210 bytes} [Mon Oct 31 12:26:43 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 12:26:43.501780 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi [None req-cf29c5b2-3593-4834-9459-c754ee8aa7fc admin admin] Calling method '>' {{(pid=103776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:26:43.518510 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: INFO nova.api.openstack.requestlog [None req-cf29c5b2-3593-4834-9459-c754ee8aa7fc admin admin] 10.222.0.15 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.020891 Oct 31 12:26:43.519265 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: [pid: 103776|app: 0|req: 23/46] 10.222.0.15 () {60 vars in 1210 bytes} [Mon Oct 31 12:26:43 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 12:26:43.528300 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi [None req-ac4f8a05-1c80-419f-9032-c093792fcce4 admin admin] Calling method '>' {{(pid=103775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:26:43.533424 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: INFO nova.api.openstack.wsgi [None req-ac4f8a05-1c80-419f-9032-c093792fcce4 admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 31 12:26:43.535156 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi [None req-ac4f8a05-1c80-419f-9032-c093792fcce4 admin admin] Request method failure captured: Oct 31 12:26:43.535156 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 31 12:26:43.535156 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: Accept: application/json Oct 31 12:26:43.535156 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: Accept-Encoding: gzip, deflate Oct 31 12:26:43.535156 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: Connection: keep-alive Oct 31 12:26:43.535156 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: Content-Length: 0 Oct 31 12:26:43.535156 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: Host: 10.222.0.15 Oct 31 12:26:43.535156 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: Openstack-Api-Version: compute 2.92 Oct 31 12:26:43.535156 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: Openstack-System-Scope: None Oct 31 12:26:43.535156 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: User-Agent: python-novaclient Oct 31 12:26:43.535156 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: X-Auth-Token: gAAAAABjX78CdPk5XBBUQuLQX2-1qePQd3cffF6yPEb4aV8UGiJF6nIeVAR48h-CRGaLAlKrftPUlrzMch7LADSK87Rmir6_zE34Iz-42jDQizuSxASdWp3vdiafdSQZ3ziEXtyFZV0fWrGkUZhUDZCVpRNPGuJQPannEfiGcbvfQdXcci81qxc Oct 31 12:26:43.535156 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: X-Domain-Id: None Oct 31 12:26:43.535156 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: X-Domain-Name: None Oct 31 12:26:43.535156 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: X-Identity-Status: Confirmed Oct 31 12:26:43.535156 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: X-Is-Admin-Project: True Oct 31 12:26:43.535156 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: X-Openstack-Nova-Api-Version: 2.92 Oct 31 12:26:43.535156 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: X-Project-Domain-Id: default Oct 31 12:26:43.535156 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: X-Project-Domain-Name: Default Oct 31 12:26:43.535156 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: X-Project-Id: 20cfeec04f5e4394b2ab5ceaa7d9c63a Oct 31 12:26:43.535156 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: X-Project-Name: admin Oct 31 12:26:43.535156 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: X-Role: reader,member,admin Oct 31 12:26:43.535156 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: X-Roles: reader,member,admin Oct 31 12:26:43.536634 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/20cfeec04f5e4394b2ab5ceaa7d9c63a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_20cfeec04f5e4394b2ab5ceaa7d9c63a", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/20cfeec04f5e4394b2ab5ceaa7d9c63a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/20cfeec04f5e4394b2ab5ceaa7d9c63a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Oct 31 12:26:43.536634 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: X-Tenant: admin Oct 31 12:26:43.536634 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: X-Tenant-Id: 20cfeec04f5e4394b2ab5ceaa7d9c63a Oct 31 12:26:43.536634 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: X-Tenant-Name: admin Oct 31 12:26:43.536634 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: X-User: admin Oct 31 12:26:43.536634 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: X-User-Domain-Id: default Oct 31 12:26:43.536634 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: X-User-Domain-Name: Default Oct 31 12:26:43.536634 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: X-User-Id: d2ddf15ba0c7488b8e49f974bba93de7 Oct 31 12:26:43.536634 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: X-User-Name: admin Oct 31 12:26:43.536634 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: method: > Oct 31 12:26:43.536634 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: exception: Flavor 84 could not be found. Oct 31 12:26:43.536634 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: action_args: {'id': '84'} Oct 31 12:26:43.536634 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: {{(pid=103775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 12:26:43.536634 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 12:26:43.537600 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 31 12:26:43.537600 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 31 12:26:43.537600 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 31 12:26:43.537600 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 31 12:26:43.537600 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 31 12:26:43.537600 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 31 12:26:43.537600 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 31 12:26:43.537600 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 31 12:26:43.537600 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 31 12:26:43.537600 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 12:26:43.537600 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 31 12:26:43.537600 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 31 12:26:43.537600 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 31 12:26:43.537600 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: ERROR nova.api.openstack.wsgi Oct 31 12:26:43.537600 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 12:26:43.537600 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: ERROR nova.api.openstack.wsgi Oct 31 12:26:43.537600 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 12:26:43.537600 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 12:26:43.537600 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 12:26:43.538936 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 12:26:43.538936 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 12:26:43.538936 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 12:26:43.538936 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 12:26:43.538936 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 31 12:26:43.538936 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 31 12:26:43.538936 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 31 12:26:43.538936 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: ERROR nova.api.openstack.wsgi Oct 31 12:26:43.538936 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 12:26:43.538936 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: ERROR nova.api.openstack.wsgi Oct 31 12:26:43.538936 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 12:26:43.538936 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 12:26:43.538936 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 12:26:43.538936 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 12:26:43.538936 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 12:26:43.538936 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 31 12:26:43.538936 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: ERROR nova.api.openstack.wsgi Oct 31 12:26:43.538936 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi [None req-ac4f8a05-1c80-419f-9032-c093792fcce4 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103775) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 12:26:43.540367 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: INFO nova.api.openstack.requestlog [None req-ac4f8a05-1c80-419f-9032-c093792fcce4 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.011791 Oct 31 12:26:43.540367 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: [pid: 103775|app: 0|req: 24/47] 10.222.0.15 () {60 vars in 1190 bytes} [Mon Oct 31 12:26:43 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Oct 31 12:26:44.730645 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi [None req-cf29c5b2-3593-4834-9459-c754ee8aa7fc admin admin] Calling method '>' {{(pid=103776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:26:44.731757 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: INFO nova.api.openstack.requestlog [None req-cf29c5b2-3593-4834-9459-c754ee8aa7fc admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001545 Oct 31 12:26:44.732143 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: [pid: 103776|app: 0|req: 24/48] 10.222.0.15 () {56 vars in 1074 bytes} [Mon Oct 31 12:26:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 12:26:45.251277 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi [None req-f60672c1-d531-4113-a451-bea2c6682048 admin admin] Calling method '>' {{(pid=103775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:26:45.257023 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: INFO nova.api.openstack.wsgi [None req-f60672c1-d531-4113-a451-bea2c6682048 admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 31 12:26:45.258508 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi [None req-f60672c1-d531-4113-a451-bea2c6682048 admin admin] Request method failure captured: Oct 31 12:26:45.258508 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 31 12:26:45.258508 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: Accept: application/json Oct 31 12:26:45.258508 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: Accept-Encoding: gzip, deflate Oct 31 12:26:45.258508 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: Connection: keep-alive Oct 31 12:26:45.258508 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: Content-Length: 0 Oct 31 12:26:45.258508 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: Host: 10.222.0.15 Oct 31 12:26:45.258508 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: Openstack-Api-Version: compute 2.92 Oct 31 12:26:45.258508 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: Openstack-System-Scope: None Oct 31 12:26:45.258508 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: User-Agent: python-novaclient Oct 31 12:26:45.258508 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: X-Auth-Token: gAAAAABjX78Eq8gxQP53FuX8wwzjGoJklygDaLI-f8kfddBuUZ0LlFzfsK1MGtPrjGttfijehMahLeV-b2ypTC1keBYiT8J2M1oBlIiO4_vW_8JcYMOqiV09A0C94icUg_qJZ0D6QjsUrxtuVuKyJwb-QI3EbXXx826wCW3QApHVMwdBwhf-kpU Oct 31 12:26:45.258508 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: X-Domain-Id: None Oct 31 12:26:45.258508 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: X-Domain-Name: None Oct 31 12:26:45.258508 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: X-Identity-Status: Confirmed Oct 31 12:26:45.258508 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: X-Is-Admin-Project: True Oct 31 12:26:45.258508 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: X-Openstack-Nova-Api-Version: 2.92 Oct 31 12:26:45.258508 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: X-Project-Domain-Id: default Oct 31 12:26:45.258508 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: X-Project-Domain-Name: Default Oct 31 12:26:45.258508 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: X-Project-Id: 20cfeec04f5e4394b2ab5ceaa7d9c63a Oct 31 12:26:45.258508 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: X-Project-Name: admin Oct 31 12:26:45.258508 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: X-Role: reader,member,admin Oct 31 12:26:45.258508 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: X-Roles: reader,member,admin Oct 31 12:26:45.260093 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/20cfeec04f5e4394b2ab5ceaa7d9c63a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_20cfeec04f5e4394b2ab5ceaa7d9c63a", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/20cfeec04f5e4394b2ab5ceaa7d9c63a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/20cfeec04f5e4394b2ab5ceaa7d9c63a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Oct 31 12:26:45.260093 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: X-Tenant: admin Oct 31 12:26:45.260093 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: X-Tenant-Id: 20cfeec04f5e4394b2ab5ceaa7d9c63a Oct 31 12:26:45.260093 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: X-Tenant-Name: admin Oct 31 12:26:45.260093 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: X-User: admin Oct 31 12:26:45.260093 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: X-User-Domain-Id: default Oct 31 12:26:45.260093 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: X-User-Domain-Name: Default Oct 31 12:26:45.260093 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: X-User-Id: d2ddf15ba0c7488b8e49f974bba93de7 Oct 31 12:26:45.260093 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: X-User-Name: admin Oct 31 12:26:45.260093 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: method: > Oct 31 12:26:45.260093 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: exception: Flavor 451 could not be found. Oct 31 12:26:45.260093 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: action_args: {'id': '451'} Oct 31 12:26:45.260093 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: {{(pid=103775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 12:26:45.260093 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 12:26:45.260936 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 31 12:26:45.260936 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 31 12:26:45.260936 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 31 12:26:45.260936 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 31 12:26:45.260936 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 31 12:26:45.260936 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 31 12:26:45.260936 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 31 12:26:45.260936 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 31 12:26:45.260936 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 31 12:26:45.260936 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 12:26:45.260936 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 31 12:26:45.260936 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 31 12:26:45.260936 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 31 12:26:45.260936 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: ERROR nova.api.openstack.wsgi Oct 31 12:26:45.260936 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 12:26:45.260936 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: ERROR nova.api.openstack.wsgi Oct 31 12:26:45.260936 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 12:26:45.260936 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 12:26:45.260936 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 12:26:45.261989 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 12:26:45.261989 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 12:26:45.261989 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 12:26:45.261989 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 12:26:45.261989 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 31 12:26:45.261989 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 31 12:26:45.261989 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 31 12:26:45.261989 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: ERROR nova.api.openstack.wsgi Oct 31 12:26:45.261989 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 12:26:45.261989 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: ERROR nova.api.openstack.wsgi Oct 31 12:26:45.261989 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 12:26:45.261989 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 12:26:45.261989 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 12:26:45.261989 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 12:26:45.261989 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 12:26:45.261989 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 31 12:26:45.261989 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: ERROR nova.api.openstack.wsgi Oct 31 12:26:45.261989 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi [None req-f60672c1-d531-4113-a451-bea2c6682048 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103775) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 12:26:45.262998 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: INFO nova.api.openstack.requestlog [None req-f60672c1-d531-4113-a451-bea2c6682048 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.391600 Oct 31 12:26:45.262998 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: [pid: 103775|app: 0|req: 25/49] 10.222.0.15 () {60 vars in 1193 bytes} [Mon Oct 31 12:26:44 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 393 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 31 12:26:45.270241 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi [None req-52d404a4-0b8d-4f99-b4cd-6612521af9a8 admin admin] Calling method '>' {{(pid=103776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:26:45.285019 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: INFO nova.api.openstack.requestlog [None req-52d404a4-0b8d-4f99-b4cd-6612521af9a8 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018891 Oct 31 12:26:45.285564 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: [pid: 103776|app: 0|req: 25/50] 10.222.0.15 () {60 vars in 1210 bytes} [Mon Oct 31 12:26:45 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 12:26:45.295153 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi [None req-d9b9ae8c-d926-4b0d-a647-d92dfb58edf3 admin admin] Calling method '>' {{(pid=103775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:26:45.310438 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: INFO nova.api.openstack.requestlog [None req-d9b9ae8c-d926-4b0d-a647-d92dfb58edf3 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018855 Oct 31 12:26:45.310985 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: [pid: 103775|app: 0|req: 26/51] 10.222.0.15 () {60 vars in 1210 bytes} [Mon Oct 31 12:26:45 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 12:26:45.320769 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi [None req-25460f8b-fbdc-4862-b553-02eac0c76bbc admin admin] Calling method '>' {{(pid=103776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:26:45.325667 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: INFO nova.api.openstack.wsgi [None req-25460f8b-fbdc-4862-b553-02eac0c76bbc admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 31 12:26:45.327144 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi [None req-25460f8b-fbdc-4862-b553-02eac0c76bbc admin admin] Request method failure captured: Oct 31 12:26:45.327144 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 31 12:26:45.327144 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: Accept: application/json Oct 31 12:26:45.327144 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: Accept-Encoding: gzip, deflate Oct 31 12:26:45.327144 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: Connection: keep-alive Oct 31 12:26:45.327144 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: Content-Length: 0 Oct 31 12:26:45.327144 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: Host: 10.222.0.15 Oct 31 12:26:45.327144 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: Openstack-Api-Version: compute 2.92 Oct 31 12:26:45.327144 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: Openstack-System-Scope: None Oct 31 12:26:45.327144 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: User-Agent: python-novaclient Oct 31 12:26:45.327144 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: X-Auth-Token: gAAAAABjX78Eq8gxQP53FuX8wwzjGoJklygDaLI-f8kfddBuUZ0LlFzfsK1MGtPrjGttfijehMahLeV-b2ypTC1keBYiT8J2M1oBlIiO4_vW_8JcYMOqiV09A0C94icUg_qJZ0D6QjsUrxtuVuKyJwb-QI3EbXXx826wCW3QApHVMwdBwhf-kpU Oct 31 12:26:45.327144 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: X-Domain-Id: None Oct 31 12:26:45.327144 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: X-Domain-Name: None Oct 31 12:26:45.327144 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: X-Identity-Status: Confirmed Oct 31 12:26:45.327144 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: X-Is-Admin-Project: True Oct 31 12:26:45.327144 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: X-Openstack-Nova-Api-Version: 2.92 Oct 31 12:26:45.327144 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: X-Project-Domain-Id: default Oct 31 12:26:45.327144 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: X-Project-Domain-Name: Default Oct 31 12:26:45.327144 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: X-Project-Id: 20cfeec04f5e4394b2ab5ceaa7d9c63a Oct 31 12:26:45.327144 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: X-Project-Name: admin Oct 31 12:26:45.327144 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: X-Role: reader,member,admin Oct 31 12:26:45.327144 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: X-Roles: reader,member,admin Oct 31 12:26:45.328977 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/20cfeec04f5e4394b2ab5ceaa7d9c63a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_20cfeec04f5e4394b2ab5ceaa7d9c63a", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/20cfeec04f5e4394b2ab5ceaa7d9c63a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/20cfeec04f5e4394b2ab5ceaa7d9c63a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Oct 31 12:26:45.328977 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: X-Tenant: admin Oct 31 12:26:45.328977 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: X-Tenant-Id: 20cfeec04f5e4394b2ab5ceaa7d9c63a Oct 31 12:26:45.328977 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: X-Tenant-Name: admin Oct 31 12:26:45.328977 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: X-User: admin Oct 31 12:26:45.328977 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: X-User-Domain-Id: default Oct 31 12:26:45.328977 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: X-User-Domain-Name: Default Oct 31 12:26:45.328977 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: X-User-Id: d2ddf15ba0c7488b8e49f974bba93de7 Oct 31 12:26:45.328977 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: X-User-Name: admin Oct 31 12:26:45.328977 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: method: > Oct 31 12:26:45.328977 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: exception: Flavor 451 could not be found. Oct 31 12:26:45.328977 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: action_args: {'id': '451'} Oct 31 12:26:45.328977 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: {{(pid=103776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 12:26:45.328977 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 12:26:45.330016 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 31 12:26:45.330016 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 31 12:26:45.330016 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 31 12:26:45.330016 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 31 12:26:45.330016 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 31 12:26:45.330016 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 31 12:26:45.330016 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 31 12:26:45.330016 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 31 12:26:45.330016 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 31 12:26:45.330016 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 12:26:45.330016 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 31 12:26:45.330016 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 31 12:26:45.330016 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 31 12:26:45.330016 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: ERROR nova.api.openstack.wsgi Oct 31 12:26:45.330016 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 12:26:45.330016 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: ERROR nova.api.openstack.wsgi Oct 31 12:26:45.330016 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 12:26:45.330016 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 12:26:45.330016 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 12:26:45.331286 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 12:26:45.331286 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 12:26:45.331286 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 12:26:45.331286 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 12:26:45.331286 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 31 12:26:45.331286 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 31 12:26:45.331286 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 31 12:26:45.331286 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: ERROR nova.api.openstack.wsgi Oct 31 12:26:45.331286 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 12:26:45.331286 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: ERROR nova.api.openstack.wsgi Oct 31 12:26:45.331286 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 12:26:45.331286 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 12:26:45.331286 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 12:26:45.331286 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 12:26:45.331286 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 12:26:45.331286 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 31 12:26:45.331286 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: ERROR nova.api.openstack.wsgi Oct 31 12:26:45.331286 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi [None req-25460f8b-fbdc-4862-b553-02eac0c76bbc admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 12:26:45.332673 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: INFO nova.api.openstack.requestlog [None req-25460f8b-fbdc-4862-b553-02eac0c76bbc admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.011213 Oct 31 12:26:45.332673 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: [pid: 103776|app: 0|req: 26/52] 10.222.0.15 () {60 vars in 1193 bytes} [Mon Oct 31 12:26:45 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Oct 31 12:26:46.533813 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi [None req-d9b9ae8c-d926-4b0d-a647-d92dfb58edf3 admin admin] Calling method '>' {{(pid=103775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:26:46.534833 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: INFO nova.api.openstack.requestlog [None req-d9b9ae8c-d926-4b0d-a647-d92dfb58edf3 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 Oct 31 12:26:46.535254 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: [pid: 103775|app: 0|req: 27/53] 10.222.0.15 () {56 vars in 1074 bytes} [Mon Oct 31 12:26:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 12:26:47.053922 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi [None req-4f7ed1cb-005b-4215-ab62-6dd8ca09cf5e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 12:26:47.073273 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: INFO nova.api.openstack.requestlog [None req-4f7ed1cb-005b-4215-ab62-6dd8ca09cf5e admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.398738 Oct 31 12:26:47.073805 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: [pid: 103776|app: 0|req: 27/54] 10.222.0.15 () {64 vars in 1235 bytes} [Mon Oct 31 12:26:46 2022] POST /compute/v2.1/flavors => generated 404 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 12:26:48.270969 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi [None req-d9b9ae8c-d926-4b0d-a647-d92dfb58edf3 admin admin] Calling method '>' {{(pid=103775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:26:48.272000 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: INFO nova.api.openstack.requestlog [None req-d9b9ae8c-d926-4b0d-a647-d92dfb58edf3 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 Oct 31 12:26:48.272394 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: [pid: 103775|app: 0|req: 28/55] 10.222.0.15 () {56 vars in 1074 bytes} [Mon Oct 31 12:26:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 12:26:48.790326 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi [None req-2bd69ec0-183a-4f0c-8471-f12191af3e76 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 12:26:48.809267 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: INFO nova.api.openstack.requestlog [None req-2bd69ec0-183a-4f0c-8471-f12191af3e76 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.400624 Oct 31 12:26:48.809847 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: [pid: 103776|app: 0|req: 28/56] 10.222.0.15 () {64 vars in 1235 bytes} [Mon Oct 31 12:26:48 2022] POST /compute/v2.1/flavors => generated 405 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 12:26:50.006926 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi [None req-d9b9ae8c-d926-4b0d-a647-d92dfb58edf3 admin admin] Calling method '>' {{(pid=103775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:26:50.007996 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: INFO nova.api.openstack.requestlog [None req-d9b9ae8c-d926-4b0d-a647-d92dfb58edf3 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001496 Oct 31 12:26:50.008388 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: [pid: 103775|app: 0|req: 29/57] 10.222.0.15 () {56 vars in 1074 bytes} [Mon Oct 31 12:26:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 12:26:50.526721 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi [None req-892d1373-e6bd-45f0-92f5-35bfd1842db4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 12:26:50.545563 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: INFO nova.api.openstack.requestlog [None req-892d1373-e6bd-45f0-92f5-35bfd1842db4 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.402134 Oct 31 12:26:50.546128 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: [pid: 103776|app: 0|req: 29/58] 10.222.0.15 () {64 vars in 1235 bytes} [Mon Oct 31 12:26:50 2022] POST /compute/v2.1/flavors => generated 407 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 31 12:26:51.849190 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi [None req-d9b9ae8c-d926-4b0d-a647-d92dfb58edf3 admin admin] Calling method '>' {{(pid=103775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:26:51.850198 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: INFO nova.api.openstack.requestlog [None req-d9b9ae8c-d926-4b0d-a647-d92dfb58edf3 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001430 Oct 31 12:26:51.850591 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: [pid: 103775|app: 0|req: 30/59] 10.222.0.15 () {56 vars in 1074 bytes} [Mon Oct 31 12:26:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 12:26:52.373153 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi [None req-82c66621-9660-42d4-aadc-f09c6006ef4b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 12:26:52.392940 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: INFO nova.api.openstack.requestlog [None req-82c66621-9660-42d4-aadc-f09c6006ef4b admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.404102 Oct 31 12:26:52.393485 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: [pid: 103776|app: 0|req: 30/60] 10.222.0.15 () {64 vars in 1235 bytes} [Mon Oct 31 12:26:51 2022] POST /compute/v2.1/flavors => generated 409 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 12:26:53.588559 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi [None req-d9b9ae8c-d926-4b0d-a647-d92dfb58edf3 admin admin] Calling method '>' {{(pid=103775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:26:53.589575 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: INFO nova.api.openstack.requestlog [None req-d9b9ae8c-d926-4b0d-a647-d92dfb58edf3 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001491 Oct 31 12:26:53.589977 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: [pid: 103775|app: 0|req: 31/61] 10.222.0.15 () {56 vars in 1074 bytes} [Mon Oct 31 12:26:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 12:26:54.109172 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi [None req-9e82dbdd-ccd4-463b-8077-415fc3825efb admin admin] Calling method '>' {{(pid=103776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:26:54.129761 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: INFO nova.api.openstack.requestlog [None req-9e82dbdd-ccd4-463b-8077-415fc3825efb admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.402706 Oct 31 12:26:54.130304 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: [pid: 103776|app: 0|req: 31/62] 10.222.0.15 () {60 vars in 1202 bytes} [Mon Oct 31 12:26:53 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 12:27:50.507470 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi [None req-d9b9ae8c-d926-4b0d-a647-d92dfb58edf3 admin admin] Calling method '>' {{(pid=103775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:27:50.508393 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: INFO nova.api.openstack.requestlog [None req-d9b9ae8c-d926-4b0d-a647-d92dfb58edf3 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001487 Oct 31 12:27:50.508791 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: [pid: 103775|app: 0|req: 32/63] 10.222.0.15 () {54 vars in 931 bytes} [Mon Oct 31 12:27:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 12:27:50.519840 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG dbcounter [-] [103776] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=103776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:27:50.892784 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi [None req-c27102bf-d8f0-4b2b-bd9d-a75392de06bf admin admin] Calling method '>' {{(pid=103776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:27:50.913188 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: INFO nova.api.openstack.requestlog [None req-c27102bf-d8f0-4b2b-bd9d-a75392de06bf admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.398566 Oct 31 12:27:50.913735 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: [pid: 103776|app: 0|req: 32/64] 10.222.0.15 () {60 vars in 1292 bytes} [Mon Oct 31 12:27:50 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 12:27:50.934868 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG dbcounter [-] [103775] Writing DB stats nova_api:SELECT=14 {{(pid=103775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:27:50.939305 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi [None req-437fe67b-e0be-4fba-b996-dd44ea4f0ac4 admin admin] Calling method '>' {{(pid=103775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:27:50.946525 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: INFO nova.api.openstack.requestlog [None req-437fe67b-e0be-4fba-b996-dd44ea4f0ac4 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013089 Oct 31 12:27:50.947037 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: [pid: 103775|app: 0|req: 33/65] 10.222.0.15 () {60 vars in 1283 bytes} [Mon Oct 31 12:27:50 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 12:27:50.959135 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi [None req-274e5e13-4aab-4686-9b4f-d48dc2457c72 admin admin] Calling method '>' {{(pid=103776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:27:50.966348 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: INFO nova.api.openstack.requestlog [None req-274e5e13-4aab-4686-9b4f-d48dc2457c72 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010714 Oct 31 12:27:50.966851 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: [pid: 103776|app: 0|req: 33/66] 10.222.0.15 () {60 vars in 1286 bytes} [Mon Oct 31 12:27:50 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:27:50.977885 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi [None req-b5699144-aaac-4235-9982-9090dab5cc49 admin admin] Calling method '>' {{(pid=103775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:27:50.985193 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: INFO nova.api.openstack.requestlog [None req-b5699144-aaac-4235-9982-9090dab5cc49 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010736 Oct 31 12:27:50.985701 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: [pid: 103775|app: 0|req: 34/67] 10.222.0.15 () {60 vars in 1286 bytes} [Mon Oct 31 12:27:50 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:27:50.996733 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi [None req-df56f19a-21c4-41d8-a18c-51e7dbc62a3d admin admin] Calling method '>' {{(pid=103776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:27:51.004251 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: INFO nova.api.openstack.requestlog [None req-df56f19a-21c4-41d8-a18c-51e7dbc62a3d admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010966 Oct 31 12:27:51.004755 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: [pid: 103776|app: 0|req: 34/68] 10.222.0.15 () {60 vars in 1283 bytes} [Mon Oct 31 12:27:50 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:30:45.837588 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi [None req-b5699144-aaac-4235-9982-9090dab5cc49 admin admin] Calling method '>' {{(pid=103775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:30:45.838594 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: INFO nova.api.openstack.requestlog [None req-b5699144-aaac-4235-9982-9090dab5cc49 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001447 Oct 31 12:30:45.838990 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: [pid: 103775|app: 0|req: 35/69] 10.222.0.15 () {56 vars in 1074 bytes} [Mon Oct 31 12:30:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 12:30:45.980004 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG dbcounter [-] [103776] Writing DB stats nova_api:SELECT=6 {{(pid=103776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:30:46.144406 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi [None req-fabfe506-7936-4810-87ad-a582e6bc9342 admin admin] Calling method '>' {{(pid=103776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:30:46.149358 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG oslo_concurrency.lockutils [None req-fabfe506-7936-4810-87ad-a582e6bc9342 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:30:46.149835 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG oslo_concurrency.lockutils [None req-fabfe506-7936-4810-87ad-a582e6bc9342 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:30:46.150265 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG oslo_concurrency.lockutils [None req-fabfe506-7936-4810-87ad-a582e6bc9342 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:30:46.150981 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG oslo_concurrency.lockutils [None req-fabfe506-7936-4810-87ad-a582e6bc9342 admin admin] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:30:46.151457 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG oslo_concurrency.lockutils [None req-fabfe506-7936-4810-87ad-a582e6bc9342 admin admin] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:30:46.151875 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG oslo_concurrency.lockutils [None req-fabfe506-7936-4810-87ad-a582e6bc9342 admin admin] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:30:46.183754 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: INFO nova.api.openstack.requestlog [None req-fabfe506-7936-4810-87ad-a582e6bc9342 admin admin] 10.222.0.15 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.204896 Oct 31 12:30:46.184308 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: [pid: 103776|app: 0|req: 35/70] 10.222.0.15 () {60 vars in 1193 bytes} [Mon Oct 31 12:30:45 2022] GET /compute/v2.1/os-services => generated 791 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 12:30:47.269069 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi [None req-b5699144-aaac-4235-9982-9090dab5cc49 admin admin] Calling method '>' {{(pid=103775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:30:47.270339 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: INFO nova.api.openstack.requestlog [None req-b5699144-aaac-4235-9982-9090dab5cc49 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001695 Oct 31 12:30:47.270737 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: [pid: 103775|app: 0|req: 36/71] 10.222.0.15 () {56 vars in 1074 bytes} [Mon Oct 31 12:30:47 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 12:30:47.461319 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi [None req-e38fb654-1817-4b51-9358-f67fbdfe197d admin admin] Calling method '>' {{(pid=103776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:30:47.464777 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG oslo_concurrency.lockutils [None req-e38fb654-1817-4b51-9358-f67fbdfe197d admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:30:47.465257 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG oslo_concurrency.lockutils [None req-e38fb654-1817-4b51-9358-f67fbdfe197d admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:30:47.465683 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG oslo_concurrency.lockutils [None req-e38fb654-1817-4b51-9358-f67fbdfe197d admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:30:47.466396 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG oslo_concurrency.lockutils [None req-e38fb654-1817-4b51-9358-f67fbdfe197d admin admin] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:30:47.466844 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG oslo_concurrency.lockutils [None req-e38fb654-1817-4b51-9358-f67fbdfe197d admin admin] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:30:47.467287 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG oslo_concurrency.lockutils [None req-e38fb654-1817-4b51-9358-f67fbdfe197d admin admin] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:30:47.486878 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: INFO nova.api.openstack.requestlog [None req-e38fb654-1817-4b51-9358-f67fbdfe197d admin admin] 10.222.0.15 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.076823 Oct 31 12:30:47.487458 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: [pid: 103776|app: 0|req: 36/72] 10.222.0.15 () {60 vars in 1193 bytes} [Mon Oct 31 12:30:47 2022] GET /compute/v2.1/os-services => generated 791 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 12:30:58.960377 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi [None req-b5699144-aaac-4235-9982-9090dab5cc49 admin admin] Calling method '>' {{(pid=103775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:30:58.961647 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: INFO nova.api.openstack.requestlog [None req-b5699144-aaac-4235-9982-9090dab5cc49 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001708 Oct 31 12:30:58.962053 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: [pid: 103775|app: 0|req: 37/73] 10.222.0.15 () {56 vars in 1074 bytes} [Mon Oct 31 12:30:58 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 12:30:59.109535 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG dbcounter [-] [103776] Writing DB stats nova_cell0:SELECT=4 {{(pid=103776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:30:59.110806 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG dbcounter [-] [103776] Writing DB stats nova_cell1:SELECT=4 {{(pid=103776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:30:59.111576 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG dbcounter [-] [103776] Writing DB stats nova_api:SELECT=8 {{(pid=103776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:30:59.159207 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi [None req-8280186a-7497-48e3-b12c-77521e47b17e admin admin] Calling method '>' {{(pid=103776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:30:59.162530 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG oslo_concurrency.lockutils [None req-8280186a-7497-48e3-b12c-77521e47b17e admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:30:59.163301 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG oslo_concurrency.lockutils [None req-8280186a-7497-48e3-b12c-77521e47b17e admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:30:59.163732 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG oslo_concurrency.lockutils [None req-8280186a-7497-48e3-b12c-77521e47b17e admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:30:59.164442 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG oslo_concurrency.lockutils [None req-8280186a-7497-48e3-b12c-77521e47b17e admin admin] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:30:59.164881 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG oslo_concurrency.lockutils [None req-8280186a-7497-48e3-b12c-77521e47b17e admin admin] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:30:59.165294 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG oslo_concurrency.lockutils [None req-8280186a-7497-48e3-b12c-77521e47b17e admin admin] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:30:59.190430 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: INFO nova.api.openstack.requestlog [None req-8280186a-7497-48e3-b12c-77521e47b17e admin admin] 10.222.0.15 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.92 time: 0.085245 Oct 31 12:30:59.190907 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: [pid: 103776|app: 0|req: 37/74] 10.222.0.15 () {60 vars in 1193 bytes} [Mon Oct 31 12:30:59 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 12:31:00.262510 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG nova.api.openstack.wsgi [None req-b5699144-aaac-4235-9982-9090dab5cc49 admin admin] Calling method '>' {{(pid=103775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:31:00.263543 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: INFO nova.api.openstack.requestlog [None req-b5699144-aaac-4235-9982-9090dab5cc49 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001435 Oct 31 12:31:00.264145 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: [pid: 103775|app: 0|req: 38/75] 10.222.0.15 () {56 vars in 1074 bytes} [Mon Oct 31 12:31:00 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 12:31:00.458236 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG nova.api.openstack.wsgi [None req-c24ac9e6-0b0f-4ac7-9bd9-d790efb6188a admin admin] Calling method '>' {{(pid=103776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:31:00.461674 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG oslo_concurrency.lockutils [None req-c24ac9e6-0b0f-4ac7-9bd9-d790efb6188a admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:31:00.462156 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG oslo_concurrency.lockutils [None req-c24ac9e6-0b0f-4ac7-9bd9-d790efb6188a admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:31:00.462589 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG oslo_concurrency.lockutils [None req-c24ac9e6-0b0f-4ac7-9bd9-d790efb6188a admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:31:00.463341 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG oslo_concurrency.lockutils [None req-c24ac9e6-0b0f-4ac7-9bd9-d790efb6188a admin admin] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:31:00.463795 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG oslo_concurrency.lockutils [None req-c24ac9e6-0b0f-4ac7-9bd9-d790efb6188a admin admin] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:31:00.464215 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: DEBUG oslo_concurrency.lockutils [None req-c24ac9e6-0b0f-4ac7-9bd9-d790efb6188a admin admin] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:31:00.486971 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: INFO nova.api.openstack.requestlog [None req-c24ac9e6-0b0f-4ac7-9bd9-d790efb6188a admin admin] 10.222.0.15 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.92 time: 0.082698 Oct 31 12:31:00.487564 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: [pid: 103776|app: 0|req: 38/76] 10.222.0.15 () {60 vars in 1193 bytes} [Mon Oct 31 12:31:00 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 12:31:59.023290 dv-cinder-796170-6-iscsi devstack@n-api.service[103774]: Mon Oct 31 12:31:59 2022 - graceful shutdown triggered... Oct 31 12:31:59.022961 dv-cinder-796170-6-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Oct 31 12:31:59.024259 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: Gracefully killing worker 1 (pid: 103775)... Oct 31 12:31:59.025301 dv-cinder-796170-6-iscsi devstack@n-api.service[103776]: Gracefully killing worker 2 (pid: 103776)... Oct 31 12:31:59.149381 dv-cinder-796170-6-iscsi devstack@n-api.service[103775]: DEBUG dbcounter [-] [103775] Writing DB stats nova_api:SELECT=4 {{(pid=103775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:32:00.023608 dv-cinder-796170-6-iscsi devstack@n-api.service[103774]: worker 1 buried after 1 seconds Oct 31 12:32:00.023608 dv-cinder-796170-6-iscsi devstack@n-api.service[103774]: worker 2 buried after 1 seconds Oct 31 12:32:00.023608 dv-cinder-796170-6-iscsi devstack@n-api.service[103774]: goodbye to uWSGI. Oct 31 12:32:00.025191 dv-cinder-796170-6-iscsi systemd[1]: devstack@n-api.service: Succeeded. Oct 31 12:32:00.025748 dv-cinder-796170-6-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Oct 31 12:32:00.028412 dv-cinder-796170-6-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Oct 31 12:32:00.048314 dv-cinder-796170-6-iscsi devstack@n-api.service[125424]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 31 12:32:00.051036 dv-cinder-796170-6-iscsi devstack@n-api.service[125424]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Oct 31 12:32:00 2022] *** Oct 31 12:32:00.051036 dv-cinder-796170-6-iscsi devstack@n-api.service[125424]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 31 12:32:00.051036 dv-cinder-796170-6-iscsi devstack@n-api.service[125424]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 31 12:32:00.051036 dv-cinder-796170-6-iscsi devstack@n-api.service[125424]: nodename: dv-cinder-796170-6-iscsi Oct 31 12:32:00.051036 dv-cinder-796170-6-iscsi devstack@n-api.service[125424]: machine: x86_64 Oct 31 12:32:00.051036 dv-cinder-796170-6-iscsi devstack@n-api.service[125424]: clock source: unix Oct 31 12:32:00.051036 dv-cinder-796170-6-iscsi devstack@n-api.service[125424]: pcre jit disabled Oct 31 12:32:00.051036 dv-cinder-796170-6-iscsi devstack@n-api.service[125424]: detected number of CPU cores: 4 Oct 31 12:32:00.051036 dv-cinder-796170-6-iscsi devstack@n-api.service[125424]: current working directory: / Oct 31 12:32:00.051036 dv-cinder-796170-6-iscsi devstack@n-api.service[125424]: detected binary path: /usr/bin/uwsgi-core Oct 31 12:32:00.052971 dv-cinder-796170-6-iscsi devstack@n-api.service[125424]: your processes number limit is 47680 Oct 31 12:32:00.052971 dv-cinder-796170-6-iscsi devstack@n-api.service[125424]: your memory page size is 4096 bytes Oct 31 12:32:00.052971 dv-cinder-796170-6-iscsi devstack@n-api.service[125424]: detected max file descriptor number: 2048 Oct 31 12:32:00.052971 dv-cinder-796170-6-iscsi devstack@n-api.service[125424]: lock engine: pthread robust mutexes Oct 31 12:32:00.052971 dv-cinder-796170-6-iscsi devstack@n-api.service[125424]: thunder lock: enabled Oct 31 12:32:00.052971 dv-cinder-796170-6-iscsi devstack@n-api.service[125424]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 31 12:32:00.052971 dv-cinder-796170-6-iscsi devstack@n-api.service[125424]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 31 12:32:00.092209 dv-cinder-796170-6-iscsi devstack@n-api.service[125424]: Python main interpreter initialized at 0x559580fcf9c0 Oct 31 12:32:00.092209 dv-cinder-796170-6-iscsi devstack@n-api.service[125424]: python threads support enabled Oct 31 12:32:00.092209 dv-cinder-796170-6-iscsi devstack@n-api.service[125424]: your server socket listen backlog is limited to 100 connections Oct 31 12:32:00.092209 dv-cinder-796170-6-iscsi devstack@n-api.service[125424]: your mercy for graceful operations on workers is 90 seconds Oct 31 12:32:00.092648 dv-cinder-796170-6-iscsi devstack@n-api.service[125424]: mapped 403077 bytes (393 KB) for 2 cores Oct 31 12:32:00.092648 dv-cinder-796170-6-iscsi devstack@n-api.service[125424]: *** Operational MODE: preforking *** Oct 31 12:32:00.092916 dv-cinder-796170-6-iscsi devstack@n-api.service[125424]: *** uWSGI is running in multiple interpreter mode *** Oct 31 12:32:00.092916 dv-cinder-796170-6-iscsi devstack@n-api.service[125424]: spawned uWSGI master process (pid: 125424) Oct 31 12:32:00.093118 dv-cinder-796170-6-iscsi systemd[1]: Started Devstack devstack@n-api.service. Oct 31 12:32:00.093866 dv-cinder-796170-6-iscsi devstack@n-api.service[125424]: spawned uWSGI worker 1 (pid: 125440, cores: 1) Oct 31 12:32:00.099242 dv-cinder-796170-6-iscsi devstack@n-api.service[125424]: spawned uWSGI worker 2 (pid: 125441, cores: 1) Oct 31 12:32:00.099242 dv-cinder-796170-6-iscsi devstack@n-api.service[125424]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 31 12:32:00.761811 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 31 12:32:00.785475 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 31 12:32:02.014280 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 31 12:32:02.014280 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: from cryptography.utils import int_from_bytes Oct 31 12:32:02.014888 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 31 12:32:02.014888 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: from cryptography.utils import int_from_bytes Oct 31 12:32:02.116417 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 31 12:32:02.116417 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: from cryptography.utils import int_from_bytes Oct 31 12:32:02.117025 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 31 12:32:02.117025 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: from cryptography.utils import int_from_bytes Oct 31 12:32:04.473534 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 31 12:32:04.474137 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 31 12:32:04.474429 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 31 12:32:04.474799 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 31 12:32:04.475053 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 31 12:32:04.475488 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.475814 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.476135 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.476460 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.476789 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.477100 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.477426 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.477741 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.478067 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.478327 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.478640 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.478966 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-796170-6-iscsi {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.479316 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.479626 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.479944 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.480257 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.480558 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.480878 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.481181 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.481683 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.482871 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.482871 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.482871 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.483106 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.483428 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.483683 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.483991 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.484297 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.484623 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.484930 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.485358 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-796170-6-iscsi {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.485654 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.485969 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.486280 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.486710 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.487019 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.487353 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.487677 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.487996 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.488305 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.489296 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.489777 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.490212 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.490544 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.490847 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.491179 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.491489 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.491809 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.492116 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.492423 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.492673 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.492981 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.493301 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.493622 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.493945 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.494196 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.494444 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.494762 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.495082 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.495427 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.495723 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.496028 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.496334 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.496639 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.496952 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.497258 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.497562 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.497885 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.498198 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.498523 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.498828 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.499147 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.499583 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.15 {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.499833 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.15 {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.500141 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.500484 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.500803 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.501106 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.501425 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.501747 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.502055 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.502359 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.502665 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.502983 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.503345 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.503652 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.503905 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.504821 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.505131 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.505449 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.505759 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.506061 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.506367 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.506663 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.506974 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.507302 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.507608 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.507986 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.508212 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.508517 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.508820 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.509124 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.509427 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.509729 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.510052 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.510371 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.510676 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.510978 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.511303 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.511608 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.511927 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.512229 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.512532 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.512857 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.513162 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.513467 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.513784 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.514090 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.514396 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.514712 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.515012 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.515343 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.515663 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.515969 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.516273 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.516574 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.516882 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.517183 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.517485 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.517785 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.518135 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.518380 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.518699 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.519025 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.519359 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.519666 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.520006 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.520621 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.521006 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.521381 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.521725 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.522040 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.522368 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.522699 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.523015 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.523359 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.523674 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.523999 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.524310 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.524621 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.524929 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.525245 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.525563 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.525889 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.526203 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.526516 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.526838 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.527148 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.527486 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.527812 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.528132 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.528424 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.528768 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.529115 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.530040 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.530040 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.530040 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.530463 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.530650 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.530960 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.531404 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.531648 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.531965 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.532288 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.532597 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.532919 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.533233 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.533544 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.533854 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.534166 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.534474 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.534812 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.535126 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.535568 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.535891 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.536210 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.536528 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.536847 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.537160 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.537471 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.537775 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.538077 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.538436 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.538683 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.538985 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.539331 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.539659 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.539968 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.540303 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.540610 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.540920 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.541232 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.541549 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.541840 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.542153 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.542467 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.542767 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.543091 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.543425 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.543729 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.544052 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.544358 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.544661 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.544976 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.545285 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.545595 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.545907 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.546215 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.546538 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.546858 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.547204 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.547530 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.547861 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.548166 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.548541 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.548812 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.549127 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.549430 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.549738 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.550043 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.550344 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.550646 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.550955 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.551787 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.552089 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.552401 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.552692 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.552993 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.553315 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.553623 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.553926 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.554228 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.554530 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.554877 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.555198 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.555536 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.555873 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.556191 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.556512 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.556829 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.557145 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.557454 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.557765 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.558076 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.558385 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.558707 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.559015 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.559357 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.559667 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.559988 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.560298 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.560619 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.560923 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.561239 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.561578 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.561911 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.562223 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.562544 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.562853 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.563199 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.563493 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.564109 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.564109 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.564386 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.564705 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.565012 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.565326 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.565631 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.566182 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.566329 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.566558 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.566911 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.567313 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.567643 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.567975 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.568280 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.568590 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.568913 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.569219 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.569526 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.569835 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.570138 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.570440 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.570747 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.571060 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.571392 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.571705 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.572027 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.572314 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.572617 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.572921 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.573221 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.573528 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.573847 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.574155 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.574471 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.574789 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.575089 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.575412 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.575732 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.576039 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.576340 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.576640 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.576941 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.577278 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.577585 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.577887 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.578201 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.578518 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.578826 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.579139 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.579472 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.579780 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.580100 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.580412 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.580719 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.581027 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.581335 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.581647 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.581954 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.582784 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.583092 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.583507 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.583819 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.584121 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.584430 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.584748 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.585329 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.585661 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.585976 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.586294 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.586635 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.586955 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.587307 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.587637 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.587951 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.588256 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.588564 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.588868 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.589170 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.589480 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.589786 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.590088 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.590391 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.590698 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.590998 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.591330 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.591637 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.591939 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.592323 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.592547 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.592857 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.593157 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.593476 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.593782 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.594083 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.594383 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.594685 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.595024 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.595349 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.595687 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.596017 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.596358 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.596664 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.596969 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.597292 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.597594 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.598019 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.598411 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.598727 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.599039 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.599369 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.599682 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.599993 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.600302 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.600611 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.600914 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.601222 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.601524 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.601842 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.602147 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.602461 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.602678 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 31 12:32:04.603142 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.603323 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 31 12:32:04.603467 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.603467 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.603727 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 31 12:32:04.603858 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.603990 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 31 12:32:04.604132 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.604273 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 31 12:32:04.604407 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.604547 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.604690 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.604836 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.604959 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.605097 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.605229 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.605361 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.605501 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.605646 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.605779 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.605918 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.606063 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.606220 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.606356 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.606536 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.606725 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.606859 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.606991 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.607131 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.607318 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.607454 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.607594 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.607727 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-796170-6-iscsi {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.607859 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.608025 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.608170 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.608327 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.608463 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.608632 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.608776 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.608946 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.609092 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.609246 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.609382 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.609546 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.609690 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.609830 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.609973 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.610143 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.610321 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.610481 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.610615 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.610761 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.610895 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.611025 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.611224 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.611373 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.611556 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.611703 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.611849 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.611993 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.612148 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.612284 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.612460 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.612694 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.612832 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.612963 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.613103 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.613236 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.613381 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.614006 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.614172 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.614308 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-796170-6-iscsi {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.614474 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.614725 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.614863 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.615039 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.615220 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.615356 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.615488 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.615756 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.615893 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.616063 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.616197 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.616369 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.616586 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.616721 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.616850 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.616989 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.617122 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.617253 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.617392 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.617555 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.617700 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.617867 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.618012 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.618176 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.618322 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.618486 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.618621 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.618786 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.618921 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.619087 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.619256 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.619432 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.619577 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.619741 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.619877 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.620051 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.620196 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.620335 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.620474 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.620614 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.620746 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.620886 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.621018 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.621159 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.621298 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.621471 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.621607 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.621787 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.621939 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.622073 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.622207 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.622388 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.622537 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.622693 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.622918 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.623055 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.623220 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.623355 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.623501 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.623644 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.623784 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.623925 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.624057 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.624196 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.624347 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.624488 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.624628 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.624761 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.624892 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.625038 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.625178 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.625319 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.625459 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.625598 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.625731 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.625871 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.626027 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.626163 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.626329 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.626467 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.626638 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.626786 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.626926 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.627059 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.15 {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.627260 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.627399 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.15 {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.627564 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.627710 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.627893 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.628206 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.628360 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.628501 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.628648 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.628805 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.628964 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.629802 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.629943 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.630099 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.630243 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.630416 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.630565 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.630732 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.630868 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.631045 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.631220 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.631378 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.631515 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.631685 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.631821 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.631961 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.632104 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.632245 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.632405 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.632548 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.632718 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.632855 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.633093 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.633238 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.633381 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.633522 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.633654 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.633796 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.633930 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.634061 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.634192 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.634323 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.634492 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.634638 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.634780 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.634911 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.635079 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.635261 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.635395 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.635547 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.635681 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.635814 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.635954 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.636120 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.636264 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.636432 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.636569 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.636734 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.636870 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.637118 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.637270 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.637435 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.637570 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.637735 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.637872 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.638035 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.638185 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.638325 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.638465 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.638605 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.638738 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.638915 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.639060 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.639225 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.639367 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.639509 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.639642 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.639830 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.639966 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.640132 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.640269 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.640431 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.640587 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.640742 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.640878 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.641043 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.641189 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.641331 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.641464 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.641641 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.641785 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.641919 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.642061 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.642222 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.642359 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.642532 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.642677 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.642833 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.643004 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.643272 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.643978 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.644119 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.644253 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.644394 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.644538 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.644692 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.644907 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.645048 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.645181 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.645586 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.645728 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.645861 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.645999 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.646130 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.646262 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.646411 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.646551 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.646689 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.646828 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.646967 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.647107 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.647311 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.647454 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.647596 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.647734 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.647865 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:32:04.648002 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.648142 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.648275 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.648405 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.649076 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.649224 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.649374 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.649518 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.649653 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.649793 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.649927 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.650060 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.650201 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.650343 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.650485 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.650619 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.650758 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.650899 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.651046 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.651198 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.651332 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.651476 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.651621 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.651835 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.651977 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.652112 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.652243 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.652382 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.652514 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.652656 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.652789 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.652922 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.653054 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.653192 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.653433 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.653585 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.653727 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.653867 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.654001 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.654141 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.654141 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.654409 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.654543 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.654683 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.654817 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.654959 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.655103 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.655282 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.655424 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.655557 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.655557 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.655808 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.655949 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.656082 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.656213 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.656356 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.656497 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.656631 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.656778 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.656920 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.657053 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.657192 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.657333 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.657466 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.657611 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.657753 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.657894 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.658035 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.658176 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.658385 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.658526 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.658660 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.658791 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.658924 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.659063 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.659233 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.659376 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.659510 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.659642 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.659774 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.659914 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.660061 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.660194 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.660324 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.660561 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.660712 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.660847 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.660995 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.661144 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.661278 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.661411 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.661543 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.661684 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.661825 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.661965 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.662107 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.662240 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.662380 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.662527 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.662661 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.662793 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.662926 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.663074 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.663228 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.663376 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.663616 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.663754 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.663895 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.664035 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.664170 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.664315 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.664449 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.664580 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.664725 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.664867 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.665000 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.665141 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.665276 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.665466 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.665600 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.665733 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.665884 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.666018 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.666150 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.666308 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.666452 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.666616 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.666761 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.666922 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.667057 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.667246 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.667394 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.667541 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.667686 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.667820 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.667951 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.668118 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.668255 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.668436 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.668580 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.668741 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.668966 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.669174 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.669323 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.669467 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.669600 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.669732 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.669871 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.670005 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.670146 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.670288 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.670423 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.670568 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.670710 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.670843 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.670988 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.671114 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.671305 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.671454 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.671619 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.671765 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.671924 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.672061 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.672242 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.672387 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.672556 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.672704 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.672868 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.673012 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.673178 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.673315 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.673487 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.673651 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.673868 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.674012 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.674144 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.674283 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.674424 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.674547 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.674677 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.674807 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.674984 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.675120 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.675347 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.675481 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.675613 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.675752 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.675890 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.676522 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.676767 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.677024 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.677174 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.677322 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.677463 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.677605 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.677737 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.677868 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.678006 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.678189 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.678324 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.678503 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.678647 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.678833 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.678967 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.679154 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.679321 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.679487 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.679621 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.679813 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.679957 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.680113 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.680247 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.680442 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.680576 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.680746 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.680889 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.681048 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.681193 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.681356 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.681490 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.681662 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.681797 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.681964 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.682109 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.682268 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.682401 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.682577 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.682719 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.682879 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.683027 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.683210 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.683353 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.683534 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.683668 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.683799 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.684039 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.684186 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.684370 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.684517 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.684685 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.684814 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.684995 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.685140 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.685312 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.685456 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.685597 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.685744 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.685909 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.686054 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.686227 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.686363 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.686531 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.686675 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.686834 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.686979 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.687149 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.687306 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.687477 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.687626 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.687768 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.687899 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.688068 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.688206 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.688374 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.688519 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.688679 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.688813 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.688979 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.689118 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.689285 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.689431 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.689570 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.689702 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.689883 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.690027 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.690323 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.690467 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.690467 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.690716 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.690850 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.690989 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.691137 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.691321 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.691455 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.692308 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.692525 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.692674 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.692820 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.692956 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.693089 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.693229 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.693363 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.693505 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.693647 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.693780 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.693921 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.694070 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.694297 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.694445 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.694582 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.694728 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.694863 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.694997 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.695130 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.695295 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.695438 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.695582 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.695716 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.695849 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.695982 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.696123 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.696257 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.696390 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.696530 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.696665 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.696812 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.696955 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.697089 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.697269 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.697408 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.697579 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.697789 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.697922 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.698062 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.698202 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.698344 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.698478 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.698621 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.698764 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.699037 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.699227 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.699376 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.699521 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.699664 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.699834 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.699991 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.700133 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.700276 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.700419 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.700549 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.700678 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.700820 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.700962 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.701109 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.701243 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.701393 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.701534 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.701723 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.701863 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.702030 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.702169 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.702332 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.702477 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.702644 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.702791 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.702959 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.703106 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.703289 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.703425 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.703588 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.703734 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.703894 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.704038 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.704202 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.704441 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.704578 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.704721 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.704866 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.705003 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.705143 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.705266 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.705414 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.705549 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.705682 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.705815 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.705970 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.706117 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.706266 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.706409 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.706574 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.706730 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.706864 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.706997 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.707228 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.707436 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.707590 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.707768 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.707906 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.708084 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.708237 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.708380 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.708515 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.708689 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.708996 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.709150 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.709315 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.709454 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.709642 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.709782 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.709954 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.710100 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.710246 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.710395 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.710590 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.710738 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.710917 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.711062 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.711270 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.711412 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.711586 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.711724 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.711890 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.712035 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.712196 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.712334 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.712497 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.712646 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.712790 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.712924 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.713090 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.713227 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.713394 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.713534 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.713696 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.713841 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.713997 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.714148 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.714291 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.714432 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.714649 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.714796 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.714939 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.715083 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.715269 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.715414 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.715560 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.715702 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.715845 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.715988 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.716123 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.716257 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.716397 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.716532 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.716666 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.716812 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.716955 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.717090 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.717222 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.717369 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.717513 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.717657 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.717799 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.717934 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.718159 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.718304 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.718476 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.718621 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.718781 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.718925 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.719081 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.719278 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.719429 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.719564 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.719700 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.719835 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.719977 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.720125 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.720261 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.720409 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.720545 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.720678 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.720842 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.720988 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.721145 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.721289 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.721447 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.721584 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.721747 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.721898 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.722033 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.722174 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.722333 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.722478 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.722661 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.722807 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.723588 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.723737 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.723932 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.724076 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.724257 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.724395 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.724570 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.724802 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.724940 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.725082 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.725263 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.725399 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.725533 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.725665 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.725799 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.725932 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.726084 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.726219 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.726359 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.726493 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.726634 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.726768 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.726909 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.727045 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.727208 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.727344 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.727478 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.727621 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.727763 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.727927 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.728067 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.728237 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.728375 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.728546 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.728692 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.728873 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.729011 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.729200 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.729347 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.729495 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.729637 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.729771 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.729911 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.730088 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.730227 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.730395 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.730534 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.730696 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.730825 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.730995 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.731146 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.731330 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.731465 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.731799 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.731943 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.732086 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.732293 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.732293 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.732512 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.732653 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.732789 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.732929 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.733079 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.733214 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.733400 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.733523 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.733639 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.733781 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.734000 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.734124 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.734368 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.734520 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.734666 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.734834 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.735053 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.735213 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.735350 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.735528 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.735666 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.736020 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.736175 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.736294 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.736438 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.736575 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.736696 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.736884 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.737023 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.737320 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.737504 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.737641 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.737785 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.737903 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.738016 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.738147 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.738344 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=125440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 31 12:32:04.738547 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.739295 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.739751 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.740128 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.740506 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.740850 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.741192 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.741606 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.741956 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.742337 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.742808 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.743089 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.743557 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.743945 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.744285 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.744629 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.744981 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.745350 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.746035 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.746183 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.746651 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.746917 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.747471 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.747716 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.748094 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.748443 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.748914 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.749086 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.749580 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.749945 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.750346 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.750729 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.751303 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.751528 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.751874 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.752226 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.752549 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.752981 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.753270 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.753636 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.754004 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.755033 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.755389 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.755702 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.756007 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.756689 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.757004 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.757314 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.757621 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.757929 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.758237 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.758548 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.758859 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.759180 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.759597 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.759905 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.760214 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.760523 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.760823 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.761122 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.761430 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.761747 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.762047 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.762346 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.762646 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.762962 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.763285 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.763605 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.764015 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.764320 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.764620 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.765033 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.765465 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.765797 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.766730 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.766730 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.767068 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.767068 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.767421 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.767746 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.768067 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.768387 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.768698 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.769000 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.769299 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.769618 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.770120 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.770580 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.771033 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.771379 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.771705 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.772111 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.772329 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.772648 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.773037 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.773341 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.773648 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.773953 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.774256 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.774576 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.774877 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.775214 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.775525 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.775831 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.776135 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.776437 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.776757 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.777055 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.777374 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.777682 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.778000 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.778317 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.778619 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.778936 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.779266 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.779569 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.779869 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.780170 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.780509 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.780812 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.781126 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.781453 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.781775 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.782081 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.782407 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.782734 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.783052 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.783380 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.783695 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.784015 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.784315 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.784613 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.784924 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.785227 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.786154 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.786459 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.786781 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.787061 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.787387 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.787688 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.788007 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.788308 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.788625 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.788931 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.789231 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.789532 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.789833 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.790170 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.790470 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.790796 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.791100 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.791446 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.791759 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.792072 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.792437 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.792817 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.793121 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.793435 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.793744 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.794048 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.794360 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.794671 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.794984 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.795574 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.795900 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.796210 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.796528 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.796935 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.797115 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.797443 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.797727 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.798031 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.799037 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.799037 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.799037 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.799373 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.799599 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.799929 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.800247 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.800598 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.800981 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.801831 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.802195 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.802509 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.802818 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.802978 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO dbcounter [None req-78db5951-b42e-4708-8f49-da186de8d7be None None] Registered counter for database nova_api Oct 31 12:32:04.803141 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.803506 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.803822 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.804130 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.804439 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.804749 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.805059 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.805375 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.805681 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.805990 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.806300 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.806643 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.806951 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.807296 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.807606 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.807916 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.808230 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.808757 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.809069 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.809396 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.809715 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.810033 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.810350 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.810663 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.810985 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.811309 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.811611 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.811916 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.812222 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.812538 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.812836 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.813141 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.813440 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.813753 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.814055 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.814583 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.814932 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.815276 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.815600 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.815922 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.816236 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.816540 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.816901 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.817211 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.818285 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.818285 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.818285 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.818709 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.818860 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.819206 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.819516 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.819817 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.820124 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.820425 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.820749 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.821052 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.821355 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.821657 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.821965 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.822264 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.822562 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.822862 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.823064 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_db.sqlalchemy.engines [None req-78db5951-b42e-4708-8f49-da186de8d7be None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125440) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 31 12:32:04.823391 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.823552 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.823767 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.824070 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.824368 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.824674 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.825036 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.825325 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.825625 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.825943 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.826243 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.826544 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.826851 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.827271 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.827489 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.827795 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.828101 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.828445 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.828753 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.829305 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.829633 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.829809 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG dbcounter [-] [125440] Writer thread running {{(pid=125440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 31 12:32:04.830167 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.830563 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.830893 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.831217 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.831618 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.831864 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.832186 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.832540 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.833010 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.833245 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.833581 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.833852 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.834158 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.834464 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.834769 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.835079 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.835407 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.835712 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.836015 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.836318 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.836621 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.836931 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.837270 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.837617 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.837896 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.838206 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.838560 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.838869 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.839194 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.839613 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.839864 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.840166 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.840539 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.840848 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.841148 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.841568 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.841879 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.842194 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.842514 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.842820 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.843364 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.843706 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.843995 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.844402 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.844817 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.845041 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.845377 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.845700 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.846024 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.846326 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.846628 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.846990 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.847381 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.847696 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.848735 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.849215 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.849390 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.849598 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.849882 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.850224 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.850556 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.850889 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.851269 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.851549 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.851885 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.852187 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.852486 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.852784 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.853082 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.853385 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.853683 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.853983 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.854281 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.854578 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.854875 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.855217 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.855555 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.855867 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.856185 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.856492 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.856855 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.857111 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.857425 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.857820 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.858054 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.858361 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.858689 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.858994 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.859326 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.859635 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.859940 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.860247 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.860550 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.860873 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.861196 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.861496 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.861817 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.862130 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.862445 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.862757 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.863064 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.863412 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.864315 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.864624 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.864933 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.865246 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.865556 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.865867 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.866174 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.866480 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.866792 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.867105 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.867455 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.867777 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.868084 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.868401 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.868720 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.869064 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.869374 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.869712 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.870035 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.870345 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.870653 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.870952 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:32:04.871216 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=125441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 31 12:32:04.886308 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.context [None req-78db5951-b42e-4708-8f49-da186de8d7be None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa(cell1) {{(pid=125440) load_cells /opt/stack/nova/nova/context.py:464}} Oct 31 12:32:04.890342 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-78db5951-b42e-4708-8f49-da186de8d7be None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:32:04.890817 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-78db5951-b42e-4708-8f49-da186de8d7be None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:32:04.892420 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-78db5951-b42e-4708-8f49-da186de8d7be None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:32:04.893148 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-78db5951-b42e-4708-8f49-da186de8d7be None None] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:32:04.893595 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-78db5951-b42e-4708-8f49-da186de8d7be None None] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:32:04.896014 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-78db5951-b42e-4708-8f49-da186de8d7be None None] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:32:04.898024 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO dbcounter [None req-78db5951-b42e-4708-8f49-da186de8d7be None None] Registered counter for database nova_cell0 Oct 31 12:32:04.902555 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO dbcounter [None req-78db5951-b42e-4708-8f49-da186de8d7be None None] Registered counter for database nova_cell1 Oct 31 12:32:04.913931 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_db.sqlalchemy.engines [None req-78db5951-b42e-4708-8f49-da186de8d7be None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125440) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 31 12:32:04.913931 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_db.sqlalchemy.engines [None req-78db5951-b42e-4708-8f49-da186de8d7be None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125440) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 31 12:32:04.920874 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG dbcounter [-] [125440] Writer thread running {{(pid=125440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 31 12:32:04.921213 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG dbcounter [-] [125440] Writer thread running {{(pid=125440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 31 12:32:04.936520 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO dbcounter [None req-e79aab1e-0786-4684-ae33-1e577ff1a057 None None] Registered counter for database nova_api Oct 31 12:32:04.956647 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_db.sqlalchemy.engines [None req-e79aab1e-0786-4684-ae33-1e577ff1a057 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125441) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 31 12:32:04.967739 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG dbcounter [-] [125441] Writer thread running {{(pid=125441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 31 12:32:05.031025 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.context [None req-e79aab1e-0786-4684-ae33-1e577ff1a057 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa(cell1) {{(pid=125441) load_cells /opt/stack/nova/nova/context.py:464}} Oct 31 12:32:05.036554 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-e79aab1e-0786-4684-ae33-1e577ff1a057 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:32:05.037036 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-e79aab1e-0786-4684-ae33-1e577ff1a057 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:32:05.038624 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-e79aab1e-0786-4684-ae33-1e577ff1a057 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:32:05.039391 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-e79aab1e-0786-4684-ae33-1e577ff1a057 None None] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:32:05.039841 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-e79aab1e-0786-4684-ae33-1e577ff1a057 None None] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:32:05.041958 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-e79aab1e-0786-4684-ae33-1e577ff1a057 None None] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:32:05.044114 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO dbcounter [None req-e79aab1e-0786-4684-ae33-1e577ff1a057 None None] Registered counter for database nova_cell0 Oct 31 12:32:05.048485 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO dbcounter [None req-e79aab1e-0786-4684-ae33-1e577ff1a057 None None] Registered counter for database nova_cell1 Oct 31 12:32:05.056860 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_db.sqlalchemy.engines [None req-e79aab1e-0786-4684-ae33-1e577ff1a057 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125441) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 31 12:32:05.059405 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_db.sqlalchemy.engines [None req-e79aab1e-0786-4684-ae33-1e577ff1a057 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125441) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 31 12:32:05.066717 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG dbcounter [-] [125441] Writer thread running {{(pid=125441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 31 12:32:05.068034 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG dbcounter [-] [125441] Writer thread running {{(pid=125441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 31 12:32:05.074872 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO dbcounter [None req-78db5951-b42e-4708-8f49-da186de8d7be None None] Registered counter for database nova_cell0 Oct 31 12:32:05.081821 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_db.sqlalchemy.engines [None req-78db5951-b42e-4708-8f49-da186de8d7be None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125440) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 31 12:32:05.087849 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG dbcounter [-] [125440] Writer thread running {{(pid=125440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 31 12:32:05.217096 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO dbcounter [None req-e79aab1e-0786-4684-ae33-1e577ff1a057 None None] Registered counter for database nova_cell0 Oct 31 12:32:05.224613 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_db.sqlalchemy.engines [None req-e79aab1e-0786-4684-ae33-1e577ff1a057 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125441) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 31 12:32:05.230390 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG dbcounter [-] [125441] Writer thread running {{(pid=125441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 31 12:32:05.415760 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: WARNING keystonemiddleware.auth_token [None req-78db5951-b42e-4708-8f49-da186de8d7be None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 31 12:32:05.423138 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: WARNING keystonemiddleware.auth_token [None req-78db5951-b42e-4708-8f49-da186de8d7be None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 31 12:32:05.560489 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: WARNING keystonemiddleware.auth_token [None req-e79aab1e-0786-4684-ae33-1e577ff1a057 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 31 12:32:05.569013 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: WARNING keystonemiddleware.auth_token [None req-e79aab1e-0786-4684-ae33-1e577ff1a057 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 31 12:32:05.771894 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: WARNING keystonemiddleware.auth_token [None req-78db5951-b42e-4708-8f49-da186de8d7be None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 31 12:32:05.778164 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: WARNING keystonemiddleware.auth_token [None req-78db5951-b42e-4708-8f49-da186de8d7be None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 31 12:32:05.783757 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x559580fcf9c0 pid: 125440 (default app) Oct 31 12:32:05.914937 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: WARNING keystonemiddleware.auth_token [None req-e79aab1e-0786-4684-ae33-1e577ff1a057 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 31 12:32:05.920915 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: WARNING keystonemiddleware.auth_token [None req-e79aab1e-0786-4684-ae33-1e577ff1a057 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 31 12:32:05.926290 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x559580fcf9c0 pid: 125441 (default app) Oct 31 12:32:41.825201 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG dbcounter [-] [125440] Writing DB stats nova_api:SELECT=3 {{(pid=125440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:32:41.826879 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG dbcounter [-] [125440] Writing DB stats nova_cell0:SELECT=3 {{(pid=125440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:32:41.827856 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG dbcounter [-] [125440] Writing DB stats nova_cell1:SELECT=3 {{(pid=125440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:32:41.830356 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG dbcounter [-] [125440] Writing DB stats nova_cell0:SELECT=3 {{(pid=125440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:32:43.311626 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-6c365829-5bc5-4d7d-b994-141498aed4f6 tempest-VolumesGetTestJSON-1309004110 tempest-VolumesGetTestJSON-1309004110-project] Action: 'create', calling method: .version_select at 0x7f2aa618ff70>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1603672939", "metadata": {"Type": "work"}}} {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 12:32:45.193610 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-6c365829-5bc5-4d7d-b994-141498aed4f6 tempest-VolumesGetTestJSON-1309004110 tempest-VolumesGetTestJSON-1309004110-project] 10.222.0.15 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 3.379032 Oct 31 12:32:45.194522 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 1/1] 10.222.0.15 () {60 vars in 1156 bytes} [Mon Oct 31 12:32:41 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 3381 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 31 12:32:45.212108 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG dbcounter [-] [125441] Writing DB stats nova_api:SELECT=3 {{(pid=125441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:32:45.213054 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG dbcounter [-] [125441] Writing DB stats nova_cell1:SELECT=3 {{(pid=125441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:32:45.218210 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG dbcounter [-] [125441] Writing DB stats nova_cell0:SELECT=3 {{(pid=125441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:32:45.219571 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG dbcounter [-] [125441] Writing DB stats nova_cell0:SELECT=3 {{(pid=125441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:32:45.793723 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-e2962675-4f02-437e-88ae-2cd0033c2ea2 tempest-VolumesGetTestJSON-1309004110 tempest-VolumesGetTestJSON-1309004110-project] Calling method '.version_select at 0x7f2aa610bc10>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:32:46.680272 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-e2962675-4f02-437e-88ae-2cd0033c2ea2 tempest-VolumesGetTestJSON-1309004110 tempest-VolumesGetTestJSON-1309004110-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/aeb07dc6-741f-4e74-be3d-30e1150760e8" status: 200 len: 354 microversion: 2.1 time: 1.471631 Oct 31 12:32:46.682267 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 1/2] 10.222.0.15 () {58 vars in 1245 bytes} [Mon Oct 31 12:32:45 2022] GET /compute/v2.1/os-volumes/aeb07dc6-741f-4e74-be3d-30e1150760e8 => generated 354 bytes in 1478 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 12:32:46.702407 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-4b33b17f-9aaa-4968-b56b-ccf98ccd3c21 tempest-VolumesGetTestJSON-1309004110 tempest-VolumesGetTestJSON-1309004110-project] Calling method '.version_select at 0x7f2aa5f9ddc0>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:32:46.821582 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-4b33b17f-9aaa-4968-b56b-ccf98ccd3c21 tempest-VolumesGetTestJSON-1309004110 tempest-VolumesGetTestJSON-1309004110-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/aeb07dc6-741f-4e74-be3d-30e1150760e8" status: 200 len: 354 microversion: 2.1 time: 0.129129 Oct 31 12:32:46.835211 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 2/3] 10.222.0.15 () {58 vars in 1245 bytes} [Mon Oct 31 12:32:46 2022] GET /compute/v2.1/os-volumes/aeb07dc6-741f-4e74-be3d-30e1150760e8 => generated 354 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 12:32:46.846187 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-263ca6e6-49aa-49fc-9330-71cd91ce70b6 tempest-VolumesGetTestJSON-1309004110 tempest-VolumesGetTestJSON-1309004110-project] Calling method '.version_select at 0x7f2aa5fd4d30>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:32:46.984899 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-263ca6e6-49aa-49fc-9330-71cd91ce70b6 tempest-VolumesGetTestJSON-1309004110 tempest-VolumesGetTestJSON-1309004110-project] 10.222.0.15 "DELETE /compute/v2.1/os-volumes/aeb07dc6-741f-4e74-be3d-30e1150760e8" status: 202 len: 0 microversion: 2.1 time: 0.144035 Oct 31 12:32:46.985849 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 2/4] 10.222.0.15 () {58 vars in 1248 bytes} [Mon Oct 31 12:32:46 2022] DELETE /compute/v2.1/os-volumes/aeb07dc6-741f-4e74-be3d-30e1150760e8 => generated 0 bytes in 147 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 31 12:32:46.996389 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-db8b79a0-20c1-4b2d-a1b1-baa31015d7f1 tempest-VolumesGetTestJSON-1309004110 tempest-VolumesGetTestJSON-1309004110-project] Calling method '.version_select at 0x7f2aa5f324c0>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:32:47.131658 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-db8b79a0-20c1-4b2d-a1b1-baa31015d7f1 tempest-VolumesGetTestJSON-1309004110 tempest-VolumesGetTestJSON-1309004110-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/aeb07dc6-741f-4e74-be3d-30e1150760e8" status: 200 len: 353 microversion: 2.1 time: 0.140687 Oct 31 12:32:47.133204 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 3/5] 10.222.0.15 () {58 vars in 1245 bytes} [Mon Oct 31 12:32:46 2022] GET /compute/v2.1/os-volumes/aeb07dc6-741f-4e74-be3d-30e1150760e8 => generated 353 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 12:32:48.148406 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-32630139-6614-4f18-a167-f877f50c0ea6 tempest-VolumesGetTestJSON-1309004110 tempest-VolumesGetTestJSON-1309004110-project] Calling method '.version_select at 0x7f2aa5f95430>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:32:48.201403 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.wsgi [None req-32630139-6614-4f18-a167-f877f50c0ea6 tempest-VolumesGetTestJSON-1309004110 tempest-VolumesGetTestJSON-1309004110-project] HTTP exception thrown: Volume aeb07dc6-741f-4e74-be3d-30e1150760e8 could not be found. Oct 31 12:32:48.205567 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-32630139-6614-4f18-a167-f877f50c0ea6 tempest-VolumesGetTestJSON-1309004110 tempest-VolumesGetTestJSON-1309004110-project] Request method failure captured: Oct 31 12:32:48.205567 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: request: GET /compute/v2.1/os-volumes/aeb07dc6-741f-4e74-be3d-30e1150760e8 HTTP/1.1 Oct 31 12:32:48.205567 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: Accept: application/json Oct 31 12:32:48.205567 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: Accept-Encoding: identity Oct 31 12:32:48.205567 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: Connection: close Oct 31 12:32:48.205567 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: Content-Length: 0 Oct 31 12:32:48.205567 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: Content-Type: application/json Oct 31 12:32:48.205567 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: Host: 10.222.0.15 Oct 31 12:32:48.205567 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: Openstack-System-Scope: None Oct 31 12:32:48.205567 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: User-Agent: python-urllib3/1.26.12 Oct 31 12:32:48.205567 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Auth-Token: gAAAAABjX8BpFangUkv2j1_fE0fncL4pAJ5_5YBwiY4tcdBjIgj9YgjNwlyQb0-dTTgdEFKqF2FD8aR0I_dayvmlQ2x3WFsIj3bDvwlakS_xszuhWF5WgPFifYr_g_F9T77sS02fNTNDF6saitd0pcucC0694plvUcoqZVuEQOhhhAuDgrK5_pc Oct 31 12:32:48.205567 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Domain-Id: None Oct 31 12:32:48.205567 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Domain-Name: None Oct 31 12:32:48.205567 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Identity-Status: Confirmed Oct 31 12:32:48.205567 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Is-Admin-Project: True Oct 31 12:32:48.205567 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Project-Domain-Id: default Oct 31 12:32:48.205567 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Project-Domain-Name: Default Oct 31 12:32:48.205567 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Project-Id: f358b4885deb4fd2a377cc4f358ed2d4 Oct 31 12:32:48.205567 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Project-Name: tempest-VolumesGetTestJSON-1309004110 Oct 31 12:32:48.205567 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Role: reader,member Oct 31 12:32:48.205567 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Roles: reader,member Oct 31 12:32:48.207010 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/f358b4885deb4fd2a377cc4f358ed2d4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_f358b4885deb4fd2a377cc4f358ed2d4", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/f358b4885deb4fd2a377cc4f358ed2d4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/f358b4885deb4fd2a377cc4f358ed2d4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Oct 31 12:32:48.207010 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Tenant: tempest-VolumesGetTestJSON-1309004110 Oct 31 12:32:48.207010 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Tenant-Id: f358b4885deb4fd2a377cc4f358ed2d4 Oct 31 12:32:48.207010 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Tenant-Name: tempest-VolumesGetTestJSON-1309004110 Oct 31 12:32:48.207010 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-User: tempest-VolumesGetTestJSON-1309004110-project Oct 31 12:32:48.207010 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-User-Domain-Id: default Oct 31 12:32:48.207010 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-User-Domain-Name: Default Oct 31 12:32:48.207010 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-User-Id: fba837d05c3e441ab2500f342edd37d1 Oct 31 12:32:48.207010 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-User-Name: tempest-VolumesGetTestJSON-1309004110-project Oct 31 12:32:48.207010 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: method: Oct 31 12:32:48.207010 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: exception: Volume aeb07dc6-741f-4e74-be3d-30e1150760e8 could not be found. Oct 31 12:32:48.207010 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: action_args: {'id': 'aeb07dc6-741f-4e74-be3d-30e1150760e8'} Oct 31 12:32:48.207010 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 12:32:48.209441 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 12:32:48.209441 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 31 12:32:48.209441 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 31 12:32:48.209441 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 31 12:32:48.209441 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 31 12:32:48.209441 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 31 12:32:48.209441 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 31 12:32:48.209441 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 31 12:32:48.209441 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 31 12:32:48.209441 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 31 12:32:48.209441 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 31 12:32:48.209441 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 31 12:32:48.209441 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 31 12:32:48.209441 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 31 12:32:48.209441 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 31 12:32:48.209441 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume aeb07dc6-741f-4e74-be3d-30e1150760e8 could not be found. (HTTP 404) (Request-ID: req-e03f2a43-cb5b-487d-aec9-314636e1d2be) Oct 31 12:32:48.209441 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Oct 31 12:32:48.209441 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 12:32:48.209441 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Oct 31 12:32:48.210902 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 12:32:48.210902 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 31 12:32:48.210902 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 31 12:32:48.210902 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 31 12:32:48.210902 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 31 12:32:48.210902 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 31 12:32:48.210902 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 31 12:32:48.210902 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 31 12:32:48.210902 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 31 12:32:48.210902 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 31 12:32:48.210902 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 31 12:32:48.210902 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 31 12:32:48.210902 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 31 12:32:48.210902 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 31 12:32:48.210902 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 31 12:32:48.210902 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 31 12:32:48.210902 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 31 12:32:48.210902 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 31 12:32:48.210902 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 31 12:32:48.213679 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 31 12:32:48.213679 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 31 12:32:48.213679 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 31 12:32:48.213679 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 31 12:32:48.213679 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume aeb07dc6-741f-4e74-be3d-30e1150760e8 could not be found. Oct 31 12:32:48.213679 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Oct 31 12:32:48.213679 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 12:32:48.213679 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Oct 31 12:32:48.213679 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 12:32:48.213679 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 12:32:48.213679 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 12:32:48.213679 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 12:32:48.213679 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 12:32:48.213679 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 12:32:48.213679 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 12:32:48.213679 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 12:32:48.213679 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 12:32:48.213679 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 31 12:32:48.213679 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 12:32:48.216119 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume aeb07dc6-741f-4e74-be3d-30e1150760e8 could not be found. Oct 31 12:32:48.216119 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Oct 31 12:32:48.216119 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 12:32:48.216119 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Oct 31 12:32:48.216119 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 12:32:48.216119 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 12:32:48.216119 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 12:32:48.216119 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 12:32:48.216119 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 12:32:48.216119 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume aeb07dc6-741f-4e74-be3d-30e1150760e8 could not be found. Oct 31 12:32:48.216119 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Oct 31 12:32:48.216119 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-32630139-6614-4f18-a167-f877f50c0ea6 tempest-VolumesGetTestJSON-1309004110 tempest-VolumesGetTestJSON-1309004110-project] Returning 404 to user: Volume aeb07dc6-741f-4e74-be3d-30e1150760e8 could not be found. {{(pid=125441) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 12:32:48.216119 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-32630139-6614-4f18-a167-f877f50c0ea6 tempest-VolumesGetTestJSON-1309004110 tempest-VolumesGetTestJSON-1309004110-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/aeb07dc6-741f-4e74-be3d-30e1150760e8" status: 404 len: 109 microversion: 2.1 time: 0.063573 Oct 31 12:32:48.216119 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 3/6] 10.222.0.15 () {58 vars in 1245 bytes} [Mon Oct 31 12:32:48 2022] GET /compute/v2.1/os-volumes/aeb07dc6-741f-4e74-be3d-30e1150760e8 => generated 109 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 12:32:54.620271 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-6d718bca-30f0-4fdb-a0d2-e3a6d3c7753f tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Action: 'create', calling method: .version_select at 0x7f2aa5f32af0>, body: {"keypair": {"name": "tempest-keypair-2037540967", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMt6QXP8nDqP9vFyCLFDAxfFuF3aSvKZPXB0Sx+VKipSRBEmDOtIFzlZ4dFrrfxqfuW1Uhd/G1KMyyxpES+LMOjAy5jW7A8yNsd7TTtZQHdu+NbtPuRoW61HjX6+5aNFdA=="}} {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 12:32:54.727090 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.quota [None req-6d718bca-30f0-4fdb-a0d2-e3a6d3c7753f tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Getting quotas for project b9a2bf9a5a484523a700e4e6c568d4de. Resources: {'key_pairs'} {{(pid=125440) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 12:32:54.735070 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.quota [None req-6d718bca-30f0-4fdb-a0d2-e3a6d3c7753f tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Getting quotas for user d6c1beb321e44908ab987b17f7b74484 and project b9a2bf9a5a484523a700e4e6c568d4de. Resources: {'key_pairs'} {{(pid=125440) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 12:32:54.829816 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-6d718bca-30f0-4fdb-a0d2-e3a6d3c7753f tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.513324 Oct 31 12:32:54.834563 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 4/7] 10.222.0.15 () {60 vars in 1159 bytes} [Mon Oct 31 12:32:54 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 12:32:56.505481 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-9f8be69c-bbb7-4ab1-901f-dbfacef26084 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Action: 'create', calling method: .version_select at 0x7f2aa5eff430>, body: {"keypair": {"name": "tempest-keypair-360295023", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBImL7BgOpwispC1lrDdASNyY19LJ4cltedXVWm8XdpEVdX23HeH/OME0iqkC2YzRusfA0SNVZ8VZclNqGt085ql4l0uXFbVzWXwwcMVZKiUa9GgKZV3WDDFz0Df1EDx9rg=="}} {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 12:32:56.644245 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.quota [None req-9f8be69c-bbb7-4ab1-901f-dbfacef26084 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Getting quotas for project bfbc3a46f12942299b99cdd20c989e1f. Resources: {'key_pairs'} {{(pid=125441) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 12:32:56.655814 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.quota [None req-9f8be69c-bbb7-4ab1-901f-dbfacef26084 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Getting quotas for user b2c03f0365ee4a26b8c076ae365325b2 and project bfbc3a46f12942299b99cdd20c989e1f. Resources: {'key_pairs'} {{(pid=125441) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 12:32:56.750702 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-9f8be69c-bbb7-4ab1-901f-dbfacef26084 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.989075 Oct 31 12:32:56.751850 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 4/8] 10.222.0.15 () {60 vars in 1159 bytes} [Mon Oct 31 12:32:55 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 992 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 12:33:00.645384 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-bd466508-023a-4bb4-b32c-6e1210e638c9 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-337522216", "imageRef": "fbbea321-8f0d-4092-b070-b67a6931d610", "flavorRef": "452", "networks": [{"uuid": "3f02c4fa-e4fb-4ba3-a36e-b3ee2e2a46d5"}]}} {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 12:33:00.962192 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.network.neutron [None req-bd466508-023a-4bb4-b32c-6e1210e638c9 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] validate_networks() for [('3f02c4fa-e4fb-4ba3-a36e-b3ee2e2a46d5', None, None, None, None, None)] {{(pid=125440) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 12:33:02.420601 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-8ebca387-d2a9-4ce8-96c9-6ef82d17492d tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2127913214", "imageRef": "fbbea321-8f0d-4092-b070-b67a6931d610", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 12:33:02.679244 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.network.neutron [None req-8ebca387-d2a9-4ce8-96c9-6ef82d17492d tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] validate_networks() for [('9c998076-e873-4913-aa9f-032e3218ef2a', None, None, None, None, None)] {{(pid=125441) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 12:33:04.536719 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.virt.hardware [None req-8ebca387-d2a9-4ce8-96c9-6ef82d17492d tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Flavor limits 0:0:0 {{(pid=125441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 12:33:04.538063 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.virt.hardware [None req-8ebca387-d2a9-4ce8-96c9-6ef82d17492d tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Image limits 0:0:0 {{(pid=125441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 12:33:04.539052 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.virt.hardware [None req-8ebca387-d2a9-4ce8-96c9-6ef82d17492d tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Flavor pref 0:0:0 {{(pid=125441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 12:33:04.539672 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.virt.hardware [None req-8ebca387-d2a9-4ce8-96c9-6ef82d17492d tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Image pref 0:0:0 {{(pid=125441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 12:33:04.540230 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.virt.hardware [None req-8ebca387-d2a9-4ce8-96c9-6ef82d17492d tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 12:33:04.591272 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-8ebca387-d2a9-4ce8-96c9-6ef82d17492d tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:04.592969 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-8ebca387-d2a9-4ce8-96c9-6ef82d17492d tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:04.593901 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-8ebca387-d2a9-4ce8-96c9-6ef82d17492d tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:04.594754 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-8ebca387-d2a9-4ce8-96c9-6ef82d17492d tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:04.595361 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-8ebca387-d2a9-4ce8-96c9-6ef82d17492d tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:04.595724 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-8ebca387-d2a9-4ce8-96c9-6ef82d17492d tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:04.633836 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.quota [None req-8ebca387-d2a9-4ce8-96c9-6ef82d17492d tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Getting quotas for project 7573cb9c503243ab90b1649591d550e6. Resources: {'instances', 'cores', 'ram'} {{(pid=125441) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 12:33:04.647325 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.quota [None req-8ebca387-d2a9-4ce8-96c9-6ef82d17492d tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Getting quotas for user db2e978bcb824a5e9d593b861c9e3bd7 and project 7573cb9c503243ab90b1649591d550e6. Resources: {'instances', 'cores', 'ram'} {{(pid=125441) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 12:33:04.662274 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-8ebca387-d2a9-4ce8-96c9-6ef82d17492d tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Going to run 1 instances... {{(pid=125441) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 12:33:04.665533 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-8ebca387-d2a9-4ce8-96c9-6ef82d17492d tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] [instance: d33a2d6b-f17c-4ce3-ad33-9086d790495d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fbbea321-8f0d-4092-b070-b67a6931d610',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125441) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 12:33:04.718340 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.virt.hardware [None req-bd466508-023a-4bb4-b32c-6e1210e638c9 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Flavor limits 0:0:0 {{(pid=125440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 12:33:04.718821 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.virt.hardware [None req-bd466508-023a-4bb4-b32c-6e1210e638c9 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Image limits 0:0:0 {{(pid=125440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 12:33:04.719321 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.virt.hardware [None req-bd466508-023a-4bb4-b32c-6e1210e638c9 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Flavor pref 0:0:0 {{(pid=125440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 12:33:04.719735 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.virt.hardware [None req-bd466508-023a-4bb4-b32c-6e1210e638c9 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Image pref 0:0:0 {{(pid=125440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 12:33:04.720164 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.virt.hardware [None req-bd466508-023a-4bb4-b32c-6e1210e638c9 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 12:33:04.739460 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-bd466508-023a-4bb4-b32c-6e1210e638c9 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:04.741033 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-bd466508-023a-4bb4-b32c-6e1210e638c9 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:04.741891 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-bd466508-023a-4bb4-b32c-6e1210e638c9 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:04.745140 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-bd466508-023a-4bb4-b32c-6e1210e638c9 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:04.748142 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-bd466508-023a-4bb4-b32c-6e1210e638c9 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:04.748971 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-bd466508-023a-4bb4-b32c-6e1210e638c9 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:04.783861 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-8ebca387-d2a9-4ce8-96c9-6ef82d17492d tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.831940 Oct 31 12:33:04.793862 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 5/9] 10.222.0.15 () {60 vars in 1147 bytes} [Mon Oct 31 12:33:01 2022] POST /compute/v2.1/servers => generated 383 bytes in 2843 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 12:33:04.815131 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-6f95b1d9-cf2d-46e2-a1c2-f5a9ed18eb2a tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1806610180", "imageRef": "fbbea321-8f0d-4092-b070-b67a6931d610", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "213ef750-b5e2-42dd-8125-73c9f2985c9d"}], "security_groups": [{"name": "tempest-securitygroup--2081838466"}], "key_name": "tempest-keypair-2037540967", "user_data": "}} {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 12:33:04.840045 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.quota [None req-bd466508-023a-4bb4-b32c-6e1210e638c9 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Getting quotas for project a4d5cd8851dc4216b4e3e035a32decad. Resources: {'instances', 'cores', 'ram'} {{(pid=125440) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 12:33:04.867830 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.quota [None req-bd466508-023a-4bb4-b32c-6e1210e638c9 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Getting quotas for user 70d59ee6f94848308665a32099cf5255 and project a4d5cd8851dc4216b4e3e035a32decad. Resources: {'instances', 'cores', 'ram'} {{(pid=125440) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 12:33:04.904410 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-bd466508-023a-4bb4-b32c-6e1210e638c9 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Going to run 1 instances... {{(pid=125440) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 12:33:04.912172 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-bd466508-023a-4bb4-b32c-6e1210e638c9 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] [instance: 8d254a92-15fa-4d98-8954-a8028647165e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fbbea321-8f0d-4092-b070-b67a6931d610',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125440) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 12:33:05.093860 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-bd466508-023a-4bb4-b32c-6e1210e638c9 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.794226 Oct 31 12:33:05.097829 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 5/10] 10.222.0.15 () {60 vars in 1147 bytes} [Mon Oct 31 12:33:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 4799 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 12:33:05.117030 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-ada45577-7937-474c-83ff-74c7834fcd7e tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:33:05.121231 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-ada45577-7937-474c-83ff-74c7834fcd7e tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] [instance: d33a2d6b-f17c-4ce3-ad33-9086d790495d] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:33:05.162236 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.network.neutron [None req-6f95b1d9-cf2d-46e2-a1c2-f5a9ed18eb2a tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] validate_networks() for [('213ef750-b5e2-42dd-8125-73c9f2985c9d', None, None, None, None, None)] {{(pid=125441) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 12:33:05.607617 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-ada45577-7937-474c-83ff-74c7834fcd7e tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2e978bcb824a5e9d593b861c9e3bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7573cb9c503243ab90b1649591d550e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:33:05.664683 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-ada45577-7937-474c-83ff-74c7834fcd7e tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] 10.222.0.15 "GET /compute/v2.1/servers/d33a2d6b-f17c-4ce3-ad33-9086d790495d" status: 200 len: 1222 microversion: 2.1 time: 0.563528 Oct 31 12:33:05.668743 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 6/11] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:33:05 2022] GET /compute/v2.1/servers/d33a2d6b-f17c-4ce3-ad33-9086d790495d => generated 1222 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:33:06.094160 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-495edb86-99bc-43c1-8dea-76d210e8d2c7 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Action: 'create', calling method: .version_select at 0x7f2aa5df5310>, body: {"keypair": {"name": "tempest-keypair-1575790766", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMQ+LVKWxlqKzS1GcZdfMIcXB22AxxwXlJk+zrRi0uZvoYcB7g7TXE9ottNBLAruwKZBnkC3Z/CSM+Z4zxhnq2Sy/DQDNtxmts5vjC3ujESCnCQBV2xtsIdjSobxxm9Txg=="}} {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 12:33:06.121648 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.quota [None req-495edb86-99bc-43c1-8dea-76d210e8d2c7 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Getting quotas for project de0eb090bf44403983e0cbb99e038321. Resources: {'key_pairs'} {{(pid=125440) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 12:33:06.127454 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.quota [None req-495edb86-99bc-43c1-8dea-76d210e8d2c7 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Getting quotas for user a6d1ace68aa84499a4929da60f3d71bf and project de0eb090bf44403983e0cbb99e038321. Resources: {'key_pairs'} {{(pid=125440) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 12:33:06.203876 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-495edb86-99bc-43c1-8dea-76d210e8d2c7 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.532852 Oct 31 12:33:06.212903 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 7/12] 10.222.0.15 () {62 vars in 1200 bytes} [Mon Oct 31 12:33:05 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 543 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 31 12:33:06.218668 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-1f51b1cc-e70a-4782-b5a0-d802040fceca tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:33:06.221085 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-1f51b1cc-e70a-4782-b5a0-d802040fceca tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] [instance: 8d254a92-15fa-4d98-8954-a8028647165e] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:33:06.352637 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-1f51b1cc-e70a-4782-b5a0-d802040fceca tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d59ee6f94848308665a32099cf5255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4d5cd8851dc4216b4e3e035a32decad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:33:06.361387 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-1f51b1cc-e70a-4782-b5a0-d802040fceca tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] 10.222.0.15 "GET /compute/v2.1/servers/8d254a92-15fa-4d98-8954-a8028647165e" status: 200 len: 1214 microversion: 2.1 time: 0.147185 Oct 31 12:33:06.364028 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 8/13] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:33:06 2022] GET /compute/v2.1/servers/8d254a92-15fa-4d98-8954-a8028647165e => generated 1214 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:33:06.382761 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-020a783b-22d9-4366-bc64-41428620370c tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-962011278", "imageRef": "fbbea321-8f0d-4092-b070-b67a6931d610", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 12:33:06.498870 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.network.neutron [None req-020a783b-22d9-4366-bc64-41428620370c tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] validate_networks() for [('9c998076-e873-4913-aa9f-032e3218ef2a', None, None, None, None, None)] {{(pid=125440) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 12:33:06.876034 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.virt.hardware [None req-6f95b1d9-cf2d-46e2-a1c2-f5a9ed18eb2a tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Flavor limits 0:0:0 {{(pid=125441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 12:33:06.876573 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.virt.hardware [None req-6f95b1d9-cf2d-46e2-a1c2-f5a9ed18eb2a tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Image limits 0:0:0 {{(pid=125441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 12:33:06.876902 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.virt.hardware [None req-6f95b1d9-cf2d-46e2-a1c2-f5a9ed18eb2a tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Flavor pref 0:0:0 {{(pid=125441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 12:33:06.877305 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.virt.hardware [None req-6f95b1d9-cf2d-46e2-a1c2-f5a9ed18eb2a tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Image pref 0:0:0 {{(pid=125441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 12:33:06.877709 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.virt.hardware [None req-6f95b1d9-cf2d-46e2-a1c2-f5a9ed18eb2a tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 12:33:06.901493 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-6f95b1d9-cf2d-46e2-a1c2-f5a9ed18eb2a tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:06.902010 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-6f95b1d9-cf2d-46e2-a1c2-f5a9ed18eb2a tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:06.902506 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-6f95b1d9-cf2d-46e2-a1c2-f5a9ed18eb2a tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:06.905326 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-6f95b1d9-cf2d-46e2-a1c2-f5a9ed18eb2a tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:06.907091 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-6f95b1d9-cf2d-46e2-a1c2-f5a9ed18eb2a tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:06.908001 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-6f95b1d9-cf2d-46e2-a1c2-f5a9ed18eb2a tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:06.961775 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.quota [None req-6f95b1d9-cf2d-46e2-a1c2-f5a9ed18eb2a tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Getting quotas for project b9a2bf9a5a484523a700e4e6c568d4de. Resources: {'instances', 'cores', 'ram'} {{(pid=125441) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 12:33:06.973710 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.quota [None req-6f95b1d9-cf2d-46e2-a1c2-f5a9ed18eb2a tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Getting quotas for user d6c1beb321e44908ab987b17f7b74484 and project b9a2bf9a5a484523a700e4e6c568d4de. Resources: {'instances', 'cores', 'ram'} {{(pid=125441) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 12:33:07.010628 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-6f95b1d9-cf2d-46e2-a1c2-f5a9ed18eb2a tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Going to run 1 instances... {{(pid=125441) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 12:33:07.018402 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-6f95b1d9-cf2d-46e2-a1c2-f5a9ed18eb2a tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] [instance: ff125cf8-e8a5-4f00-ade9-045b18ee33f4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fbbea321-8f0d-4092-b070-b67a6931d610',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125441) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 12:33:07.218941 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-6f95b1d9-cf2d-46e2-a1c2-f5a9ed18eb2a tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.422403 Oct 31 12:33:07.221252 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 6/14] 10.222.0.15 () {60 vars in 1147 bytes} [Mon Oct 31 12:33:04 2022] POST /compute/v2.1/servers => generated 402 bytes in 2427 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 12:33:07.254222 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-fbd852c1-9567-4c42-82dd-bc54122f8af1 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-566457686", "imageRef": "fbbea321-8f0d-4092-b070-b67a6931d610", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6630ddc4-dc53-4e5a-8b9d-7632c3075289"}], "security_groups": [{"name": "tempest-securitygroup--1173477971"}], "key_name": "tempest-keypair-360295023", "user_data": "}} {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 12:33:07.545784 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.virt.hardware [None req-020a783b-22d9-4366-bc64-41428620370c tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Flavor limits 0:0:0 {{(pid=125440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 12:33:07.546321 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.virt.hardware [None req-020a783b-22d9-4366-bc64-41428620370c tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Image limits 0:0:0 {{(pid=125440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 12:33:07.546944 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.virt.hardware [None req-020a783b-22d9-4366-bc64-41428620370c tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Flavor pref 0:0:0 {{(pid=125440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 12:33:07.547388 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.virt.hardware [None req-020a783b-22d9-4366-bc64-41428620370c tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Image pref 0:0:0 {{(pid=125440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 12:33:07.547805 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.virt.hardware [None req-020a783b-22d9-4366-bc64-41428620370c tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 12:33:07.602129 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-020a783b-22d9-4366-bc64-41428620370c tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:07.603067 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-020a783b-22d9-4366-bc64-41428620370c tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:07.608726 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-020a783b-22d9-4366-bc64-41428620370c tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:07.613565 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-020a783b-22d9-4366-bc64-41428620370c tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:07.615769 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-020a783b-22d9-4366-bc64-41428620370c tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:07.616591 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-020a783b-22d9-4366-bc64-41428620370c tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:07.704496 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.quota [None req-020a783b-22d9-4366-bc64-41428620370c tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Getting quotas for project 7573cb9c503243ab90b1649591d550e6. Resources: {'instances', 'cores', 'ram'} {{(pid=125440) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 12:33:07.735837 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.quota [None req-020a783b-22d9-4366-bc64-41428620370c tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Getting quotas for user db2e978bcb824a5e9d593b861c9e3bd7 and project 7573cb9c503243ab90b1649591d550e6. Resources: {'instances', 'cores', 'ram'} {{(pid=125440) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 12:33:07.803190 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-020a783b-22d9-4366-bc64-41428620370c tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Going to run 1 instances... {{(pid=125440) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 12:33:07.805558 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-020a783b-22d9-4366-bc64-41428620370c tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] [instance: d0befdd2-2ecd-4006-bfdd-86d5253a7687] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fbbea321-8f0d-4092-b070-b67a6931d610',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125440) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 12:33:07.928643 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.network.neutron [None req-fbd852c1-9567-4c42-82dd-bc54122f8af1 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] validate_networks() for [('6630ddc4-dc53-4e5a-8b9d-7632c3075289', None, None, None, None, None)] {{(pid=125441) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 12:33:07.951225 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-020a783b-22d9-4366-bc64-41428620370c tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.585896 Oct 31 12:33:07.960099 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 9/15] 10.222.0.15 () {60 vars in 1147 bytes} [Mon Oct 31 12:33:06 2022] POST /compute/v2.1/servers => generated 383 bytes in 1595 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 12:33:07.981972 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-52c8529c-c2b0-4f72-8385-ed0772f7ddda tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:33:07.982987 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-52c8529c-c2b0-4f72-8385-ed0772f7ddda tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] [instance: ff125cf8-e8a5-4f00-ade9-045b18ee33f4] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:33:08.186993 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-52c8529c-c2b0-4f72-8385-ed0772f7ddda tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c1beb321e44908ab987b17f7b74484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a2bf9a5a484523a700e4e6c568d4de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:33:08.194850 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-52c8529c-c2b0-4f72-8385-ed0772f7ddda tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] 10.222.0.15 "GET /compute/v2.1/servers/ff125cf8-e8a5-4f00-ade9-045b18ee33f4" status: 200 len: 1238 microversion: 2.1 time: 0.231369 Oct 31 12:33:08.195519 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 10/16] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:33:07 2022] GET /compute/v2.1/servers/ff125cf8-e8a5-4f00-ade9-045b18ee33f4 => generated 1238 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:33:08.225900 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-a03a7e6b-7679-4a7b-9948-036e70048beb tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:33:08.225900 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-a03a7e6b-7679-4a7b-9948-036e70048beb tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] [instance: 8d254a92-15fa-4d98-8954-a8028647165e] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:33:08.460961 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-a03a7e6b-7679-4a7b-9948-036e70048beb tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d59ee6f94848308665a32099cf5255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4d5cd8851dc4216b4e3e035a32decad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:33:08.470749 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-a03a7e6b-7679-4a7b-9948-036e70048beb tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] 10.222.0.15 "GET /compute/v2.1/servers/8d254a92-15fa-4d98-8954-a8028647165e" status: 200 len: 1214 microversion: 2.1 time: 0.274202 Oct 31 12:33:08.493178 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 11/17] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:33:08 2022] GET /compute/v2.1/servers/8d254a92-15fa-4d98-8954-a8028647165e => generated 1214 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:33:08.525785 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-923f4f29-1357-4aa6-8d4f-98be278ecbca tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:33:08.526449 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-923f4f29-1357-4aa6-8d4f-98be278ecbca tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] [instance: d0befdd2-2ecd-4006-bfdd-86d5253a7687] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:33:08.786136 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-923f4f29-1357-4aa6-8d4f-98be278ecbca tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2e978bcb824a5e9d593b861c9e3bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7573cb9c503243ab90b1649591d550e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:33:08.833977 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-923f4f29-1357-4aa6-8d4f-98be278ecbca tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] 10.222.0.15 "GET /compute/v2.1/servers/d0befdd2-2ecd-4006-bfdd-86d5253a7687" status: 200 len: 1221 microversion: 2.1 time: 0.329966 Oct 31 12:33:08.839408 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 12/18] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:33:08 2022] GET /compute/v2.1/servers/d0befdd2-2ecd-4006-bfdd-86d5253a7687 => generated 1221 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:33:09.235911 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-bba3dd20-ac1c-4306-a46a-c7f7b83ed7cb tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:33:09.239045 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-bba3dd20-ac1c-4306-a46a-c7f7b83ed7cb tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] [instance: ff125cf8-e8a5-4f00-ade9-045b18ee33f4] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:33:09.271195 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-bba3dd20-ac1c-4306-a46a-c7f7b83ed7cb tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:09.275367 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-bba3dd20-ac1c-4306-a46a-c7f7b83ed7cb tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:09.276661 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-bba3dd20-ac1c-4306-a46a-c7f7b83ed7cb tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:09.282418 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-bba3dd20-ac1c-4306-a46a-c7f7b83ed7cb tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:09.283862 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-bba3dd20-ac1c-4306-a46a-c7f7b83ed7cb tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:09.286946 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-bba3dd20-ac1c-4306-a46a-c7f7b83ed7cb tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:09.799597 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-bba3dd20-ac1c-4306-a46a-c7f7b83ed7cb tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c1beb321e44908ab987b17f7b74484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a2bf9a5a484523a700e4e6c568d4de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:33:09.837711 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-bba3dd20-ac1c-4306-a46a-c7f7b83ed7cb tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] 10.222.0.15 "GET /compute/v2.1/servers/ff125cf8-e8a5-4f00-ade9-045b18ee33f4" status: 200 len: 1234 microversion: 2.1 time: 0.614089 Oct 31 12:33:09.848246 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 13/19] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:33:09 2022] GET /compute/v2.1/servers/ff125cf8-e8a5-4f00-ade9-045b18ee33f4 => generated 1234 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:33:09.867983 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-5e85e249-1d5b-4609-9144-157e2c4db6c5 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:33:09.868799 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-5e85e249-1d5b-4609-9144-157e2c4db6c5 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] [instance: 8d254a92-15fa-4d98-8954-a8028647165e] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:33:09.897249 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-5e85e249-1d5b-4609-9144-157e2c4db6c5 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:09.898203 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-5e85e249-1d5b-4609-9144-157e2c4db6c5 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:09.898949 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-5e85e249-1d5b-4609-9144-157e2c4db6c5 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:09.906560 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-5e85e249-1d5b-4609-9144-157e2c4db6c5 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:09.907335 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-5e85e249-1d5b-4609-9144-157e2c4db6c5 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:09.908813 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-5e85e249-1d5b-4609-9144-157e2c4db6c5 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:10.265912 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.virt.hardware [None req-fbd852c1-9567-4c42-82dd-bc54122f8af1 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Flavor limits 0:0:0 {{(pid=125441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 12:33:10.266390 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.virt.hardware [None req-fbd852c1-9567-4c42-82dd-bc54122f8af1 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Image limits 0:0:0 {{(pid=125441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 12:33:10.266785 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.virt.hardware [None req-fbd852c1-9567-4c42-82dd-bc54122f8af1 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Flavor pref 0:0:0 {{(pid=125441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 12:33:10.267353 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-5e85e249-1d5b-4609-9144-157e2c4db6c5 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d59ee6f94848308665a32099cf5255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4d5cd8851dc4216b4e3e035a32decad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:33:10.269760 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.virt.hardware [None req-fbd852c1-9567-4c42-82dd-bc54122f8af1 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Image pref 0:0:0 {{(pid=125441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 12:33:10.271240 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.virt.hardware [None req-fbd852c1-9567-4c42-82dd-bc54122f8af1 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 12:33:10.287127 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-5e85e249-1d5b-4609-9144-157e2c4db6c5 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] 10.222.0.15 "GET /compute/v2.1/servers/8d254a92-15fa-4d98-8954-a8028647165e" status: 200 len: 1266 microversion: 2.1 time: 0.431783 Oct 31 12:33:10.289138 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 14/20] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:33:09 2022] GET /compute/v2.1/servers/8d254a92-15fa-4d98-8954-a8028647165e => generated 1266 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:33:10.297218 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-fbd852c1-9567-4c42-82dd-bc54122f8af1 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:10.301236 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-8166593e-5889-41b6-b2c1-19cd185ec167 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:33:10.302214 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-fbd852c1-9567-4c42-82dd-bc54122f8af1 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:10.303690 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-fbd852c1-9567-4c42-82dd-bc54122f8af1 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:10.312411 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-fbd852c1-9567-4c42-82dd-bc54122f8af1 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:10.312903 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-fbd852c1-9567-4c42-82dd-bc54122f8af1 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:10.313532 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-fbd852c1-9567-4c42-82dd-bc54122f8af1 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:10.319521 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-8166593e-5889-41b6-b2c1-19cd185ec167 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] [instance: d0befdd2-2ecd-4006-bfdd-86d5253a7687] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:33:10.343154 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-8166593e-5889-41b6-b2c1-19cd185ec167 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:10.344365 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-8166593e-5889-41b6-b2c1-19cd185ec167 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:10.344951 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-8166593e-5889-41b6-b2c1-19cd185ec167 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:10.346686 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-8166593e-5889-41b6-b2c1-19cd185ec167 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:10.350784 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-8166593e-5889-41b6-b2c1-19cd185ec167 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:10.351805 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-8166593e-5889-41b6-b2c1-19cd185ec167 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:10.389704 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.quota [None req-fbd852c1-9567-4c42-82dd-bc54122f8af1 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Getting quotas for project bfbc3a46f12942299b99cdd20c989e1f. Resources: {'instances', 'cores', 'ram'} {{(pid=125441) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 12:33:10.404149 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.quota [None req-fbd852c1-9567-4c42-82dd-bc54122f8af1 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Getting quotas for user b2c03f0365ee4a26b8c076ae365325b2 and project bfbc3a46f12942299b99cdd20c989e1f. Resources: {'instances', 'cores', 'ram'} {{(pid=125441) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 12:33:10.474070 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-fbd852c1-9567-4c42-82dd-bc54122f8af1 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Going to run 1 instances... {{(pid=125441) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 12:33:10.477868 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-fbd852c1-9567-4c42-82dd-bc54122f8af1 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] [instance: 9906becc-a42b-4b4c-855a-450915f7a3f8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fbbea321-8f0d-4092-b070-b67a6931d610',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125441) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 12:33:10.578830 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-8166593e-5889-41b6-b2c1-19cd185ec167 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2e978bcb824a5e9d593b861c9e3bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7573cb9c503243ab90b1649591d550e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:33:10.589907 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-8166593e-5889-41b6-b2c1-19cd185ec167 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] 10.222.0.15 "GET /compute/v2.1/servers/d0befdd2-2ecd-4006-bfdd-86d5253a7687" status: 200 len: 1217 microversion: 2.1 time: 0.294428 Oct 31 12:33:10.595747 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 15/21] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:33:10 2022] GET /compute/v2.1/servers/d0befdd2-2ecd-4006-bfdd-86d5253a7687 => generated 1217 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:33:10.605745 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-fbd852c1-9567-4c42-82dd-bc54122f8af1 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 3.381788 Oct 31 12:33:10.615357 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 7/22] 10.222.0.15 () {60 vars in 1147 bytes} [Mon Oct 31 12:33:07 2022] POST /compute/v2.1/servers => generated 402 bytes in 3392 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 12:33:10.621517 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-1caa15d6-0b14-4b62-b053-fa2292ae9bf6 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:33:10.622114 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-1caa15d6-0b14-4b62-b053-fa2292ae9bf6 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] [instance: 9906becc-a42b-4b4c-855a-450915f7a3f8] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:33:10.874294 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-d1ecc776-1d5f-4c1a-9f2d-c4229feb4b47 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:33:10.875275 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-d1ecc776-1d5f-4c1a-9f2d-c4229feb4b47 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] [instance: ff125cf8-e8a5-4f00-ade9-045b18ee33f4] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:33:10.932877 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-1caa15d6-0b14-4b62-b053-fa2292ae9bf6 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c03f0365ee4a26b8c076ae365325b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfbc3a46f12942299b99cdd20c989e1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:33:10.945375 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-1caa15d6-0b14-4b62-b053-fa2292ae9bf6 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] 10.222.0.15 "GET /compute/v2.1/servers/9906becc-a42b-4b4c-855a-450915f7a3f8" status: 200 len: 1240 microversion: 2.1 time: 0.327543 Oct 31 12:33:10.948177 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 16/23] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:33:10 2022] GET /compute/v2.1/servers/9906becc-a42b-4b4c-855a-450915f7a3f8 => generated 1240 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:33:10.974180 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-d1ecc776-1d5f-4c1a-9f2d-c4229feb4b47 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:10.975110 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-d1ecc776-1d5f-4c1a-9f2d-c4229feb4b47 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:10.977583 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-d1ecc776-1d5f-4c1a-9f2d-c4229feb4b47 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:10.983179 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-d1ecc776-1d5f-4c1a-9f2d-c4229feb4b47 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:10.985430 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-d1ecc776-1d5f-4c1a-9f2d-c4229feb4b47 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:10.996584 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-d1ecc776-1d5f-4c1a-9f2d-c4229feb4b47 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:11.324361 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-1327538b-c8d9-408e-8cce-7d08943e41b5 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:33:11.324990 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-1327538b-c8d9-408e-8cce-7d08943e41b5 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] [instance: 8d254a92-15fa-4d98-8954-a8028647165e] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:33:11.346303 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-1327538b-c8d9-408e-8cce-7d08943e41b5 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:11.346879 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-1327538b-c8d9-408e-8cce-7d08943e41b5 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:11.352316 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-1327538b-c8d9-408e-8cce-7d08943e41b5 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:11.356887 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-1327538b-c8d9-408e-8cce-7d08943e41b5 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:11.358318 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-1327538b-c8d9-408e-8cce-7d08943e41b5 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:11.361005 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-1327538b-c8d9-408e-8cce-7d08943e41b5 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:11.734812 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-d1ecc776-1d5f-4c1a-9f2d-c4229feb4b47 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c1beb321e44908ab987b17f7b74484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a2bf9a5a484523a700e4e6c568d4de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:33:11.782012 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-d1ecc776-1d5f-4c1a-9f2d-c4229feb4b47 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] 10.222.0.15 "GET /compute/v2.1/servers/ff125cf8-e8a5-4f00-ade9-045b18ee33f4" status: 200 len: 1290 microversion: 2.1 time: 0.911748 Oct 31 12:33:11.803817 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 8/24] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:33:10 2022] GET /compute/v2.1/servers/ff125cf8-e8a5-4f00-ade9-045b18ee33f4 => generated 1290 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:33:11.809048 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-58118838-53ec-4163-bfb2-c8bfd32787be tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:33:11.809706 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-58118838-53ec-4163-bfb2-c8bfd32787be tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] [instance: d0befdd2-2ecd-4006-bfdd-86d5253a7687] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:33:11.850122 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-58118838-53ec-4163-bfb2-c8bfd32787be tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:11.850616 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-58118838-53ec-4163-bfb2-c8bfd32787be tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:11.851047 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-58118838-53ec-4163-bfb2-c8bfd32787be tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:11.851779 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-58118838-53ec-4163-bfb2-c8bfd32787be tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:11.852341 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-58118838-53ec-4163-bfb2-c8bfd32787be tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:11.852800 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-58118838-53ec-4163-bfb2-c8bfd32787be tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:12.103751 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-58118838-53ec-4163-bfb2-c8bfd32787be tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2e978bcb824a5e9d593b861c9e3bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7573cb9c503243ab90b1649591d550e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:33:12.122503 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-58118838-53ec-4163-bfb2-c8bfd32787be tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] 10.222.0.15 "GET /compute/v2.1/servers/d0befdd2-2ecd-4006-bfdd-86d5253a7687" status: 200 len: 1273 microversion: 2.1 time: 0.317428 Oct 31 12:33:12.126429 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 9/25] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:33:11 2022] GET /compute/v2.1/servers/d0befdd2-2ecd-4006-bfdd-86d5253a7687 => generated 1273 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:33:12.144302 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-5d363492-da1a-4036-b374-55e044c305b2 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:33:12.157036 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-5d363492-da1a-4036-b374-55e044c305b2 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] [instance: 9906becc-a42b-4b4c-855a-450915f7a3f8] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:33:12.180241 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-5d363492-da1a-4036-b374-55e044c305b2 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:12.180753 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-5d363492-da1a-4036-b374-55e044c305b2 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:12.181193 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-5d363492-da1a-4036-b374-55e044c305b2 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:12.181916 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-5d363492-da1a-4036-b374-55e044c305b2 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:12.182375 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-5d363492-da1a-4036-b374-55e044c305b2 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:12.182802 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-5d363492-da1a-4036-b374-55e044c305b2 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:12.370575 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-1327538b-c8d9-408e-8cce-7d08943e41b5 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d59ee6f94848308665a32099cf5255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4d5cd8851dc4216b4e3e035a32decad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:33:12.384240 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-1327538b-c8d9-408e-8cce-7d08943e41b5 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] 10.222.0.15 "GET /compute/v2.1/servers/8d254a92-15fa-4d98-8954-a8028647165e" status: 200 len: 1272 microversion: 2.1 time: 1.067020 Oct 31 12:33:12.408362 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 17/26] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:33:11 2022] GET /compute/v2.1/servers/8d254a92-15fa-4d98-8954-a8028647165e => generated 1272 bytes in 1097 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:33:12.431981 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-5d363492-da1a-4036-b374-55e044c305b2 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c03f0365ee4a26b8c076ae365325b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfbc3a46f12942299b99cdd20c989e1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:33:12.455154 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-5d363492-da1a-4036-b374-55e044c305b2 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] 10.222.0.15 "GET /compute/v2.1/servers/9906becc-a42b-4b4c-855a-450915f7a3f8" status: 200 len: 1244 microversion: 2.1 time: 0.324054 Oct 31 12:33:12.458638 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 10/27] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:33:12 2022] GET /compute/v2.1/servers/9906becc-a42b-4b4c-855a-450915f7a3f8 => generated 1244 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:33:12.807877 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-a3881206-91e4-4593-bb35-cdaa6c88890b tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:33:12.808467 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-a3881206-91e4-4593-bb35-cdaa6c88890b tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] [instance: ff125cf8-e8a5-4f00-ade9-045b18ee33f4] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:33:12.820603 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-a3881206-91e4-4593-bb35-cdaa6c88890b tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:12.821104 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-a3881206-91e4-4593-bb35-cdaa6c88890b tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:12.831446 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-a3881206-91e4-4593-bb35-cdaa6c88890b tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:12.834644 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-a3881206-91e4-4593-bb35-cdaa6c88890b tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:12.837239 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-a3881206-91e4-4593-bb35-cdaa6c88890b tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:12.840952 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-a3881206-91e4-4593-bb35-cdaa6c88890b tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:13.073023 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-dc27b69d-f6c8-4371-93d0-6a658fddde5d tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1528569852", "imageRef": "fbbea321-8f0d-4092-b070-b67a6931d610", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "89ec9ee8-fff5-4bf0-84fc-cc885776f150"}], "security_groups": [{"name": "tempest-securitygroup--1775222746"}], "key_name": "tempest-keypair-1575790766", "user_data": "}} {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 12:33:13.079753 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-a3881206-91e4-4593-bb35-cdaa6c88890b tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c1beb321e44908ab987b17f7b74484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a2bf9a5a484523a700e4e6c568d4de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:33:13.096350 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-a3881206-91e4-4593-bb35-cdaa6c88890b tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] 10.222.0.15 "GET /compute/v2.1/servers/ff125cf8-e8a5-4f00-ade9-045b18ee33f4" status: 200 len: 1296 microversion: 2.1 time: 0.291320 Oct 31 12:33:13.099659 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 18/28] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:33:12 2022] GET /compute/v2.1/servers/ff125cf8-e8a5-4f00-ade9-045b18ee33f4 => generated 1296 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:33:13.150803 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-b3096ebb-f61f-4154-ae53-4514682d6adf tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:33:13.152478 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-b3096ebb-f61f-4154-ae53-4514682d6adf tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] [instance: d0befdd2-2ecd-4006-bfdd-86d5253a7687] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:33:13.201995 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-b3096ebb-f61f-4154-ae53-4514682d6adf tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:13.216584 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-b3096ebb-f61f-4154-ae53-4514682d6adf tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:13.217937 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-b3096ebb-f61f-4154-ae53-4514682d6adf tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:13.219343 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-b3096ebb-f61f-4154-ae53-4514682d6adf tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:13.221098 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-b3096ebb-f61f-4154-ae53-4514682d6adf tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:13.225674 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-b3096ebb-f61f-4154-ae53-4514682d6adf tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:14.278253 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.network.neutron [None req-dc27b69d-f6c8-4371-93d0-6a658fddde5d tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] validate_networks() for [('89ec9ee8-fff5-4bf0-84fc-cc885776f150', None, None, None, None, None)] {{(pid=125441) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 12:33:14.338599 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-b3096ebb-f61f-4154-ae53-4514682d6adf tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2e978bcb824a5e9d593b861c9e3bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7573cb9c503243ab90b1649591d550e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:33:14.353070 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-b3096ebb-f61f-4154-ae53-4514682d6adf tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] 10.222.0.15 "GET /compute/v2.1/servers/d0befdd2-2ecd-4006-bfdd-86d5253a7687" status: 200 len: 1281 microversion: 2.1 time: 1.205581 Oct 31 12:33:14.364541 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 19/29] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:33:13 2022] GET /compute/v2.1/servers/d0befdd2-2ecd-4006-bfdd-86d5253a7687 => generated 1281 bytes in 1219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:33:14.390627 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-3852d4b7-7d00-4f3b-9f00-e84c3c6cf7a2 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:33:14.391553 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-3852d4b7-7d00-4f3b-9f00-e84c3c6cf7a2 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] [instance: 8d254a92-15fa-4d98-8954-a8028647165e] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:33:14.407527 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-3852d4b7-7d00-4f3b-9f00-e84c3c6cf7a2 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:14.408388 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-3852d4b7-7d00-4f3b-9f00-e84c3c6cf7a2 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:14.409583 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-3852d4b7-7d00-4f3b-9f00-e84c3c6cf7a2 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:14.410647 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-3852d4b7-7d00-4f3b-9f00-e84c3c6cf7a2 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:14.412245 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-3852d4b7-7d00-4f3b-9f00-e84c3c6cf7a2 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:14.415696 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-3852d4b7-7d00-4f3b-9f00-e84c3c6cf7a2 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:16.479409 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-3852d4b7-7d00-4f3b-9f00-e84c3c6cf7a2 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d59ee6f94848308665a32099cf5255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4d5cd8851dc4216b4e3e035a32decad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:33:16.500879 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-3852d4b7-7d00-4f3b-9f00-e84c3c6cf7a2 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] 10.222.0.15 "GET /compute/v2.1/servers/8d254a92-15fa-4d98-8954-a8028647165e" status: 200 len: 1314 microversion: 2.1 time: 2.130412 Oct 31 12:33:16.507446 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 20/30] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:33:14 2022] GET /compute/v2.1/servers/8d254a92-15fa-4d98-8954-a8028647165e => generated 1314 bytes in 2142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:33:16.542201 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-ef8efce3-71ff-4453-9edc-2b9b1e717317 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:33:16.547313 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-ef8efce3-71ff-4453-9edc-2b9b1e717317 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] [instance: 9906becc-a42b-4b4c-855a-450915f7a3f8] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:33:16.598996 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-ef8efce3-71ff-4453-9edc-2b9b1e717317 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:16.600627 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-ef8efce3-71ff-4453-9edc-2b9b1e717317 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:16.602998 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-ef8efce3-71ff-4453-9edc-2b9b1e717317 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:16.607499 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-ef8efce3-71ff-4453-9edc-2b9b1e717317 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:16.610528 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-ef8efce3-71ff-4453-9edc-2b9b1e717317 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:16.611594 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-ef8efce3-71ff-4453-9edc-2b9b1e717317 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:16.877719 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-ef8efce3-71ff-4453-9edc-2b9b1e717317 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c03f0365ee4a26b8c076ae365325b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfbc3a46f12942299b99cdd20c989e1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:33:16.889801 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-ef8efce3-71ff-4453-9edc-2b9b1e717317 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] 10.222.0.15 "GET /compute/v2.1/servers/9906becc-a42b-4b4c-855a-450915f7a3f8" status: 200 len: 1298 microversion: 2.1 time: 0.377132 Oct 31 12:33:16.892241 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 21/31] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:33:16 2022] GET /compute/v2.1/servers/9906becc-a42b-4b4c-855a-450915f7a3f8 => generated 1298 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:33:16.911074 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-f14ed2a3-65e3-470f-bd4e-c621df6309ea tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:33:16.911997 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-f14ed2a3-65e3-470f-bd4e-c621df6309ea tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] [instance: ff125cf8-e8a5-4f00-ade9-045b18ee33f4] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:33:16.924920 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-f14ed2a3-65e3-470f-bd4e-c621df6309ea tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:16.926699 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-f14ed2a3-65e3-470f-bd4e-c621df6309ea tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:16.929765 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-f14ed2a3-65e3-470f-bd4e-c621df6309ea tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:16.930881 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-f14ed2a3-65e3-470f-bd4e-c621df6309ea tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:16.931541 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-f14ed2a3-65e3-470f-bd4e-c621df6309ea tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:16.932119 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-f14ed2a3-65e3-470f-bd4e-c621df6309ea tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:17.586747 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-f14ed2a3-65e3-470f-bd4e-c621df6309ea tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c1beb321e44908ab987b17f7b74484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a2bf9a5a484523a700e4e6c568d4de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:33:17.600280 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-f14ed2a3-65e3-470f-bd4e-c621df6309ea tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] 10.222.0.15 "GET /compute/v2.1/servers/ff125cf8-e8a5-4f00-ade9-045b18ee33f4" status: 200 len: 1296 microversion: 2.1 time: 0.706182 Oct 31 12:33:17.603106 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 22/32] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:33:16 2022] GET /compute/v2.1/servers/ff125cf8-e8a5-4f00-ade9-045b18ee33f4 => generated 1296 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:33:17.620674 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-3d3adf1a-270b-4a84-80b1-1a5033262712 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:33:17.623230 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-3d3adf1a-270b-4a84-80b1-1a5033262712 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] [instance: d0befdd2-2ecd-4006-bfdd-86d5253a7687] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:33:17.630356 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG dbcounter [-] [125440] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=125440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:33:17.657573 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-3d3adf1a-270b-4a84-80b1-1a5033262712 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:17.658007 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-3d3adf1a-270b-4a84-80b1-1a5033262712 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:17.658461 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-3d3adf1a-270b-4a84-80b1-1a5033262712 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:17.659223 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-3d3adf1a-270b-4a84-80b1-1a5033262712 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:17.663392 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-3d3adf1a-270b-4a84-80b1-1a5033262712 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:17.665771 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-3d3adf1a-270b-4a84-80b1-1a5033262712 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:17.670237 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG dbcounter [-] [125440] Writing DB stats nova_cell0:SELECT=4 {{(pid=125440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:33:17.899195 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.virt.hardware [None req-dc27b69d-f6c8-4371-93d0-6a658fddde5d tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Flavor limits 0:0:0 {{(pid=125441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 12:33:17.899761 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.virt.hardware [None req-dc27b69d-f6c8-4371-93d0-6a658fddde5d tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Image limits 0:0:0 {{(pid=125441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 12:33:17.900428 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.virt.hardware [None req-dc27b69d-f6c8-4371-93d0-6a658fddde5d tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Flavor pref 0:0:0 {{(pid=125441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 12:33:17.901625 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.virt.hardware [None req-dc27b69d-f6c8-4371-93d0-6a658fddde5d tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Image pref 0:0:0 {{(pid=125441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 12:33:17.902357 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.virt.hardware [None req-dc27b69d-f6c8-4371-93d0-6a658fddde5d tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 12:33:17.926874 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-dc27b69d-f6c8-4371-93d0-6a658fddde5d tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:17.929550 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-dc27b69d-f6c8-4371-93d0-6a658fddde5d tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:17.933601 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-dc27b69d-f6c8-4371-93d0-6a658fddde5d tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:17.946106 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-dc27b69d-f6c8-4371-93d0-6a658fddde5d tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:17.951233 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-dc27b69d-f6c8-4371-93d0-6a658fddde5d tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:17.954837 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-dc27b69d-f6c8-4371-93d0-6a658fddde5d tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:18.029528 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.quota [None req-dc27b69d-f6c8-4371-93d0-6a658fddde5d tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Getting quotas for project de0eb090bf44403983e0cbb99e038321. Resources: {'instances', 'cores', 'ram'} {{(pid=125441) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 12:33:18.047370 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.quota [None req-dc27b69d-f6c8-4371-93d0-6a658fddde5d tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Getting quotas for user a6d1ace68aa84499a4929da60f3d71bf and project de0eb090bf44403983e0cbb99e038321. Resources: {'instances', 'cores', 'ram'} {{(pid=125441) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 12:33:18.082281 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-dc27b69d-f6c8-4371-93d0-6a658fddde5d tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Going to run 1 instances... {{(pid=125441) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 12:33:18.105565 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-dc27b69d-f6c8-4371-93d0-6a658fddde5d tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] [instance: 852e8870-b3ec-4a21-a9b5-e31a423ddd3d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fbbea321-8f0d-4092-b070-b67a6931d610',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125441) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 12:33:18.340666 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-dc27b69d-f6c8-4371-93d0-6a658fddde5d tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 5.287431 Oct 31 12:33:18.361032 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 11/33] 10.222.0.15 () {62 vars in 1188 bytes} [Mon Oct 31 12:33:13 2022] POST /compute/v2.1/servers => generated 402 bytes in 5315 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 31 12:33:18.372896 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-fa16da19-0d79-4f00-a40d-b29598fe0d70 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:33:18.383463 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-fa16da19-0d79-4f00-a40d-b29598fe0d70 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] [instance: 8d254a92-15fa-4d98-8954-a8028647165e] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:33:18.420935 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-fa16da19-0d79-4f00-a40d-b29598fe0d70 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:18.435635 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-fa16da19-0d79-4f00-a40d-b29598fe0d70 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:18.437175 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-fa16da19-0d79-4f00-a40d-b29598fe0d70 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:18.441597 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-fa16da19-0d79-4f00-a40d-b29598fe0d70 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:18.448459 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-fa16da19-0d79-4f00-a40d-b29598fe0d70 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:18.457789 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-fa16da19-0d79-4f00-a40d-b29598fe0d70 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:19.801221 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-3d3adf1a-270b-4a84-80b1-1a5033262712 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2e978bcb824a5e9d593b861c9e3bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7573cb9c503243ab90b1649591d550e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:33:19.810718 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-3d3adf1a-270b-4a84-80b1-1a5033262712 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] 10.222.0.15 "GET /compute/v2.1/servers/d0befdd2-2ecd-4006-bfdd-86d5253a7687" status: 200 len: 1279 microversion: 2.1 time: 2.206500 Oct 31 12:33:19.815446 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 23/34] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:33:17 2022] GET /compute/v2.1/servers/d0befdd2-2ecd-4006-bfdd-86d5253a7687 => generated 1279 bytes in 2212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:33:19.832791 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-ac4913d9-b0e7-4245-b047-e574a1fdeff6 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:33:19.833763 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-ac4913d9-b0e7-4245-b047-e574a1fdeff6 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] [instance: 9906becc-a42b-4b4c-855a-450915f7a3f8] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:33:19.860535 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-ac4913d9-b0e7-4245-b047-e574a1fdeff6 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:19.863732 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-ac4913d9-b0e7-4245-b047-e574a1fdeff6 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:19.864203 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-ac4913d9-b0e7-4245-b047-e574a1fdeff6 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:19.865137 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-ac4913d9-b0e7-4245-b047-e574a1fdeff6 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:19.865661 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-ac4913d9-b0e7-4245-b047-e574a1fdeff6 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:19.866135 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-ac4913d9-b0e7-4245-b047-e574a1fdeff6 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:19.914370 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-fa16da19-0d79-4f00-a40d-b29598fe0d70 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d59ee6f94848308665a32099cf5255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4d5cd8851dc4216b4e3e035a32decad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:33:19.934465 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-fa16da19-0d79-4f00-a40d-b29598fe0d70 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] 10.222.0.15 "GET /compute/v2.1/servers/8d254a92-15fa-4d98-8954-a8028647165e" status: 200 len: 1314 microversion: 2.1 time: 1.563362 Oct 31 12:33:19.961597 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 12/35] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:33:18 2022] GET /compute/v2.1/servers/8d254a92-15fa-4d98-8954-a8028647165e => generated 1314 bytes in 1600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:33:19.968492 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-207de14d-2ca7-47d5-8108-190fd9443498 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:33:19.971852 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-207de14d-2ca7-47d5-8108-190fd9443498 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] [instance: 852e8870-b3ec-4a21-a9b5-e31a423ddd3d] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:33:19.987574 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-207de14d-2ca7-47d5-8108-190fd9443498 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:19.992420 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-207de14d-2ca7-47d5-8108-190fd9443498 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:19.993097 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-207de14d-2ca7-47d5-8108-190fd9443498 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:19.994043 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-207de14d-2ca7-47d5-8108-190fd9443498 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:19.994650 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-207de14d-2ca7-47d5-8108-190fd9443498 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:19.995271 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-207de14d-2ca7-47d5-8108-190fd9443498 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:20.351633 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-ac4913d9-b0e7-4245-b047-e574a1fdeff6 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c03f0365ee4a26b8c076ae365325b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfbc3a46f12942299b99cdd20c989e1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:33:20.363393 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-ac4913d9-b0e7-4245-b047-e574a1fdeff6 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] 10.222.0.15 "GET /compute/v2.1/servers/9906becc-a42b-4b4c-855a-450915f7a3f8" status: 200 len: 1298 microversion: 2.1 time: 0.546558 Oct 31 12:33:20.369206 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 24/36] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:33:19 2022] GET /compute/v2.1/servers/9906becc-a42b-4b4c-855a-450915f7a3f8 => generated 1298 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:33:20.383933 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-503f6436-a674-4cde-aa84-4ac2b3c93fac tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:33:20.384895 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-503f6436-a674-4cde-aa84-4ac2b3c93fac tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] [instance: ff125cf8-e8a5-4f00-ade9-045b18ee33f4] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:33:20.402840 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-503f6436-a674-4cde-aa84-4ac2b3c93fac tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:20.405173 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-503f6436-a674-4cde-aa84-4ac2b3c93fac tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:20.405823 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-503f6436-a674-4cde-aa84-4ac2b3c93fac tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:20.410856 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-503f6436-a674-4cde-aa84-4ac2b3c93fac tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:20.412398 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-503f6436-a674-4cde-aa84-4ac2b3c93fac tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:20.413308 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-503f6436-a674-4cde-aa84-4ac2b3c93fac tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:20.565847 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-207de14d-2ca7-47d5-8108-190fd9443498 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:33:20.580634 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-207de14d-2ca7-47d5-8108-190fd9443498 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:33:20.585706 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-207de14d-2ca7-47d5-8108-190fd9443498 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:33:20.592622 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-207de14d-2ca7-47d5-8108-190fd9443498 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] 10.222.0.15 "GET /compute/v2.1/servers/852e8870-b3ec-4a21-a9b5-e31a423ddd3d" status: 200 len: 1334 microversion: 2.20 time: 0.629523 Oct 31 12:33:20.593633 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 13/37] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Oct 31 12:33:19 2022] GET /compute/v2.1/servers/852e8870-b3ec-4a21-a9b5-e31a423ddd3d => generated 1334 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 12:33:20.851106 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-376b9e9c-8f03-4019-9811-f8782a6d07c8 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:33:20.851938 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-376b9e9c-8f03-4019-9811-f8782a6d07c8 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] [instance: d0befdd2-2ecd-4006-bfdd-86d5253a7687] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:33:20.865900 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-376b9e9c-8f03-4019-9811-f8782a6d07c8 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:20.884968 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-376b9e9c-8f03-4019-9811-f8782a6d07c8 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:20.886741 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-376b9e9c-8f03-4019-9811-f8782a6d07c8 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:20.892194 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-376b9e9c-8f03-4019-9811-f8782a6d07c8 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:20.892194 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-376b9e9c-8f03-4019-9811-f8782a6d07c8 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:20.892194 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-376b9e9c-8f03-4019-9811-f8782a6d07c8 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:20.938003 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG dbcounter [-] [125440] Writing DB stats nova_cell0:SELECT=32 {{(pid=125440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:33:22.836552 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-503f6436-a674-4cde-aa84-4ac2b3c93fac tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c1beb321e44908ab987b17f7b74484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a2bf9a5a484523a700e4e6c568d4de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:33:22.850747 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-503f6436-a674-4cde-aa84-4ac2b3c93fac tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] 10.222.0.15 "GET /compute/v2.1/servers/ff125cf8-e8a5-4f00-ade9-045b18ee33f4" status: 200 len: 1364 microversion: 2.1 time: 2.479538 Oct 31 12:33:22.865155 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 25/38] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:33:20 2022] GET /compute/v2.1/servers/ff125cf8-e8a5-4f00-ade9-045b18ee33f4 => generated 1364 bytes in 2495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:33:22.897385 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-a52851e5-f062-4c4d-8bb0-101b94fdd128 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:33:22.899020 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-a52851e5-f062-4c4d-8bb0-101b94fdd128 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] [instance: 8d254a92-15fa-4d98-8954-a8028647165e] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:33:22.920823 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-a52851e5-f062-4c4d-8bb0-101b94fdd128 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:22.921669 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-a52851e5-f062-4c4d-8bb0-101b94fdd128 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:22.922661 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-a52851e5-f062-4c4d-8bb0-101b94fdd128 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:22.925083 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-a52851e5-f062-4c4d-8bb0-101b94fdd128 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:22.926038 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-a52851e5-f062-4c4d-8bb0-101b94fdd128 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:22.926914 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-a52851e5-f062-4c4d-8bb0-101b94fdd128 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:23.320078 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-376b9e9c-8f03-4019-9811-f8782a6d07c8 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2e978bcb824a5e9d593b861c9e3bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7573cb9c503243ab90b1649591d550e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:33:23.334618 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-376b9e9c-8f03-4019-9811-f8782a6d07c8 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] 10.222.0.15 "GET /compute/v2.1/servers/d0befdd2-2ecd-4006-bfdd-86d5253a7687" status: 200 len: 1321 microversion: 2.1 time: 2.495537 Oct 31 12:33:23.352747 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 14/39] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:33:20 2022] GET /compute/v2.1/servers/d0befdd2-2ecd-4006-bfdd-86d5253a7687 => generated 1321 bytes in 2514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 12:33:23.367219 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-3269056b-2084-472f-b709-d522c4afb233 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:33:23.368917 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-3269056b-2084-472f-b709-d522c4afb233 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] [instance: 9906becc-a42b-4b4c-855a-450915f7a3f8] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:33:23.385076 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-3269056b-2084-472f-b709-d522c4afb233 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:23.385964 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-3269056b-2084-472f-b709-d522c4afb233 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:23.386677 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-3269056b-2084-472f-b709-d522c4afb233 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:23.389235 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-3269056b-2084-472f-b709-d522c4afb233 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:23.392011 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-3269056b-2084-472f-b709-d522c4afb233 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:23.392731 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-3269056b-2084-472f-b709-d522c4afb233 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:23.535560 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-3269056b-2084-472f-b709-d522c4afb233 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c03f0365ee4a26b8c076ae365325b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfbc3a46f12942299b99cdd20c989e1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:33:23.546365 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-3269056b-2084-472f-b709-d522c4afb233 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] 10.222.0.15 "GET /compute/v2.1/servers/9906becc-a42b-4b4c-855a-450915f7a3f8" status: 200 len: 1298 microversion: 2.1 time: 0.191345 Oct 31 12:33:23.552008 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 15/40] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:33:23 2022] GET /compute/v2.1/servers/9906becc-a42b-4b4c-855a-450915f7a3f8 => generated 1298 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:33:23.559919 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-0f02c3bc-a729-4512-8901-3c901f7360eb tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:33:23.564745 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-0f02c3bc-a729-4512-8901-3c901f7360eb tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] [instance: 852e8870-b3ec-4a21-a9b5-e31a423ddd3d] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:33:23.599770 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-0f02c3bc-a729-4512-8901-3c901f7360eb tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:23.610807 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-0f02c3bc-a729-4512-8901-3c901f7360eb tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:23.611548 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-0f02c3bc-a729-4512-8901-3c901f7360eb tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:23.613911 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-0f02c3bc-a729-4512-8901-3c901f7360eb tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:23.615580 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-0f02c3bc-a729-4512-8901-3c901f7360eb tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:23.617619 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-0f02c3bc-a729-4512-8901-3c901f7360eb tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:23.904778 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-0f02c3bc-a729-4512-8901-3c901f7360eb tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:33:23.924187 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-0f02c3bc-a729-4512-8901-3c901f7360eb tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:33:23.929754 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-0f02c3bc-a729-4512-8901-3c901f7360eb tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:33:23.936225 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-0f02c3bc-a729-4512-8901-3c901f7360eb tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] 10.222.0.15 "GET /compute/v2.1/servers/852e8870-b3ec-4a21-a9b5-e31a423ddd3d" status: 200 len: 1340 microversion: 2.20 time: 0.380155 Oct 31 12:33:23.938487 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 16/41] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Oct 31 12:33:23 2022] GET /compute/v2.1/servers/852e8870-b3ec-4a21-a9b5-e31a423ddd3d => generated 1340 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 12:33:24.241821 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [req-fba6ea8d-b281-48bf-98d3-604d21706bb3 req-00ddea8c-ebe6-41e4-84c5-ab65355f1140 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d254a92-15fa-4d98-8954-a8028647165e", "tag": "526d397e-43ed-4b15-84f5-0072c801c1b0"}]} {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 12:33:24.263432 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG dbcounter [-] [125441] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=13 {{(pid=125441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:33:24.296631 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [req-fba6ea8d-b281-48bf-98d3-604d21706bb3 req-00ddea8c-ebe6-41e4-84c5-ab65355f1140 service nova] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:24.298179 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [req-fba6ea8d-b281-48bf-98d3-604d21706bb3 req-00ddea8c-ebe6-41e4-84c5-ab65355f1140 service nova] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:24.301174 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [req-fba6ea8d-b281-48bf-98d3-604d21706bb3 req-00ddea8c-ebe6-41e4-84c5-ab65355f1140 service nova] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:24.383017 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.compute.server_external_events [req-fba6ea8d-b281-48bf-98d3-604d21706bb3 req-00ddea8c-ebe6-41e4-84c5-ab65355f1140 service nova] Creating event network-changed:526d397e-43ed-4b15-84f5-0072c801c1b0 for instance 8d254a92-15fa-4d98-8954-a8028647165e on hv-cinder-79617 Oct 31 12:33:24.387810 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [req-fba6ea8d-b281-48bf-98d3-604d21706bb3 req-00ddea8c-ebe6-41e4-84c5-ab65355f1140 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=125441) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 31 12:33:24.389727 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [req-fba6ea8d-b281-48bf-98d3-604d21706bb3 req-00ddea8c-ebe6-41e4-84c5-ab65355f1140 service nova] Acquired lock "compute-rpcapi-router" {{(pid=125441) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 31 12:33:24.396898 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-6e4e31c4-b945-4244-8d7f-8975eeb64ed0 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:24.397664 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-6e4e31c4-b945-4244-8d7f-8975eeb64ed0 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:24.398738 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-6e4e31c4-b945-4244-8d7f-8975eeb64ed0 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:24.400767 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-6e4e31c4-b945-4244-8d7f-8975eeb64ed0 None None] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:24.408058 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-6e4e31c4-b945-4244-8d7f-8975eeb64ed0 None None] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:24.409198 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-6e4e31c4-b945-4244-8d7f-8975eeb64ed0 None None] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:24.442142 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.compute.rpcapi [None req-6e4e31c4-b945-4244-8d7f-8975eeb64ed0 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 31 12:33:24.448297 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-6e4e31c4-b945-4244-8d7f-8975eeb64ed0 None None] Releasing lock "compute-rpcapi-router" {{(pid=125441) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 31 12:33:24.498721 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-6e4e31c4-b945-4244-8d7f-8975eeb64ed0 None None] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.556029 Oct 31 12:33:24.503226 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 17/42] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Oct 31 12:33:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 12:33:24.539810 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-f68e360f-847f-4304-b273-7b93aada5daa tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:33:24.542769 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-f68e360f-847f-4304-b273-7b93aada5daa tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] [instance: ff125cf8-e8a5-4f00-ade9-045b18ee33f4] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:33:24.563209 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-f68e360f-847f-4304-b273-7b93aada5daa tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:24.563971 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-f68e360f-847f-4304-b273-7b93aada5daa tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:24.567493 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-f68e360f-847f-4304-b273-7b93aada5daa tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:24.568619 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-f68e360f-847f-4304-b273-7b93aada5daa tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:24.569223 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-f68e360f-847f-4304-b273-7b93aada5daa tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:24.569791 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-f68e360f-847f-4304-b273-7b93aada5daa tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:24.789181 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-a52851e5-f062-4c4d-8bb0-101b94fdd128 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d59ee6f94848308665a32099cf5255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4d5cd8851dc4216b4e3e035a32decad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:33:24.807687 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-a52851e5-f062-4c4d-8bb0-101b94fdd128 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] 10.222.0.15 "GET /compute/v2.1/servers/8d254a92-15fa-4d98-8954-a8028647165e" status: 200 len: 1314 microversion: 2.1 time: 1.933066 Oct 31 12:33:24.810496 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 26/43] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:33:22 2022] GET /compute/v2.1/servers/8d254a92-15fa-4d98-8954-a8028647165e => generated 1314 bytes in 1944 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:33:24.823765 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-8a7dba70-eb6c-47f6-bf49-d4404760444c tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:33:24.824604 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-8a7dba70-eb6c-47f6-bf49-d4404760444c tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] [instance: d0befdd2-2ecd-4006-bfdd-86d5253a7687] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:33:24.838866 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-8a7dba70-eb6c-47f6-bf49-d4404760444c tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:24.841102 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-8a7dba70-eb6c-47f6-bf49-d4404760444c tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:24.841852 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-8a7dba70-eb6c-47f6-bf49-d4404760444c tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:24.844281 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-8a7dba70-eb6c-47f6-bf49-d4404760444c tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:24.845553 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-8a7dba70-eb6c-47f6-bf49-d4404760444c tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:24.848045 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-8a7dba70-eb6c-47f6-bf49-d4404760444c tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:25.430215 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-f68e360f-847f-4304-b273-7b93aada5daa tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c1beb321e44908ab987b17f7b74484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a2bf9a5a484523a700e4e6c568d4de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:33:25.438535 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-f68e360f-847f-4304-b273-7b93aada5daa tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] 10.222.0.15 "GET /compute/v2.1/servers/ff125cf8-e8a5-4f00-ade9-045b18ee33f4" status: 200 len: 1364 microversion: 2.1 time: 0.922145 Oct 31 12:33:25.441505 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 18/44] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:33:24 2022] GET /compute/v2.1/servers/ff125cf8-e8a5-4f00-ade9-045b18ee33f4 => generated 1364 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:33:25.448327 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-1d4fe22a-f2b8-41c7-8e68-1ec486d02581 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:33:25.449173 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-1d4fe22a-f2b8-41c7-8e68-1ec486d02581 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] [instance: 9906becc-a42b-4b4c-855a-450915f7a3f8] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:33:25.457374 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-1d4fe22a-f2b8-41c7-8e68-1ec486d02581 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:25.458076 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-1d4fe22a-f2b8-41c7-8e68-1ec486d02581 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:25.458856 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-1d4fe22a-f2b8-41c7-8e68-1ec486d02581 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:25.459937 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-1d4fe22a-f2b8-41c7-8e68-1ec486d02581 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:25.460548 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-1d4fe22a-f2b8-41c7-8e68-1ec486d02581 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:25.461268 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-1d4fe22a-f2b8-41c7-8e68-1ec486d02581 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:25.611005 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-8a7dba70-eb6c-47f6-bf49-d4404760444c tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2e978bcb824a5e9d593b861c9e3bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7573cb9c503243ab90b1649591d550e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:33:25.623667 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-8a7dba70-eb6c-47f6-bf49-d4404760444c tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] 10.222.0.15 "GET /compute/v2.1/servers/d0befdd2-2ecd-4006-bfdd-86d5253a7687" status: 200 len: 1321 microversion: 2.1 time: 0.811385 Oct 31 12:33:25.640178 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 27/45] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:33:24 2022] GET /compute/v2.1/servers/d0befdd2-2ecd-4006-bfdd-86d5253a7687 => generated 1321 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:33:25.646961 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-b92d107c-0a85-479a-a7bf-592b15949c23 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:33:25.647819 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-b92d107c-0a85-479a-a7bf-592b15949c23 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] [instance: 852e8870-b3ec-4a21-a9b5-e31a423ddd3d] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:33:25.653928 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-b92d107c-0a85-479a-a7bf-592b15949c23 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:25.654619 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-b92d107c-0a85-479a-a7bf-592b15949c23 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:25.655225 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-b92d107c-0a85-479a-a7bf-592b15949c23 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:25.656130 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-b92d107c-0a85-479a-a7bf-592b15949c23 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:25.656726 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-b92d107c-0a85-479a-a7bf-592b15949c23 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:25.657277 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-b92d107c-0a85-479a-a7bf-592b15949c23 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:25.703026 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-1d4fe22a-f2b8-41c7-8e68-1ec486d02581 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c03f0365ee4a26b8c076ae365325b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfbc3a46f12942299b99cdd20c989e1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:33:25.714685 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-1d4fe22a-f2b8-41c7-8e68-1ec486d02581 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] 10.222.0.15 "GET /compute/v2.1/servers/9906becc-a42b-4b4c-855a-450915f7a3f8" status: 200 len: 1366 microversion: 2.1 time: 0.270887 Oct 31 12:33:25.731196 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 19/46] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:33:25 2022] GET /compute/v2.1/servers/9906becc-a42b-4b4c-855a-450915f7a3f8 => generated 1366 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:33:25.894183 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-b92d107c-0a85-479a-a7bf-592b15949c23 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:33:25.913033 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-b92d107c-0a85-479a-a7bf-592b15949c23 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:33:25.914473 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-b92d107c-0a85-479a-a7bf-592b15949c23 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:33:25.915622 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-b92d107c-0a85-479a-a7bf-592b15949c23 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] 10.222.0.15 "GET /compute/v2.1/servers/852e8870-b3ec-4a21-a9b5-e31a423ddd3d" status: 200 len: 1340 microversion: 2.20 time: 0.274205 Oct 31 12:33:25.916451 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 28/47] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Oct 31 12:33:25 2022] GET /compute/v2.1/servers/852e8870-b3ec-4a21-a9b5-e31a423ddd3d => generated 1340 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 12:33:25.920859 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-6b06ae3f-2b0c-4c18-8dfb-c1b9a8c3af00 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:33:25.921459 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-6b06ae3f-2b0c-4c18-8dfb-c1b9a8c3af00 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] [instance: 8d254a92-15fa-4d98-8954-a8028647165e] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:33:25.934680 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-6b06ae3f-2b0c-4c18-8dfb-c1b9a8c3af00 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:25.935002 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-6b06ae3f-2b0c-4c18-8dfb-c1b9a8c3af00 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:25.935454 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-6b06ae3f-2b0c-4c18-8dfb-c1b9a8c3af00 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:25.936148 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-6b06ae3f-2b0c-4c18-8dfb-c1b9a8c3af00 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:25.936590 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-6b06ae3f-2b0c-4c18-8dfb-c1b9a8c3af00 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:25.937002 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-6b06ae3f-2b0c-4c18-8dfb-c1b9a8c3af00 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:25.963437 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [req-b5627581-171a-447f-a3a3-dcc11946e53c req-cfe576f8-fa05-4d48-870c-97814d669a2c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d33a2d6b-f17c-4ce3-ad33-9086d790495d", "tag": "a33f2616-bbbf-49fa-87ab-2b1769bc0111"}]} {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 12:33:25.976528 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [req-b5627581-171a-447f-a3a3-dcc11946e53c req-cfe576f8-fa05-4d48-870c-97814d669a2c service nova] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:25.977464 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [req-b5627581-171a-447f-a3a3-dcc11946e53c req-cfe576f8-fa05-4d48-870c-97814d669a2c service nova] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:25.977921 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [req-b5627581-171a-447f-a3a3-dcc11946e53c req-cfe576f8-fa05-4d48-870c-97814d669a2c service nova] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:26.000020 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG dbcounter [-] [125441] Writing DB stats nova_cell1:SELECT=73 {{(pid=125441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:33:26.031332 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.compute.server_external_events [req-b5627581-171a-447f-a3a3-dcc11946e53c req-cfe576f8-fa05-4d48-870c-97814d669a2c service nova] Creating event network-changed:a33f2616-bbbf-49fa-87ab-2b1769bc0111 for instance d33a2d6b-f17c-4ce3-ad33-9086d790495d on hv-cinder-79617 Oct 31 12:33:26.044914 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [req-b5627581-171a-447f-a3a3-dcc11946e53c req-cfe576f8-fa05-4d48-870c-97814d669a2c service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.321532 Oct 31 12:33:26.049617 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 20/48] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Oct 31 12:33:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 12:33:26.470374 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-81af2727-713b-4c2f-9303-35142e9bb03f tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:33:26.472450 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-81af2727-713b-4c2f-9303-35142e9bb03f tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] [instance: ff125cf8-e8a5-4f00-ade9-045b18ee33f4] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:33:26.478527 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-81af2727-713b-4c2f-9303-35142e9bb03f tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:26.479342 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-81af2727-713b-4c2f-9303-35142e9bb03f tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:26.479996 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-81af2727-713b-4c2f-9303-35142e9bb03f tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:26.480927 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-81af2727-713b-4c2f-9303-35142e9bb03f tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:26.481445 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-81af2727-713b-4c2f-9303-35142e9bb03f tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:26.481925 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-81af2727-713b-4c2f-9303-35142e9bb03f tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:26.567047 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-6b06ae3f-2b0c-4c18-8dfb-c1b9a8c3af00 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d59ee6f94848308665a32099cf5255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4d5cd8851dc4216b4e3e035a32decad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:33:26.572218 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG dbcounter [-] [125440] Writing DB stats nova_cell1:SELECT=100 {{(pid=125440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:33:26.580397 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-6b06ae3f-2b0c-4c18-8dfb-c1b9a8c3af00 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] 10.222.0.15 "GET /compute/v2.1/servers/8d254a92-15fa-4d98-8954-a8028647165e" status: 200 len: 1314 microversion: 2.1 time: 0.662833 Oct 31 12:33:26.597442 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 29/49] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:33:25 2022] GET /compute/v2.1/servers/8d254a92-15fa-4d98-8954-a8028647165e => generated 1314 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:33:26.649921 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-846ccb18-2519-44dc-9103-4a7db5481c83 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:33:26.650538 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-846ccb18-2519-44dc-9103-4a7db5481c83 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] [instance: d0befdd2-2ecd-4006-bfdd-86d5253a7687] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:33:26.689669 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-846ccb18-2519-44dc-9103-4a7db5481c83 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:26.690477 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-846ccb18-2519-44dc-9103-4a7db5481c83 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:26.693965 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-81af2727-713b-4c2f-9303-35142e9bb03f tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c1beb321e44908ab987b17f7b74484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a2bf9a5a484523a700e4e6c568d4de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:33:26.702075 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-81af2727-713b-4c2f-9303-35142e9bb03f tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] 10.222.0.15 "GET /compute/v2.1/servers/ff125cf8-e8a5-4f00-ade9-045b18ee33f4" status: 200 len: 1364 microversion: 2.1 time: 0.235805 Oct 31 12:33:26.702923 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-846ccb18-2519-44dc-9103-4a7db5481c83 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:26.703774 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-846ccb18-2519-44dc-9103-4a7db5481c83 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:26.704722 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-846ccb18-2519-44dc-9103-4a7db5481c83 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:26.705086 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 21/50] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:33:26 2022] GET /compute/v2.1/servers/ff125cf8-e8a5-4f00-ade9-045b18ee33f4 => generated 1364 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 12:33:26.705588 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-846ccb18-2519-44dc-9103-4a7db5481c83 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:26.745460 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-139fa180-79c0-45fd-9fce-eafa9cbcf3e5 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:33:26.746449 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-139fa180-79c0-45fd-9fce-eafa9cbcf3e5 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] [instance: 9906becc-a42b-4b4c-855a-450915f7a3f8] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:33:26.753911 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-139fa180-79c0-45fd-9fce-eafa9cbcf3e5 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:26.754664 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-139fa180-79c0-45fd-9fce-eafa9cbcf3e5 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:26.755188 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-139fa180-79c0-45fd-9fce-eafa9cbcf3e5 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:26.756055 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-139fa180-79c0-45fd-9fce-eafa9cbcf3e5 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:26.756658 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-139fa180-79c0-45fd-9fce-eafa9cbcf3e5 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:26.757227 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-139fa180-79c0-45fd-9fce-eafa9cbcf3e5 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:26.928058 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-139fa180-79c0-45fd-9fce-eafa9cbcf3e5 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c03f0365ee4a26b8c076ae365325b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfbc3a46f12942299b99cdd20c989e1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:33:26.936411 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-139fa180-79c0-45fd-9fce-eafa9cbcf3e5 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] 10.222.0.15 "GET /compute/v2.1/servers/9906becc-a42b-4b4c-855a-450915f7a3f8" status: 200 len: 1366 microversion: 2.1 time: 0.195864 Oct 31 12:33:26.936999 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 22/51] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:33:26 2022] GET /compute/v2.1/servers/9906becc-a42b-4b4c-855a-450915f7a3f8 => generated 1366 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 12:33:26.944985 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-43f8a278-1240-4e67-a589-d29c1560d6b6 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:33:26.945583 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-43f8a278-1240-4e67-a589-d29c1560d6b6 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] [instance: 852e8870-b3ec-4a21-a9b5-e31a423ddd3d] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:33:26.965102 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-43f8a278-1240-4e67-a589-d29c1560d6b6 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:26.965588 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-43f8a278-1240-4e67-a589-d29c1560d6b6 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:26.966046 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-43f8a278-1240-4e67-a589-d29c1560d6b6 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:26.966751 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-43f8a278-1240-4e67-a589-d29c1560d6b6 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:26.967221 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-43f8a278-1240-4e67-a589-d29c1560d6b6 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:26.967640 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-43f8a278-1240-4e67-a589-d29c1560d6b6 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:27.161009 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-43f8a278-1240-4e67-a589-d29c1560d6b6 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:33:27.169275 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-43f8a278-1240-4e67-a589-d29c1560d6b6 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:33:27.171237 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-43f8a278-1240-4e67-a589-d29c1560d6b6 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:33:27.172620 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-43f8a278-1240-4e67-a589-d29c1560d6b6 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] 10.222.0.15 "GET /compute/v2.1/servers/852e8870-b3ec-4a21-a9b5-e31a423ddd3d" status: 200 len: 1408 microversion: 2.20 time: 0.231406 Oct 31 12:33:27.188229 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 23/52] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Oct 31 12:33:26 2022] GET /compute/v2.1/servers/852e8870-b3ec-4a21-a9b5-e31a423ddd3d => generated 1408 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 12:33:27.345899 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-846ccb18-2519-44dc-9103-4a7db5481c83 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2e978bcb824a5e9d593b861c9e3bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7573cb9c503243ab90b1649591d550e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:33:27.379067 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-846ccb18-2519-44dc-9103-4a7db5481c83 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] 10.222.0.15 "GET /compute/v2.1/servers/d0befdd2-2ecd-4006-bfdd-86d5253a7687" status: 200 len: 1321 microversion: 2.1 time: 0.736369 Oct 31 12:33:27.399199 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 30/53] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:33:26 2022] GET /compute/v2.1/servers/d0befdd2-2ecd-4006-bfdd-86d5253a7687 => generated 1321 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:33:27.589353 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [req-28838c7b-775d-45cf-b454-f2ab88d3b114 req-12b2ae54-e616-4ea1-8e5d-faaeb8069008 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d0befdd2-2ecd-4006-bfdd-86d5253a7687", "tag": "8ae8e564-b3aa-4e58-8d16-d182b80edabc"}]} {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 12:33:27.613784 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-e4b14be0-d812-4e87-86b9-8734e729e0bb tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:33:27.618542 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-e4b14be0-d812-4e87-86b9-8734e729e0bb tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] [instance: 8d254a92-15fa-4d98-8954-a8028647165e] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:33:27.628516 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-e4b14be0-d812-4e87-86b9-8734e729e0bb tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:27.629703 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-e4b14be0-d812-4e87-86b9-8734e729e0bb tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:27.630513 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-e4b14be0-d812-4e87-86b9-8734e729e0bb tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:27.631725 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-e4b14be0-d812-4e87-86b9-8734e729e0bb tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:27.632310 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [req-28838c7b-775d-45cf-b454-f2ab88d3b114 req-12b2ae54-e616-4ea1-8e5d-faaeb8069008 service nova] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:27.632668 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-e4b14be0-d812-4e87-86b9-8734e729e0bb tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:27.632787 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [req-28838c7b-775d-45cf-b454-f2ab88d3b114 req-12b2ae54-e616-4ea1-8e5d-faaeb8069008 service nova] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:27.633397 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-e4b14be0-d812-4e87-86b9-8734e729e0bb tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:27.635471 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [req-28838c7b-775d-45cf-b454-f2ab88d3b114 req-12b2ae54-e616-4ea1-8e5d-faaeb8069008 service nova] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:27.661440 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.compute.server_external_events [req-28838c7b-775d-45cf-b454-f2ab88d3b114 req-12b2ae54-e616-4ea1-8e5d-faaeb8069008 service nova] Creating event network-changed:8ae8e564-b3aa-4e58-8d16-d182b80edabc for instance d0befdd2-2ecd-4006-bfdd-86d5253a7687 on hv-cinder-79617 Oct 31 12:33:27.673058 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [req-28838c7b-775d-45cf-b454-f2ab88d3b114 req-12b2ae54-e616-4ea1-8e5d-faaeb8069008 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089168 Oct 31 12:33:27.677424 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 24/54] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Oct 31 12:33:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 12:33:27.726224 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-9309d07d-6cf7-495a-993b-198f049e6093 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:33:27.726906 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-9309d07d-6cf7-495a-993b-198f049e6093 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] [instance: ff125cf8-e8a5-4f00-ade9-045b18ee33f4] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:33:27.740494 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-9309d07d-6cf7-495a-993b-198f049e6093 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:27.741186 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-9309d07d-6cf7-495a-993b-198f049e6093 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:27.741778 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-9309d07d-6cf7-495a-993b-198f049e6093 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:27.745441 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-9309d07d-6cf7-495a-993b-198f049e6093 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:27.746102 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-9309d07d-6cf7-495a-993b-198f049e6093 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:27.747359 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-9309d07d-6cf7-495a-993b-198f049e6093 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:28.036865 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-9309d07d-6cf7-495a-993b-198f049e6093 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c1beb321e44908ab987b17f7b74484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a2bf9a5a484523a700e4e6c568d4de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:33:28.045797 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-9309d07d-6cf7-495a-993b-198f049e6093 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] 10.222.0.15 "GET /compute/v2.1/servers/ff125cf8-e8a5-4f00-ade9-045b18ee33f4" status: 200 len: 1364 microversion: 2.1 time: 0.322975 Oct 31 12:33:28.047045 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 25/55] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:33:27 2022] GET /compute/v2.1/servers/ff125cf8-e8a5-4f00-ade9-045b18ee33f4 => generated 1364 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 12:33:28.052833 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-62b15021-e594-4db3-b47f-8cc55e05b8fd tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:33:28.053773 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-62b15021-e594-4db3-b47f-8cc55e05b8fd tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] [instance: 9906becc-a42b-4b4c-855a-450915f7a3f8] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:33:28.073379 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG dbcounter [-] [125441] Writing DB stats nova_cell0:SELECT=28 {{(pid=125441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:33:28.075217 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-62b15021-e594-4db3-b47f-8cc55e05b8fd tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:28.076281 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-62b15021-e594-4db3-b47f-8cc55e05b8fd tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:28.077153 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-62b15021-e594-4db3-b47f-8cc55e05b8fd tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:28.082599 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-62b15021-e594-4db3-b47f-8cc55e05b8fd tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:28.083672 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-62b15021-e594-4db3-b47f-8cc55e05b8fd tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:28.083968 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-62b15021-e594-4db3-b47f-8cc55e05b8fd tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:28.138259 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-e4b14be0-d812-4e87-86b9-8734e729e0bb tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d59ee6f94848308665a32099cf5255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4d5cd8851dc4216b4e3e035a32decad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:33:28.152044 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-e4b14be0-d812-4e87-86b9-8734e729e0bb tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] 10.222.0.15 "GET /compute/v2.1/servers/8d254a92-15fa-4d98-8954-a8028647165e" status: 200 len: 1314 microversion: 2.1 time: 0.548948 Oct 31 12:33:28.153420 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 31/56] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:33:27 2022] GET /compute/v2.1/servers/8d254a92-15fa-4d98-8954-a8028647165e => generated 1314 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:33:28.162485 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [req-114b4271-e849-4b22-b7d2-18134f718e20 req-a216716e-b32e-45ce-b7bf-ecef40bdd4fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff125cf8-e8a5-4f00-ade9-045b18ee33f4", "tag": "f9ca4955-7ad3-407e-b90d-7bad757cb1d8"}]} {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 12:33:28.189049 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [req-114b4271-e849-4b22-b7d2-18134f718e20 req-a216716e-b32e-45ce-b7bf-ecef40bdd4fd service nova] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:28.190575 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [req-114b4271-e849-4b22-b7d2-18134f718e20 req-a216716e-b32e-45ce-b7bf-ecef40bdd4fd service nova] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:28.191369 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [req-114b4271-e849-4b22-b7d2-18134f718e20 req-a216716e-b32e-45ce-b7bf-ecef40bdd4fd service nova] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:28.220453 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.compute.server_external_events [req-114b4271-e849-4b22-b7d2-18134f718e20 req-a216716e-b32e-45ce-b7bf-ecef40bdd4fd service nova] Creating event network-changed:f9ca4955-7ad3-407e-b90d-7bad757cb1d8 for instance ff125cf8-e8a5-4f00-ade9-045b18ee33f4 on hv-cinder-79617 Oct 31 12:33:28.221612 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [req-114b4271-e849-4b22-b7d2-18134f718e20 req-a216716e-b32e-45ce-b7bf-ecef40bdd4fd service nova] Acquiring lock "compute-rpcapi-router" {{(pid=125440) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 31 12:33:28.222625 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [req-114b4271-e849-4b22-b7d2-18134f718e20 req-a216716e-b32e-45ce-b7bf-ecef40bdd4fd service nova] Acquired lock "compute-rpcapi-router" {{(pid=125440) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 31 12:33:28.223881 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-c206435a-134f-4f7d-a261-296e34586708 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:28.224414 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-c206435a-134f-4f7d-a261-296e34586708 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:28.225276 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-c206435a-134f-4f7d-a261-296e34586708 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:28.226090 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-c206435a-134f-4f7d-a261-296e34586708 None None] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:28.226730 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-c206435a-134f-4f7d-a261-296e34586708 None None] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:28.227321 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-c206435a-134f-4f7d-a261-296e34586708 None None] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:28.240373 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.compute.rpcapi [None req-c206435a-134f-4f7d-a261-296e34586708 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 31 12:33:28.241373 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-c206435a-134f-4f7d-a261-296e34586708 None None] Releasing lock "compute-rpcapi-router" {{(pid=125440) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 31 12:33:28.265290 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-c206435a-134f-4f7d-a261-296e34586708 None None] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109920 Oct 31 12:33:28.266515 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 32/57] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Oct 31 12:33:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 12:33:28.285466 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-20e0e906-42d3-41e6-b266-b59e77dc2fd7 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:33:28.286335 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-20e0e906-42d3-41e6-b266-b59e77dc2fd7 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] [instance: 852e8870-b3ec-4a21-a9b5-e31a423ddd3d] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:33:28.294730 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-20e0e906-42d3-41e6-b266-b59e77dc2fd7 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:28.295494 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-20e0e906-42d3-41e6-b266-b59e77dc2fd7 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:28.295991 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-20e0e906-42d3-41e6-b266-b59e77dc2fd7 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:28.296699 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-20e0e906-42d3-41e6-b266-b59e77dc2fd7 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:28.297156 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-20e0e906-42d3-41e6-b266-b59e77dc2fd7 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:28.297572 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-20e0e906-42d3-41e6-b266-b59e77dc2fd7 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:28.309284 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-62b15021-e594-4db3-b47f-8cc55e05b8fd tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c03f0365ee4a26b8c076ae365325b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfbc3a46f12942299b99cdd20c989e1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:33:28.322684 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-62b15021-e594-4db3-b47f-8cc55e05b8fd tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] 10.222.0.15 "GET /compute/v2.1/servers/9906becc-a42b-4b4c-855a-450915f7a3f8" status: 200 len: 1366 microversion: 2.1 time: 0.274041 Oct 31 12:33:28.324610 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 26/58] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:33:28 2022] GET /compute/v2.1/servers/9906becc-a42b-4b4c-855a-450915f7a3f8 => generated 1366 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:33:28.410920 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-ad9b8058-a141-4ab6-a758-abca46b20169 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:33:28.411705 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-ad9b8058-a141-4ab6-a758-abca46b20169 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] [instance: d0befdd2-2ecd-4006-bfdd-86d5253a7687] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:33:28.418714 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-ad9b8058-a141-4ab6-a758-abca46b20169 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:28.419323 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-ad9b8058-a141-4ab6-a758-abca46b20169 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:28.419966 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-ad9b8058-a141-4ab6-a758-abca46b20169 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:28.421120 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-ad9b8058-a141-4ab6-a758-abca46b20169 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:28.422101 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-ad9b8058-a141-4ab6-a758-abca46b20169 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:28.422984 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-ad9b8058-a141-4ab6-a758-abca46b20169 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:28.579266 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-ad9b8058-a141-4ab6-a758-abca46b20169 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2e978bcb824a5e9d593b861c9e3bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7573cb9c503243ab90b1649591d550e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:33:28.589875 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-ad9b8058-a141-4ab6-a758-abca46b20169 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] 10.222.0.15 "GET /compute/v2.1/servers/d0befdd2-2ecd-4006-bfdd-86d5253a7687" status: 200 len: 1321 microversion: 2.1 time: 0.183394 Oct 31 12:33:28.607401 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-20e0e906-42d3-41e6-b266-b59e77dc2fd7 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:33:28.607401 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-20e0e906-42d3-41e6-b266-b59e77dc2fd7 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:33:28.608373 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-20e0e906-42d3-41e6-b266-b59e77dc2fd7 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:33:28.608373 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-20e0e906-42d3-41e6-b266-b59e77dc2fd7 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] 10.222.0.15 "GET /compute/v2.1/servers/852e8870-b3ec-4a21-a9b5-e31a423ddd3d" status: 200 len: 1408 microversion: 2.20 time: 0.336406 Oct 31 12:33:28.608373 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 33/59] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Oct 31 12:33:28 2022] GET /compute/v2.1/servers/852e8870-b3ec-4a21-a9b5-e31a423ddd3d => generated 1408 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 12:33:28.609683 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 27/60] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:33:28 2022] GET /compute/v2.1/servers/d0befdd2-2ecd-4006-bfdd-86d5253a7687 => generated 1321 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 12:33:29.069787 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-d3d6b092-ca56-4107-8741-24810af6db77 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:33:29.070744 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-d3d6b092-ca56-4107-8741-24810af6db77 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] [instance: ff125cf8-e8a5-4f00-ade9-045b18ee33f4] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:33:29.086350 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-d3d6b092-ca56-4107-8741-24810af6db77 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:29.087131 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-d3d6b092-ca56-4107-8741-24810af6db77 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:29.087762 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-d3d6b092-ca56-4107-8741-24810af6db77 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:29.089855 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-d3d6b092-ca56-4107-8741-24810af6db77 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:29.090333 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-d3d6b092-ca56-4107-8741-24810af6db77 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:29.090850 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-d3d6b092-ca56-4107-8741-24810af6db77 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:29.181776 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-b45c2c52-b0a5-4376-b04d-8cf9a1dd4109 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:33:29.182641 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-b45c2c52-b0a5-4376-b04d-8cf9a1dd4109 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] [instance: 8d254a92-15fa-4d98-8954-a8028647165e] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:33:29.191148 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-b45c2c52-b0a5-4376-b04d-8cf9a1dd4109 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:29.191877 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-b45c2c52-b0a5-4376-b04d-8cf9a1dd4109 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:29.192962 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-b45c2c52-b0a5-4376-b04d-8cf9a1dd4109 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:29.193737 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-b45c2c52-b0a5-4376-b04d-8cf9a1dd4109 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:29.194190 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-b45c2c52-b0a5-4376-b04d-8cf9a1dd4109 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:29.194608 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-b45c2c52-b0a5-4376-b04d-8cf9a1dd4109 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:29.255562 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-d3d6b092-ca56-4107-8741-24810af6db77 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c1beb321e44908ab987b17f7b74484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a2bf9a5a484523a700e4e6c568d4de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:33:29.267300 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-d3d6b092-ca56-4107-8741-24810af6db77 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] 10.222.0.15 "GET /compute/v2.1/servers/ff125cf8-e8a5-4f00-ade9-045b18ee33f4" status: 200 len: 1364 microversion: 2.1 time: 0.202430 Oct 31 12:33:29.269699 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 34/61] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:33:29 2022] GET /compute/v2.1/servers/ff125cf8-e8a5-4f00-ade9-045b18ee33f4 => generated 1364 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:33:29.346673 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-4ac15ab7-94f6-4a37-be24-4e94796654fc tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:33:29.347257 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-4ac15ab7-94f6-4a37-be24-4e94796654fc tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] [instance: 9906becc-a42b-4b4c-855a-450915f7a3f8] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:33:29.356408 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-b45c2c52-b0a5-4376-b04d-8cf9a1dd4109 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d59ee6f94848308665a32099cf5255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4d5cd8851dc4216b4e3e035a32decad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:33:29.357219 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-4ac15ab7-94f6-4a37-be24-4e94796654fc tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:29.357706 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-4ac15ab7-94f6-4a37-be24-4e94796654fc tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:29.358192 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-4ac15ab7-94f6-4a37-be24-4e94796654fc tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:29.358889 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-4ac15ab7-94f6-4a37-be24-4e94796654fc tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:29.359723 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-4ac15ab7-94f6-4a37-be24-4e94796654fc tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:29.360381 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-4ac15ab7-94f6-4a37-be24-4e94796654fc tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:29.368512 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-b45c2c52-b0a5-4376-b04d-8cf9a1dd4109 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] 10.222.0.15 "GET /compute/v2.1/servers/8d254a92-15fa-4d98-8954-a8028647165e" status: 200 len: 1314 microversion: 2.1 time: 0.190472 Oct 31 12:33:29.369388 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 28/62] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:33:29 2022] GET /compute/v2.1/servers/8d254a92-15fa-4d98-8954-a8028647165e => generated 1314 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 12:33:29.527534 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-4ac15ab7-94f6-4a37-be24-4e94796654fc tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c03f0365ee4a26b8c076ae365325b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfbc3a46f12942299b99cdd20c989e1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:33:29.539334 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-4ac15ab7-94f6-4a37-be24-4e94796654fc tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] 10.222.0.15 "GET /compute/v2.1/servers/9906becc-a42b-4b4c-855a-450915f7a3f8" status: 200 len: 1366 microversion: 2.1 time: 0.197258 Oct 31 12:33:29.555465 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 35/63] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:33:29 2022] GET /compute/v2.1/servers/9906becc-a42b-4b4c-855a-450915f7a3f8 => generated 1366 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 12:33:29.617107 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-15c84725-3d63-49df-8d16-4388517b41b0 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:33:29.617733 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-15c84725-3d63-49df-8d16-4388517b41b0 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] [instance: d0befdd2-2ecd-4006-bfdd-86d5253a7687] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:33:29.623828 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-15c84725-3d63-49df-8d16-4388517b41b0 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:29.624401 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-15c84725-3d63-49df-8d16-4388517b41b0 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:29.625007 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-15c84725-3d63-49df-8d16-4388517b41b0 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:29.625744 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-15c84725-3d63-49df-8d16-4388517b41b0 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:29.626374 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-15c84725-3d63-49df-8d16-4388517b41b0 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:29.626779 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-15c84725-3d63-49df-8d16-4388517b41b0 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:29.632619 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-48bb2a49-5422-4786-b473-db3e6d21a00d tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:33:29.633229 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-48bb2a49-5422-4786-b473-db3e6d21a00d tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] [instance: 852e8870-b3ec-4a21-a9b5-e31a423ddd3d] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:33:29.640935 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-48bb2a49-5422-4786-b473-db3e6d21a00d tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:29.641704 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-48bb2a49-5422-4786-b473-db3e6d21a00d tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:29.642559 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-48bb2a49-5422-4786-b473-db3e6d21a00d tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:29.644198 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-48bb2a49-5422-4786-b473-db3e6d21a00d tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:29.644914 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-48bb2a49-5422-4786-b473-db3e6d21a00d tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:29.645808 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-48bb2a49-5422-4786-b473-db3e6d21a00d tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:29.786225 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-15c84725-3d63-49df-8d16-4388517b41b0 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2e978bcb824a5e9d593b861c9e3bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7573cb9c503243ab90b1649591d550e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:33:29.795862 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-15c84725-3d63-49df-8d16-4388517b41b0 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] 10.222.0.15 "GET /compute/v2.1/servers/d0befdd2-2ecd-4006-bfdd-86d5253a7687" status: 200 len: 1321 microversion: 2.1 time: 0.182646 Oct 31 12:33:29.796977 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 29/64] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:33:29 2022] GET /compute/v2.1/servers/d0befdd2-2ecd-4006-bfdd-86d5253a7687 => generated 1321 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 12:33:29.819725 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [req-c7be98c9-3964-4ec9-87e3-7c3c5e8a4b3b req-bb7941ff-cd80-4a47-9840-d020c91f30fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9906becc-a42b-4b4c-855a-450915f7a3f8", "tag": "ffe46aaf-72a4-4c15-9506-ca33161dddf3"}, {"name": "network-changed", "server_uuid": "852e8870-b3ec-4a21-a9b5-e31a423ddd3d", "tag": "dffec82d-007b-4838-9898-19da61885395"}]} {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 12:33:29.831774 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [req-c7be98c9-3964-4ec9-87e3-7c3c5e8a4b3b req-bb7941ff-cd80-4a47-9840-d020c91f30fa service nova] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:29.832603 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-48bb2a49-5422-4786-b473-db3e6d21a00d tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:33:29.833259 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [req-c7be98c9-3964-4ec9-87e3-7c3c5e8a4b3b req-bb7941ff-cd80-4a47-9840-d020c91f30fa service nova] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:29.833808 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [req-c7be98c9-3964-4ec9-87e3-7c3c5e8a4b3b req-bb7941ff-cd80-4a47-9840-d020c91f30fa service nova] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:29.842615 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-48bb2a49-5422-4786-b473-db3e6d21a00d tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:33:29.844889 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-48bb2a49-5422-4786-b473-db3e6d21a00d tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:33:29.846284 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-48bb2a49-5422-4786-b473-db3e6d21a00d tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] 10.222.0.15 "GET /compute/v2.1/servers/852e8870-b3ec-4a21-a9b5-e31a423ddd3d" status: 200 len: 1408 microversion: 2.20 time: 0.219942 Oct 31 12:33:29.847007 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 36/65] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Oct 31 12:33:29 2022] GET /compute/v2.1/servers/852e8870-b3ec-4a21-a9b5-e31a423ddd3d => generated 1408 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 12:33:29.847479 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.compute.server_external_events [req-c7be98c9-3964-4ec9-87e3-7c3c5e8a4b3b req-bb7941ff-cd80-4a47-9840-d020c91f30fa service nova] Creating event network-changed:ffe46aaf-72a4-4c15-9506-ca33161dddf3 for instance 9906becc-a42b-4b4c-855a-450915f7a3f8 on hv-cinder-79617 Oct 31 12:33:29.847986 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.compute.server_external_events [req-c7be98c9-3964-4ec9-87e3-7c3c5e8a4b3b req-bb7941ff-cd80-4a47-9840-d020c91f30fa service nova] Creating event network-changed:dffec82d-007b-4838-9898-19da61885395 for instance 852e8870-b3ec-4a21-a9b5-e31a423ddd3d on hv-cinder-79617 Oct 31 12:33:29.854402 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [req-c7be98c9-3964-4ec9-87e3-7c3c5e8a4b3b req-bb7941ff-cd80-4a47-9840-d020c91f30fa service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.045080 Oct 31 12:33:29.855032 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 30/66] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Oct 31 12:33:29 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 12:33:30.294917 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-776e1c7c-468c-4bd9-bee9-f41f772908df tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:33:30.295883 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-776e1c7c-468c-4bd9-bee9-f41f772908df tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] [instance: ff125cf8-e8a5-4f00-ade9-045b18ee33f4] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:33:30.301707 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-776e1c7c-468c-4bd9-bee9-f41f772908df tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:30.302178 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-776e1c7c-468c-4bd9-bee9-f41f772908df tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:30.302599 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-776e1c7c-468c-4bd9-bee9-f41f772908df tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:30.303308 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-776e1c7c-468c-4bd9-bee9-f41f772908df tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:30.303759 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-776e1c7c-468c-4bd9-bee9-f41f772908df tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:30.304174 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-776e1c7c-468c-4bd9-bee9-f41f772908df tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:30.401449 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-a7218d69-0926-4d4d-9cb2-60316d0636be tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:33:30.402150 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-a7218d69-0926-4d4d-9cb2-60316d0636be tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] [instance: 8d254a92-15fa-4d98-8954-a8028647165e] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:33:30.408941 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-a7218d69-0926-4d4d-9cb2-60316d0636be tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:30.409569 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-a7218d69-0926-4d4d-9cb2-60316d0636be tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:30.410002 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-a7218d69-0926-4d4d-9cb2-60316d0636be tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:30.410699 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-a7218d69-0926-4d4d-9cb2-60316d0636be tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:30.411148 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-a7218d69-0926-4d4d-9cb2-60316d0636be tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:30.411592 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-a7218d69-0926-4d4d-9cb2-60316d0636be tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:30.467296 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-776e1c7c-468c-4bd9-bee9-f41f772908df tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c1beb321e44908ab987b17f7b74484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a2bf9a5a484523a700e4e6c568d4de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:33:30.476167 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-776e1c7c-468c-4bd9-bee9-f41f772908df tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] 10.222.0.15 "GET /compute/v2.1/servers/ff125cf8-e8a5-4f00-ade9-045b18ee33f4" status: 200 len: 1364 microversion: 2.1 time: 0.185050 Oct 31 12:33:30.476876 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 37/67] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:33:30 2022] GET /compute/v2.1/servers/ff125cf8-e8a5-4f00-ade9-045b18ee33f4 => generated 1364 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:33:30.557724 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-a7218d69-0926-4d4d-9cb2-60316d0636be tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d59ee6f94848308665a32099cf5255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4d5cd8851dc4216b4e3e035a32decad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:33:30.564005 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-d15b7076-b07c-40c1-8b42-94f14879da18 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:33:30.564609 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-d15b7076-b07c-40c1-8b42-94f14879da18 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] [instance: 9906becc-a42b-4b4c-855a-450915f7a3f8] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:33:30.566042 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-a7218d69-0926-4d4d-9cb2-60316d0636be tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] 10.222.0.15 "GET /compute/v2.1/servers/8d254a92-15fa-4d98-8954-a8028647165e" status: 200 len: 1314 microversion: 2.1 time: 0.168765 Oct 31 12:33:30.566662 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 31/68] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:33:30 2022] GET /compute/v2.1/servers/8d254a92-15fa-4d98-8954-a8028647165e => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 12:33:30.571649 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-d15b7076-b07c-40c1-8b42-94f14879da18 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:30.572129 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-d15b7076-b07c-40c1-8b42-94f14879da18 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:30.572559 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-d15b7076-b07c-40c1-8b42-94f14879da18 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:30.573247 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-d15b7076-b07c-40c1-8b42-94f14879da18 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:30.573699 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-d15b7076-b07c-40c1-8b42-94f14879da18 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:30.574116 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-d15b7076-b07c-40c1-8b42-94f14879da18 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:30.708279 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-d15b7076-b07c-40c1-8b42-94f14879da18 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c03f0365ee4a26b8c076ae365325b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfbc3a46f12942299b99cdd20c989e1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:33:30.716993 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-d15b7076-b07c-40c1-8b42-94f14879da18 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] 10.222.0.15 "GET /compute/v2.1/servers/9906becc-a42b-4b4c-855a-450915f7a3f8" status: 200 len: 1366 microversion: 2.1 time: 0.157783 Oct 31 12:33:30.717655 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 38/69] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:33:30 2022] GET /compute/v2.1/servers/9906becc-a42b-4b4c-855a-450915f7a3f8 => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:33:30.821765 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-83693755-279e-46ff-b467-84efbe751048 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:33:30.822497 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-83693755-279e-46ff-b467-84efbe751048 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] [instance: d0befdd2-2ecd-4006-bfdd-86d5253a7687] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:33:30.828311 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-83693755-279e-46ff-b467-84efbe751048 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:30.828787 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-83693755-279e-46ff-b467-84efbe751048 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:30.829216 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-83693755-279e-46ff-b467-84efbe751048 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:30.829886 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-83693755-279e-46ff-b467-84efbe751048 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:30.830376 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-83693755-279e-46ff-b467-84efbe751048 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:30.830792 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-83693755-279e-46ff-b467-84efbe751048 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:30.871937 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-76fff8a8-4496-4357-9acb-70fda87179ee tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:33:30.872536 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-76fff8a8-4496-4357-9acb-70fda87179ee tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] [instance: 852e8870-b3ec-4a21-a9b5-e31a423ddd3d] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:33:30.879072 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-76fff8a8-4496-4357-9acb-70fda87179ee tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:30.879591 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-76fff8a8-4496-4357-9acb-70fda87179ee tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:30.880004 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-76fff8a8-4496-4357-9acb-70fda87179ee tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:30.880684 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-76fff8a8-4496-4357-9acb-70fda87179ee tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:30.881128 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-76fff8a8-4496-4357-9acb-70fda87179ee tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:30.881536 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-76fff8a8-4496-4357-9acb-70fda87179ee tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:30.970795 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-83693755-279e-46ff-b467-84efbe751048 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2e978bcb824a5e9d593b861c9e3bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7573cb9c503243ab90b1649591d550e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:33:30.980436 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-83693755-279e-46ff-b467-84efbe751048 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] 10.222.0.15 "GET /compute/v2.1/servers/d0befdd2-2ecd-4006-bfdd-86d5253a7687" status: 200 len: 1321 microversion: 2.1 time: 0.162349 Oct 31 12:33:30.981306 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 32/70] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:33:30 2022] GET /compute/v2.1/servers/d0befdd2-2ecd-4006-bfdd-86d5253a7687 => generated 1321 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:33:31.025470 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-76fff8a8-4496-4357-9acb-70fda87179ee tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:33:31.039472 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-76fff8a8-4496-4357-9acb-70fda87179ee tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:33:31.039472 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-76fff8a8-4496-4357-9acb-70fda87179ee tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:33:31.039659 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-76fff8a8-4496-4357-9acb-70fda87179ee tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] 10.222.0.15 "GET /compute/v2.1/servers/852e8870-b3ec-4a21-a9b5-e31a423ddd3d" status: 200 len: 1408 microversion: 2.20 time: 0.172153 Oct 31 12:33:31.040182 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 39/71] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Oct 31 12:33:30 2022] GET /compute/v2.1/servers/852e8870-b3ec-4a21-a9b5-e31a423ddd3d => generated 1408 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 12:33:31.499134 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-d8da3153-1da6-4c83-bd56-43b7ea2038d6 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:33:31.499768 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-d8da3153-1da6-4c83-bd56-43b7ea2038d6 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] [instance: ff125cf8-e8a5-4f00-ade9-045b18ee33f4] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:33:31.506390 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-d8da3153-1da6-4c83-bd56-43b7ea2038d6 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:31.506865 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-d8da3153-1da6-4c83-bd56-43b7ea2038d6 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:31.507321 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-d8da3153-1da6-4c83-bd56-43b7ea2038d6 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:31.508002 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-d8da3153-1da6-4c83-bd56-43b7ea2038d6 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:31.508451 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-d8da3153-1da6-4c83-bd56-43b7ea2038d6 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:31.508867 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-d8da3153-1da6-4c83-bd56-43b7ea2038d6 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:31.591422 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-e43e9189-8765-4240-b0c8-a75470e06474 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:33:31.592504 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-e43e9189-8765-4240-b0c8-a75470e06474 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] [instance: 8d254a92-15fa-4d98-8954-a8028647165e] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:33:31.598431 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-e43e9189-8765-4240-b0c8-a75470e06474 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:31.599217 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-e43e9189-8765-4240-b0c8-a75470e06474 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:31.599920 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-e43e9189-8765-4240-b0c8-a75470e06474 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:31.600853 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-e43e9189-8765-4240-b0c8-a75470e06474 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:31.601536 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-e43e9189-8765-4240-b0c8-a75470e06474 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:31.602126 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-e43e9189-8765-4240-b0c8-a75470e06474 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:31.659452 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-d8da3153-1da6-4c83-bd56-43b7ea2038d6 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c1beb321e44908ab987b17f7b74484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a2bf9a5a484523a700e4e6c568d4de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:33:31.667135 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-d8da3153-1da6-4c83-bd56-43b7ea2038d6 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] 10.222.0.15 "GET /compute/v2.1/servers/ff125cf8-e8a5-4f00-ade9-045b18ee33f4" status: 200 len: 1364 microversion: 2.1 time: 0.171802 Oct 31 12:33:31.667892 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 33/72] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:33:31 2022] GET /compute/v2.1/servers/ff125cf8-e8a5-4f00-ade9-045b18ee33f4 => generated 1364 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:33:31.742731 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-e43e9189-8765-4240-b0c8-a75470e06474 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d59ee6f94848308665a32099cf5255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4d5cd8851dc4216b4e3e035a32decad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:33:31.744904 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-ac07faf7-8fd1-4e84-bd3d-8692a055ac3f tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:33:31.745750 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-ac07faf7-8fd1-4e84-bd3d-8692a055ac3f tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] [instance: 9906becc-a42b-4b4c-855a-450915f7a3f8] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:33:31.751936 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-e43e9189-8765-4240-b0c8-a75470e06474 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] 10.222.0.15 "GET /compute/v2.1/servers/8d254a92-15fa-4d98-8954-a8028647165e" status: 200 len: 1314 microversion: 2.1 time: 0.164164 Oct 31 12:33:31.753860 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-ac07faf7-8fd1-4e84-bd3d-8692a055ac3f tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:31.754345 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-ac07faf7-8fd1-4e84-bd3d-8692a055ac3f tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:31.754780 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-ac07faf7-8fd1-4e84-bd3d-8692a055ac3f tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:31.755506 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-ac07faf7-8fd1-4e84-bd3d-8692a055ac3f tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:31.755959 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-ac07faf7-8fd1-4e84-bd3d-8692a055ac3f tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:31.756381 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-ac07faf7-8fd1-4e84-bd3d-8692a055ac3f tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:31.762586 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 40/73] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:33:31 2022] GET /compute/v2.1/servers/8d254a92-15fa-4d98-8954-a8028647165e => generated 1314 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 12:33:31.888755 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-ac07faf7-8fd1-4e84-bd3d-8692a055ac3f tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c03f0365ee4a26b8c076ae365325b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfbc3a46f12942299b99cdd20c989e1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:33:31.896807 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-ac07faf7-8fd1-4e84-bd3d-8692a055ac3f tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] 10.222.0.15 "GET /compute/v2.1/servers/9906becc-a42b-4b4c-855a-450915f7a3f8" status: 200 len: 1366 microversion: 2.1 time: 0.155743 Oct 31 12:33:31.897377 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 34/74] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:33:31 2022] GET /compute/v2.1/servers/9906becc-a42b-4b4c-855a-450915f7a3f8 => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 12:33:32.004197 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-d40a02d2-8d94-4875-9125-ea493ff0c321 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:33:32.004831 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-d40a02d2-8d94-4875-9125-ea493ff0c321 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] [instance: d0befdd2-2ecd-4006-bfdd-86d5253a7687] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:33:32.010754 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-d40a02d2-8d94-4875-9125-ea493ff0c321 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:32.011257 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-d40a02d2-8d94-4875-9125-ea493ff0c321 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:32.011688 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-d40a02d2-8d94-4875-9125-ea493ff0c321 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:32.012364 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-d40a02d2-8d94-4875-9125-ea493ff0c321 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:32.012814 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-d40a02d2-8d94-4875-9125-ea493ff0c321 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:32.013230 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-d40a02d2-8d94-4875-9125-ea493ff0c321 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:32.066368 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-6e326079-8a30-4ca4-9162-36061b0827ee tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:33:32.067067 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-6e326079-8a30-4ca4-9162-36061b0827ee tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] [instance: 852e8870-b3ec-4a21-a9b5-e31a423ddd3d] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:33:32.074497 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-6e326079-8a30-4ca4-9162-36061b0827ee tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:32.074970 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-6e326079-8a30-4ca4-9162-36061b0827ee tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:32.075426 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-6e326079-8a30-4ca4-9162-36061b0827ee tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:32.076209 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-6e326079-8a30-4ca4-9162-36061b0827ee tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:32.076544 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-6e326079-8a30-4ca4-9162-36061b0827ee tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:32.076984 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-6e326079-8a30-4ca4-9162-36061b0827ee tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:32.150102 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-d40a02d2-8d94-4875-9125-ea493ff0c321 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2e978bcb824a5e9d593b861c9e3bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7573cb9c503243ab90b1649591d550e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:33:32.158608 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-d40a02d2-8d94-4875-9125-ea493ff0c321 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] 10.222.0.15 "GET /compute/v2.1/servers/d0befdd2-2ecd-4006-bfdd-86d5253a7687" status: 200 len: 1321 microversion: 2.1 time: 0.158633 Oct 31 12:33:32.159955 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 41/75] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:33:31 2022] GET /compute/v2.1/servers/d0befdd2-2ecd-4006-bfdd-86d5253a7687 => generated 1321 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:33:32.213622 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-6e326079-8a30-4ca4-9162-36061b0827ee tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:33:32.221852 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-6e326079-8a30-4ca4-9162-36061b0827ee tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:33:32.223350 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-6e326079-8a30-4ca4-9162-36061b0827ee tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:33:32.224489 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-6e326079-8a30-4ca4-9162-36061b0827ee tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] 10.222.0.15 "GET /compute/v2.1/servers/852e8870-b3ec-4a21-a9b5-e31a423ddd3d" status: 200 len: 1408 microversion: 2.20 time: 0.162761 Oct 31 12:33:32.225063 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 35/76] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Oct 31 12:33:32 2022] GET /compute/v2.1/servers/852e8870-b3ec-4a21-a9b5-e31a423ddd3d => generated 1408 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 12:33:32.691742 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-c5a01752-3611-4ba3-b89a-9bdd92575160 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:33:32.692366 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-c5a01752-3611-4ba3-b89a-9bdd92575160 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] [instance: ff125cf8-e8a5-4f00-ade9-045b18ee33f4] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:33:32.698199 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-c5a01752-3611-4ba3-b89a-9bdd92575160 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:32.698671 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-c5a01752-3611-4ba3-b89a-9bdd92575160 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:32.699095 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-c5a01752-3611-4ba3-b89a-9bdd92575160 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:32.699793 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-c5a01752-3611-4ba3-b89a-9bdd92575160 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:32.700242 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-c5a01752-3611-4ba3-b89a-9bdd92575160 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:32.700682 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-c5a01752-3611-4ba3-b89a-9bdd92575160 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:32.775377 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-afc82a80-0bcd-45cb-9b07-da786237fd15 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:33:32.775976 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-afc82a80-0bcd-45cb-9b07-da786237fd15 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] [instance: 8d254a92-15fa-4d98-8954-a8028647165e] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:33:32.781911 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-afc82a80-0bcd-45cb-9b07-da786237fd15 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:32.782382 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-afc82a80-0bcd-45cb-9b07-da786237fd15 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:32.782803 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-afc82a80-0bcd-45cb-9b07-da786237fd15 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:32.784061 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-afc82a80-0bcd-45cb-9b07-da786237fd15 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:32.784919 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-afc82a80-0bcd-45cb-9b07-da786237fd15 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:32.785052 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-afc82a80-0bcd-45cb-9b07-da786237fd15 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:32.828774 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-c5a01752-3611-4ba3-b89a-9bdd92575160 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c1beb321e44908ab987b17f7b74484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a2bf9a5a484523a700e4e6c568d4de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:33:32.837049 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-c5a01752-3611-4ba3-b89a-9bdd92575160 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] 10.222.0.15 "GET /compute/v2.1/servers/ff125cf8-e8a5-4f00-ade9-045b18ee33f4" status: 200 len: 1364 microversion: 2.1 time: 0.149293 Oct 31 12:33:32.837619 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 42/77] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:33:32 2022] GET /compute/v2.1/servers/ff125cf8-e8a5-4f00-ade9-045b18ee33f4 => generated 1364 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:33:32.919397 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-afc82a80-0bcd-45cb-9b07-da786237fd15 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d59ee6f94848308665a32099cf5255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4d5cd8851dc4216b4e3e035a32decad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:33:32.920207 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-34d914a7-349b-4503-81c6-3d572120581c tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:33:32.920820 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-34d914a7-349b-4503-81c6-3d572120581c tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] [instance: 9906becc-a42b-4b4c-855a-450915f7a3f8] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:33:32.927504 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-afc82a80-0bcd-45cb-9b07-da786237fd15 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] 10.222.0.15 "GET /compute/v2.1/servers/8d254a92-15fa-4d98-8954-a8028647165e" status: 200 len: 1314 microversion: 2.1 time: 0.155881 Oct 31 12:33:32.927953 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-34d914a7-349b-4503-81c6-3d572120581c tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:32.928079 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 36/78] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:33:32 2022] GET /compute/v2.1/servers/8d254a92-15fa-4d98-8954-a8028647165e => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 12:33:32.928436 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-34d914a7-349b-4503-81c6-3d572120581c tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:32.928929 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-34d914a7-349b-4503-81c6-3d572120581c tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:32.929637 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-34d914a7-349b-4503-81c6-3d572120581c tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:32.930083 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-34d914a7-349b-4503-81c6-3d572120581c tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:32.930497 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-34d914a7-349b-4503-81c6-3d572120581c tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:33.060182 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-34d914a7-349b-4503-81c6-3d572120581c tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c03f0365ee4a26b8c076ae365325b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfbc3a46f12942299b99cdd20c989e1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:33:33.068650 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-34d914a7-349b-4503-81c6-3d572120581c tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] 10.222.0.15 "GET /compute/v2.1/servers/9906becc-a42b-4b4c-855a-450915f7a3f8" status: 200 len: 1366 microversion: 2.1 time: 0.152596 Oct 31 12:33:33.069360 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 43/79] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:33:32 2022] GET /compute/v2.1/servers/9906becc-a42b-4b4c-855a-450915f7a3f8 => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 12:33:33.181589 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-624ee81f-9a84-4a60-a5c5-52666a3dae8f tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:33:33.182120 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-624ee81f-9a84-4a60-a5c5-52666a3dae8f tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] [instance: d0befdd2-2ecd-4006-bfdd-86d5253a7687] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:33:33.188049 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-624ee81f-9a84-4a60-a5c5-52666a3dae8f tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:33.188523 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-624ee81f-9a84-4a60-a5c5-52666a3dae8f tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:33.188976 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-624ee81f-9a84-4a60-a5c5-52666a3dae8f tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:33.190252 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-624ee81f-9a84-4a60-a5c5-52666a3dae8f tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:33.190710 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-624ee81f-9a84-4a60-a5c5-52666a3dae8f tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:33.191128 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-624ee81f-9a84-4a60-a5c5-52666a3dae8f tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:33.258888 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-f1c4172c-b9b5-454c-a39f-e49a909506a7 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:33:33.259897 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-f1c4172c-b9b5-454c-a39f-e49a909506a7 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] [instance: 852e8870-b3ec-4a21-a9b5-e31a423ddd3d] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:33:33.268612 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-f1c4172c-b9b5-454c-a39f-e49a909506a7 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:33.269093 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-f1c4172c-b9b5-454c-a39f-e49a909506a7 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:33.269517 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-f1c4172c-b9b5-454c-a39f-e49a909506a7 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:33.270207 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-f1c4172c-b9b5-454c-a39f-e49a909506a7 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:33.270903 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-f1c4172c-b9b5-454c-a39f-e49a909506a7 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:33.271502 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-f1c4172c-b9b5-454c-a39f-e49a909506a7 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:33.341915 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-624ee81f-9a84-4a60-a5c5-52666a3dae8f tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2e978bcb824a5e9d593b861c9e3bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7573cb9c503243ab90b1649591d550e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:33:33.350654 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-624ee81f-9a84-4a60-a5c5-52666a3dae8f tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] 10.222.0.15 "GET /compute/v2.1/servers/d0befdd2-2ecd-4006-bfdd-86d5253a7687" status: 200 len: 1321 microversion: 2.1 time: 0.172864 Oct 31 12:33:33.351853 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 37/80] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:33:33 2022] GET /compute/v2.1/servers/d0befdd2-2ecd-4006-bfdd-86d5253a7687 => generated 1321 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:33:33.409876 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-f1c4172c-b9b5-454c-a39f-e49a909506a7 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:33:33.418217 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-f1c4172c-b9b5-454c-a39f-e49a909506a7 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:33:33.423686 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-f1c4172c-b9b5-454c-a39f-e49a909506a7 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:33:33.425054 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-f1c4172c-b9b5-454c-a39f-e49a909506a7 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] 10.222.0.15 "GET /compute/v2.1/servers/852e8870-b3ec-4a21-a9b5-e31a423ddd3d" status: 200 len: 1408 microversion: 2.20 time: 0.175591 Oct 31 12:33:33.425611 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 44/81] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Oct 31 12:33:33 2022] GET /compute/v2.1/servers/852e8870-b3ec-4a21-a9b5-e31a423ddd3d => generated 1408 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 12:33:33.859960 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-2e351760-3a46-416a-967f-975429847cfe tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:33:33.860653 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-2e351760-3a46-416a-967f-975429847cfe tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] [instance: ff125cf8-e8a5-4f00-ade9-045b18ee33f4] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:33:33.867249 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-2e351760-3a46-416a-967f-975429847cfe tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:33.867723 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-2e351760-3a46-416a-967f-975429847cfe tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:33.868162 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-2e351760-3a46-416a-967f-975429847cfe tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:33.868840 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-2e351760-3a46-416a-967f-975429847cfe tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:33.869287 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-2e351760-3a46-416a-967f-975429847cfe tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:33.869701 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-2e351760-3a46-416a-967f-975429847cfe tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:33.949937 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-db35427c-81b3-4797-a79b-4feadeee4d1e tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:33:33.950607 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-db35427c-81b3-4797-a79b-4feadeee4d1e tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] [instance: 8d254a92-15fa-4d98-8954-a8028647165e] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:33:33.956674 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-db35427c-81b3-4797-a79b-4feadeee4d1e tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:33.957147 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-db35427c-81b3-4797-a79b-4feadeee4d1e tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:33.957569 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-db35427c-81b3-4797-a79b-4feadeee4d1e tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:33.958256 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-db35427c-81b3-4797-a79b-4feadeee4d1e tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:33.958898 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-db35427c-81b3-4797-a79b-4feadeee4d1e tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:33.959351 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-db35427c-81b3-4797-a79b-4feadeee4d1e tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:33.997944 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-2e351760-3a46-416a-967f-975429847cfe tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c1beb321e44908ab987b17f7b74484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a2bf9a5a484523a700e4e6c568d4de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:33:34.000370 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG dbcounter [-] [125441] Writing DB stats nova_cell1:SELECT=100 {{(pid=125441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:33:34.007494 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-2e351760-3a46-416a-967f-975429847cfe tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] 10.222.0.15 "GET /compute/v2.1/servers/ff125cf8-e8a5-4f00-ade9-045b18ee33f4" status: 200 len: 1364 microversion: 2.1 time: 0.151267 Oct 31 12:33:34.008074 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 38/82] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:33:33 2022] GET /compute/v2.1/servers/ff125cf8-e8a5-4f00-ade9-045b18ee33f4 => generated 1364 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:33:34.091633 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-bc18940c-4d58-4642-b05e-9a83788d4804 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:33:34.092245 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-bc18940c-4d58-4642-b05e-9a83788d4804 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] [instance: 9906becc-a42b-4b4c-855a-450915f7a3f8] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:33:34.098381 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-bc18940c-4d58-4642-b05e-9a83788d4804 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:34.098870 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-bc18940c-4d58-4642-b05e-9a83788d4804 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:34.099322 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-bc18940c-4d58-4642-b05e-9a83788d4804 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:34.099645 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-db35427c-81b3-4797-a79b-4feadeee4d1e tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d59ee6f94848308665a32099cf5255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4d5cd8851dc4216b4e3e035a32decad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:33:34.100198 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-bc18940c-4d58-4642-b05e-9a83788d4804 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:34.100657 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-bc18940c-4d58-4642-b05e-9a83788d4804 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:34.101076 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-bc18940c-4d58-4642-b05e-9a83788d4804 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:34.107669 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-db35427c-81b3-4797-a79b-4feadeee4d1e tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] 10.222.0.15 "GET /compute/v2.1/servers/8d254a92-15fa-4d98-8954-a8028647165e" status: 200 len: 1314 microversion: 2.1 time: 0.161663 Oct 31 12:33:34.108239 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 45/83] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:33:33 2022] GET /compute/v2.1/servers/8d254a92-15fa-4d98-8954-a8028647165e => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:33:34.233455 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-bc18940c-4d58-4642-b05e-9a83788d4804 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c03f0365ee4a26b8c076ae365325b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfbc3a46f12942299b99cdd20c989e1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:33:34.241008 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-bc18940c-4d58-4642-b05e-9a83788d4804 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] 10.222.0.15 "GET /compute/v2.1/servers/9906becc-a42b-4b4c-855a-450915f7a3f8" status: 200 len: 1366 microversion: 2.1 time: 0.153223 Oct 31 12:33:34.241567 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 39/84] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:33:34 2022] GET /compute/v2.1/servers/9906becc-a42b-4b4c-855a-450915f7a3f8 => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 12:33:34.374060 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-4469807a-2c7c-4f04-a785-9438d4ce1a05 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:33:34.374685 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-4469807a-2c7c-4f04-a785-9438d4ce1a05 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] [instance: d0befdd2-2ecd-4006-bfdd-86d5253a7687] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:33:34.381412 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-4469807a-2c7c-4f04-a785-9438d4ce1a05 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:34.381887 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-4469807a-2c7c-4f04-a785-9438d4ce1a05 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:34.382309 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-4469807a-2c7c-4f04-a785-9438d4ce1a05 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:34.382984 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-4469807a-2c7c-4f04-a785-9438d4ce1a05 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:34.383474 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-4469807a-2c7c-4f04-a785-9438d4ce1a05 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:34.383882 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-4469807a-2c7c-4f04-a785-9438d4ce1a05 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:34.451619 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-641fdd1c-50d2-41db-aa10-03e799a30292 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:33:34.451619 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-641fdd1c-50d2-41db-aa10-03e799a30292 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] [instance: 852e8870-b3ec-4a21-a9b5-e31a423ddd3d] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:33:34.453356 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG dbcounter [-] [125441] Writing DB stats nova_cell0:SELECT=10 {{(pid=125441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:33:34.457987 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-641fdd1c-50d2-41db-aa10-03e799a30292 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:34.458115 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-641fdd1c-50d2-41db-aa10-03e799a30292 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:34.458604 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-641fdd1c-50d2-41db-aa10-03e799a30292 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:34.459235 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-641fdd1c-50d2-41db-aa10-03e799a30292 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:34.459680 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-641fdd1c-50d2-41db-aa10-03e799a30292 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:34.460090 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-641fdd1c-50d2-41db-aa10-03e799a30292 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:34.517735 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-4469807a-2c7c-4f04-a785-9438d4ce1a05 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2e978bcb824a5e9d593b861c9e3bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7573cb9c503243ab90b1649591d550e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:33:34.522054 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG dbcounter [-] [125440] Writing DB stats nova_cell1:SELECT=100 {{(pid=125440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:33:34.528511 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-4469807a-2c7c-4f04-a785-9438d4ce1a05 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] 10.222.0.15 "GET /compute/v2.1/servers/d0befdd2-2ecd-4006-bfdd-86d5253a7687" status: 200 len: 1321 microversion: 2.1 time: 0.158761 Oct 31 12:33:34.529469 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 46/85] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:33:34 2022] GET /compute/v2.1/servers/d0befdd2-2ecd-4006-bfdd-86d5253a7687 => generated 1321 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 12:33:34.604470 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-641fdd1c-50d2-41db-aa10-03e799a30292 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:33:34.614484 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-641fdd1c-50d2-41db-aa10-03e799a30292 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:33:34.616355 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-641fdd1c-50d2-41db-aa10-03e799a30292 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:33:34.617519 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-641fdd1c-50d2-41db-aa10-03e799a30292 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] 10.222.0.15 "GET /compute/v2.1/servers/852e8870-b3ec-4a21-a9b5-e31a423ddd3d" status: 200 len: 1408 microversion: 2.20 time: 0.171496 Oct 31 12:33:34.618098 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 40/86] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Oct 31 12:33:34 2022] GET /compute/v2.1/servers/852e8870-b3ec-4a21-a9b5-e31a423ddd3d => generated 1408 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 12:33:35.030073 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-1c18c6da-a255-44d9-afc8-33811686895d tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:33:35.030673 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-1c18c6da-a255-44d9-afc8-33811686895d tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] [instance: ff125cf8-e8a5-4f00-ade9-045b18ee33f4] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:33:35.036964 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-1c18c6da-a255-44d9-afc8-33811686895d tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:35.037434 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-1c18c6da-a255-44d9-afc8-33811686895d tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:35.037879 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-1c18c6da-a255-44d9-afc8-33811686895d tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:35.038553 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-1c18c6da-a255-44d9-afc8-33811686895d tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:35.038994 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-1c18c6da-a255-44d9-afc8-33811686895d tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:35.039462 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-1c18c6da-a255-44d9-afc8-33811686895d tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:35.131768 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-26e3ecd7-bb22-4495-bbd7-41645471fb3b tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:33:35.132484 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-26e3ecd7-bb22-4495-bbd7-41645471fb3b tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] [instance: 8d254a92-15fa-4d98-8954-a8028647165e] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:33:35.138722 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-26e3ecd7-bb22-4495-bbd7-41645471fb3b tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:35.139233 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-26e3ecd7-bb22-4495-bbd7-41645471fb3b tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:35.139669 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-26e3ecd7-bb22-4495-bbd7-41645471fb3b tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:35.140404 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-26e3ecd7-bb22-4495-bbd7-41645471fb3b tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:35.141032 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-26e3ecd7-bb22-4495-bbd7-41645471fb3b tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:35.141618 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-26e3ecd7-bb22-4495-bbd7-41645471fb3b tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:35.165163 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-1c18c6da-a255-44d9-afc8-33811686895d tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c1beb321e44908ab987b17f7b74484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a2bf9a5a484523a700e4e6c568d4de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:33:35.172814 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-1c18c6da-a255-44d9-afc8-33811686895d tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] 10.222.0.15 "GET /compute/v2.1/servers/ff125cf8-e8a5-4f00-ade9-045b18ee33f4" status: 200 len: 1364 microversion: 2.1 time: 0.146666 Oct 31 12:33:35.173380 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 47/87] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:33:35 2022] GET /compute/v2.1/servers/ff125cf8-e8a5-4f00-ade9-045b18ee33f4 => generated 1364 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:33:35.263992 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-f113142d-617b-462e-8fd1-6af7c6119763 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:33:35.264605 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-f113142d-617b-462e-8fd1-6af7c6119763 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] [instance: 9906becc-a42b-4b4c-855a-450915f7a3f8] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:33:35.269023 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-26e3ecd7-bb22-4495-bbd7-41645471fb3b tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d59ee6f94848308665a32099cf5255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4d5cd8851dc4216b4e3e035a32decad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:33:35.270831 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-f113142d-617b-462e-8fd1-6af7c6119763 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:35.271346 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-f113142d-617b-462e-8fd1-6af7c6119763 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:35.271776 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-f113142d-617b-462e-8fd1-6af7c6119763 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:35.272467 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-f113142d-617b-462e-8fd1-6af7c6119763 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:35.272921 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-f113142d-617b-462e-8fd1-6af7c6119763 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:35.273339 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-f113142d-617b-462e-8fd1-6af7c6119763 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:35.277358 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-26e3ecd7-bb22-4495-bbd7-41645471fb3b tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] 10.222.0.15 "GET /compute/v2.1/servers/8d254a92-15fa-4d98-8954-a8028647165e" status: 200 len: 1314 microversion: 2.1 time: 0.150267 Oct 31 12:33:35.277931 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 41/88] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:33:35 2022] GET /compute/v2.1/servers/8d254a92-15fa-4d98-8954-a8028647165e => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 12:33:35.406223 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-f113142d-617b-462e-8fd1-6af7c6119763 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c03f0365ee4a26b8c076ae365325b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfbc3a46f12942299b99cdd20c989e1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:33:35.413904 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-f113142d-617b-462e-8fd1-6af7c6119763 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] 10.222.0.15 "GET /compute/v2.1/servers/9906becc-a42b-4b4c-855a-450915f7a3f8" status: 200 len: 1366 microversion: 2.1 time: 0.153725 Oct 31 12:33:35.414473 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 48/89] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:33:35 2022] GET /compute/v2.1/servers/9906becc-a42b-4b4c-855a-450915f7a3f8 => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 12:33:35.552292 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-2fe52a11-4425-45dd-8849-8dff65ff0d7c tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:33:35.552891 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-2fe52a11-4425-45dd-8849-8dff65ff0d7c tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] [instance: d0befdd2-2ecd-4006-bfdd-86d5253a7687] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:33:35.558682 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-2fe52a11-4425-45dd-8849-8dff65ff0d7c tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:35.559157 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-2fe52a11-4425-45dd-8849-8dff65ff0d7c tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:35.559609 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-2fe52a11-4425-45dd-8849-8dff65ff0d7c tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:35.560275 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-2fe52a11-4425-45dd-8849-8dff65ff0d7c tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:35.560721 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-2fe52a11-4425-45dd-8849-8dff65ff0d7c tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:35.561149 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-2fe52a11-4425-45dd-8849-8dff65ff0d7c tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:35.643947 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-6fbe5239-8982-4c5b-a740-49ec20ca640d tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:33:35.644669 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-6fbe5239-8982-4c5b-a740-49ec20ca640d tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] [instance: 852e8870-b3ec-4a21-a9b5-e31a423ddd3d] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:33:35.651519 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-6fbe5239-8982-4c5b-a740-49ec20ca640d tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:35.652294 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-6fbe5239-8982-4c5b-a740-49ec20ca640d tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:35.652755 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-6fbe5239-8982-4c5b-a740-49ec20ca640d tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:35.653619 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-6fbe5239-8982-4c5b-a740-49ec20ca640d tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:35.654133 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-6fbe5239-8982-4c5b-a740-49ec20ca640d tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:35.654617 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-6fbe5239-8982-4c5b-a740-49ec20ca640d tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:35.696860 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-2fe52a11-4425-45dd-8849-8dff65ff0d7c tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2e978bcb824a5e9d593b861c9e3bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7573cb9c503243ab90b1649591d550e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:33:35.704515 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-2fe52a11-4425-45dd-8849-8dff65ff0d7c tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] 10.222.0.15 "GET /compute/v2.1/servers/d0befdd2-2ecd-4006-bfdd-86d5253a7687" status: 200 len: 1321 microversion: 2.1 time: 0.156573 Oct 31 12:33:35.705076 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 42/90] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:33:35 2022] GET /compute/v2.1/servers/d0befdd2-2ecd-4006-bfdd-86d5253a7687 => generated 1321 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:33:35.785785 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-6fbe5239-8982-4c5b-a740-49ec20ca640d tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:33:35.793716 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-6fbe5239-8982-4c5b-a740-49ec20ca640d tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:33:35.795137 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-6fbe5239-8982-4c5b-a740-49ec20ca640d tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:33:35.796233 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-6fbe5239-8982-4c5b-a740-49ec20ca640d tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] 10.222.0.15 "GET /compute/v2.1/servers/852e8870-b3ec-4a21-a9b5-e31a423ddd3d" status: 200 len: 1408 microversion: 2.20 time: 0.156678 Oct 31 12:33:35.796785 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 49/91] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Oct 31 12:33:35 2022] GET /compute/v2.1/servers/852e8870-b3ec-4a21-a9b5-e31a423ddd3d => generated 1408 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 12:33:36.195732 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-450bddb1-f61a-4fa6-8cfb-787f13f1b027 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:33:36.196336 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-450bddb1-f61a-4fa6-8cfb-787f13f1b027 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] [instance: ff125cf8-e8a5-4f00-ade9-045b18ee33f4] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:33:36.202152 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-450bddb1-f61a-4fa6-8cfb-787f13f1b027 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:36.202625 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-450bddb1-f61a-4fa6-8cfb-787f13f1b027 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:36.203062 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-450bddb1-f61a-4fa6-8cfb-787f13f1b027 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:36.203759 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-450bddb1-f61a-4fa6-8cfb-787f13f1b027 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:36.204202 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-450bddb1-f61a-4fa6-8cfb-787f13f1b027 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:36.204615 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-450bddb1-f61a-4fa6-8cfb-787f13f1b027 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:36.301719 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-bc329814-ac86-4067-93e4-c56ee86efc82 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:33:36.302412 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-bc329814-ac86-4067-93e4-c56ee86efc82 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] [instance: 8d254a92-15fa-4d98-8954-a8028647165e] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:33:36.308348 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-bc329814-ac86-4067-93e4-c56ee86efc82 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:36.308890 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-bc329814-ac86-4067-93e4-c56ee86efc82 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:36.309396 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-bc329814-ac86-4067-93e4-c56ee86efc82 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:36.310138 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-bc329814-ac86-4067-93e4-c56ee86efc82 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:36.310580 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-bc329814-ac86-4067-93e4-c56ee86efc82 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:36.310988 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-bc329814-ac86-4067-93e4-c56ee86efc82 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:36.330669 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-450bddb1-f61a-4fa6-8cfb-787f13f1b027 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c1beb321e44908ab987b17f7b74484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a2bf9a5a484523a700e4e6c568d4de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:33:36.338385 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-450bddb1-f61a-4fa6-8cfb-787f13f1b027 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] 10.222.0.15 "GET /compute/v2.1/servers/ff125cf8-e8a5-4f00-ade9-045b18ee33f4" status: 200 len: 1364 microversion: 2.1 time: 0.146401 Oct 31 12:33:36.338957 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 43/92] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:33:36 2022] GET /compute/v2.1/servers/ff125cf8-e8a5-4f00-ade9-045b18ee33f4 => generated 1364 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:33:36.436628 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-d2916673-fed5-4600-80e1-537888ae1a76 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:33:36.438386 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-d2916673-fed5-4600-80e1-537888ae1a76 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] [instance: 9906becc-a42b-4b4c-855a-450915f7a3f8] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:33:36.445509 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-d2916673-fed5-4600-80e1-537888ae1a76 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:36.445833 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-bc329814-ac86-4067-93e4-c56ee86efc82 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d59ee6f94848308665a32099cf5255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4d5cd8851dc4216b4e3e035a32decad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:33:36.446333 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-d2916673-fed5-4600-80e1-537888ae1a76 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:36.446900 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-d2916673-fed5-4600-80e1-537888ae1a76 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:36.447767 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-d2916673-fed5-4600-80e1-537888ae1a76 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:36.448352 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-d2916673-fed5-4600-80e1-537888ae1a76 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:36.449044 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-d2916673-fed5-4600-80e1-537888ae1a76 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:36.453937 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-bc329814-ac86-4067-93e4-c56ee86efc82 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] 10.222.0.15 "GET /compute/v2.1/servers/8d254a92-15fa-4d98-8954-a8028647165e" status: 200 len: 1314 microversion: 2.1 time: 0.157402 Oct 31 12:33:36.454508 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 50/93] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:33:36 2022] GET /compute/v2.1/servers/8d254a92-15fa-4d98-8954-a8028647165e => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 12:33:36.577691 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-d2916673-fed5-4600-80e1-537888ae1a76 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c03f0365ee4a26b8c076ae365325b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfbc3a46f12942299b99cdd20c989e1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:33:36.585294 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-d2916673-fed5-4600-80e1-537888ae1a76 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] 10.222.0.15 "GET /compute/v2.1/servers/9906becc-a42b-4b4c-855a-450915f7a3f8" status: 200 len: 1366 microversion: 2.1 time: 0.152448 Oct 31 12:33:36.585855 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 44/94] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:33:36 2022] GET /compute/v2.1/servers/9906becc-a42b-4b4c-855a-450915f7a3f8 => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 12:33:36.727051 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-b4c163ba-2438-490d-ae6b-a2a3687d58cf tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:33:36.727698 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-b4c163ba-2438-490d-ae6b-a2a3687d58cf tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] [instance: d0befdd2-2ecd-4006-bfdd-86d5253a7687] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:33:36.733553 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-b4c163ba-2438-490d-ae6b-a2a3687d58cf tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:36.734037 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-b4c163ba-2438-490d-ae6b-a2a3687d58cf tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:36.734470 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-b4c163ba-2438-490d-ae6b-a2a3687d58cf tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:36.735148 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-b4c163ba-2438-490d-ae6b-a2a3687d58cf tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:36.735618 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-b4c163ba-2438-490d-ae6b-a2a3687d58cf tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:36.736035 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-b4c163ba-2438-490d-ae6b-a2a3687d58cf tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:36.821410 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-4239671e-8184-4e2d-bbca-02a5c01dcfda tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:33:36.822012 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-4239671e-8184-4e2d-bbca-02a5c01dcfda tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] [instance: 852e8870-b3ec-4a21-a9b5-e31a423ddd3d] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:33:36.827953 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-4239671e-8184-4e2d-bbca-02a5c01dcfda tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:36.828426 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-4239671e-8184-4e2d-bbca-02a5c01dcfda tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:36.828917 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-4239671e-8184-4e2d-bbca-02a5c01dcfda tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:36.829589 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-4239671e-8184-4e2d-bbca-02a5c01dcfda tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:36.830094 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-4239671e-8184-4e2d-bbca-02a5c01dcfda tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:36.830565 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-4239671e-8184-4e2d-bbca-02a5c01dcfda tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:36.868631 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-b4c163ba-2438-490d-ae6b-a2a3687d58cf tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2e978bcb824a5e9d593b861c9e3bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7573cb9c503243ab90b1649591d550e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:33:36.876349 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-b4c163ba-2438-490d-ae6b-a2a3687d58cf tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] 10.222.0.15 "GET /compute/v2.1/servers/d0befdd2-2ecd-4006-bfdd-86d5253a7687" status: 200 len: 1321 microversion: 2.1 time: 0.153060 Oct 31 12:33:36.876920 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 51/95] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:33:36 2022] GET /compute/v2.1/servers/d0befdd2-2ecd-4006-bfdd-86d5253a7687 => generated 1321 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:33:36.956860 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-4239671e-8184-4e2d-bbca-02a5c01dcfda tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:33:36.964884 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-4239671e-8184-4e2d-bbca-02a5c01dcfda tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:33:36.966328 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-4239671e-8184-4e2d-bbca-02a5c01dcfda tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:33:36.967442 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-4239671e-8184-4e2d-bbca-02a5c01dcfda tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] 10.222.0.15 "GET /compute/v2.1/servers/852e8870-b3ec-4a21-a9b5-e31a423ddd3d" status: 200 len: 1408 microversion: 2.20 time: 0.149852 Oct 31 12:33:36.968013 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 45/96] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Oct 31 12:33:36 2022] GET /compute/v2.1/servers/852e8870-b3ec-4a21-a9b5-e31a423ddd3d => generated 1408 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 12:33:37.367340 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-21cf24dc-6fba-475e-bb02-3694236f3058 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:33:37.370021 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-21cf24dc-6fba-475e-bb02-3694236f3058 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] [instance: ff125cf8-e8a5-4f00-ade9-045b18ee33f4] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:33:37.382512 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-21cf24dc-6fba-475e-bb02-3694236f3058 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:37.383196 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-21cf24dc-6fba-475e-bb02-3694236f3058 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:37.384785 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-21cf24dc-6fba-475e-bb02-3694236f3058 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:37.385709 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-21cf24dc-6fba-475e-bb02-3694236f3058 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:37.386636 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-21cf24dc-6fba-475e-bb02-3694236f3058 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:37.388480 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-21cf24dc-6fba-475e-bb02-3694236f3058 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:37.482288 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-6b7d67fc-71b2-499c-bcf0-db56aa4d23c7 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:33:37.484107 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-6b7d67fc-71b2-499c-bcf0-db56aa4d23c7 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] [instance: 8d254a92-15fa-4d98-8954-a8028647165e] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:33:37.494015 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-6b7d67fc-71b2-499c-bcf0-db56aa4d23c7 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:37.495134 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-6b7d67fc-71b2-499c-bcf0-db56aa4d23c7 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:37.495816 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-6b7d67fc-71b2-499c-bcf0-db56aa4d23c7 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:37.497006 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-6b7d67fc-71b2-499c-bcf0-db56aa4d23c7 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:37.498214 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-6b7d67fc-71b2-499c-bcf0-db56aa4d23c7 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:37.498778 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-6b7d67fc-71b2-499c-bcf0-db56aa4d23c7 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:37.735610 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-21cf24dc-6fba-475e-bb02-3694236f3058 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c1beb321e44908ab987b17f7b74484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a2bf9a5a484523a700e4e6c568d4de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:33:37.743774 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-21cf24dc-6fba-475e-bb02-3694236f3058 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] 10.222.0.15 "GET /compute/v2.1/servers/ff125cf8-e8a5-4f00-ade9-045b18ee33f4" status: 200 len: 1364 microversion: 2.1 time: 0.384415 Oct 31 12:33:37.744830 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 52/97] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:33:37 2022] GET /compute/v2.1/servers/ff125cf8-e8a5-4f00-ade9-045b18ee33f4 => generated 1364 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:33:37.749430 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-624edd58-a8bd-4506-a163-69e801901d58 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:33:37.750054 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-624edd58-a8bd-4506-a163-69e801901d58 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] [instance: 9906becc-a42b-4b4c-855a-450915f7a3f8] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:33:37.756982 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-624edd58-a8bd-4506-a163-69e801901d58 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:37.757433 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-624edd58-a8bd-4506-a163-69e801901d58 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:37.758627 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-624edd58-a8bd-4506-a163-69e801901d58 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:37.758808 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-624edd58-a8bd-4506-a163-69e801901d58 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:37.759350 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-624edd58-a8bd-4506-a163-69e801901d58 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:37.759926 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-624edd58-a8bd-4506-a163-69e801901d58 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:37.782792 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-6b7d67fc-71b2-499c-bcf0-db56aa4d23c7 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d59ee6f94848308665a32099cf5255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4d5cd8851dc4216b4e3e035a32decad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:33:37.791256 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-6b7d67fc-71b2-499c-bcf0-db56aa4d23c7 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] 10.222.0.15 "GET /compute/v2.1/servers/8d254a92-15fa-4d98-8954-a8028647165e" status: 200 len: 1314 microversion: 2.1 time: 0.316816 Oct 31 12:33:37.792051 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 46/98] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:33:37 2022] GET /compute/v2.1/servers/8d254a92-15fa-4d98-8954-a8028647165e => generated 1314 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 12:33:37.891675 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-624edd58-a8bd-4506-a163-69e801901d58 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c03f0365ee4a26b8c076ae365325b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfbc3a46f12942299b99cdd20c989e1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:33:37.899907 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-a586138a-544d-4287-8a46-5581a160a85f tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:33:37.900484 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-624edd58-a8bd-4506-a163-69e801901d58 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] 10.222.0.15 "GET /compute/v2.1/servers/9906becc-a42b-4b4c-855a-450915f7a3f8" status: 200 len: 1366 microversion: 2.1 time: 0.155072 Oct 31 12:33:37.900583 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-a586138a-544d-4287-8a46-5581a160a85f tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] [instance: d0befdd2-2ecd-4006-bfdd-86d5253a7687] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:33:37.901415 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 53/99] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:33:37 2022] GET /compute/v2.1/servers/9906becc-a42b-4b4c-855a-450915f7a3f8 => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:33:37.906583 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-a586138a-544d-4287-8a46-5581a160a85f tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:37.907066 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-a586138a-544d-4287-8a46-5581a160a85f tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:37.907546 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-a586138a-544d-4287-8a46-5581a160a85f tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:37.908283 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-a586138a-544d-4287-8a46-5581a160a85f tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:37.909233 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-a586138a-544d-4287-8a46-5581a160a85f tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:37.910255 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-a586138a-544d-4287-8a46-5581a160a85f tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:37.992869 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-b858ca4e-99e7-48d2-859b-b7449d3f7702 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:33:37.993726 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-b858ca4e-99e7-48d2-859b-b7449d3f7702 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] [instance: 852e8870-b3ec-4a21-a9b5-e31a423ddd3d] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:33:38.001123 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-b858ca4e-99e7-48d2-859b-b7449d3f7702 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:38.001676 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-b858ca4e-99e7-48d2-859b-b7449d3f7702 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:38.002138 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-b858ca4e-99e7-48d2-859b-b7449d3f7702 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:38.003500 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-b858ca4e-99e7-48d2-859b-b7449d3f7702 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:38.004007 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-b858ca4e-99e7-48d2-859b-b7449d3f7702 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:38.004425 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-b858ca4e-99e7-48d2-859b-b7449d3f7702 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:38.059628 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-a586138a-544d-4287-8a46-5581a160a85f tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2e978bcb824a5e9d593b861c9e3bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7573cb9c503243ab90b1649591d550e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:33:38.074714 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-a586138a-544d-4287-8a46-5581a160a85f tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] 10.222.0.15 "GET /compute/v2.1/servers/d0befdd2-2ecd-4006-bfdd-86d5253a7687" status: 200 len: 1321 microversion: 2.1 time: 0.178760 Oct 31 12:33:38.075831 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 47/100] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:33:37 2022] GET /compute/v2.1/servers/d0befdd2-2ecd-4006-bfdd-86d5253a7687 => generated 1321 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 12:33:38.155478 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-b858ca4e-99e7-48d2-859b-b7449d3f7702 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:33:38.164238 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-b858ca4e-99e7-48d2-859b-b7449d3f7702 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:33:38.165676 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-b858ca4e-99e7-48d2-859b-b7449d3f7702 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:33:38.166755 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-b858ca4e-99e7-48d2-859b-b7449d3f7702 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] 10.222.0.15 "GET /compute/v2.1/servers/852e8870-b3ec-4a21-a9b5-e31a423ddd3d" status: 200 len: 1408 microversion: 2.20 time: 0.178064 Oct 31 12:33:38.167334 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 54/101] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Oct 31 12:33:37 2022] GET /compute/v2.1/servers/852e8870-b3ec-4a21-a9b5-e31a423ddd3d => generated 1408 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 12:33:38.767501 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-faedbb5e-a171-4a0b-9250-086390905aef tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:33:38.768756 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-faedbb5e-a171-4a0b-9250-086390905aef tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] [instance: ff125cf8-e8a5-4f00-ade9-045b18ee33f4] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:33:38.774881 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-faedbb5e-a171-4a0b-9250-086390905aef tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:38.775388 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-faedbb5e-a171-4a0b-9250-086390905aef tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:38.775813 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-faedbb5e-a171-4a0b-9250-086390905aef tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:38.776485 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-faedbb5e-a171-4a0b-9250-086390905aef tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:38.776928 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-faedbb5e-a171-4a0b-9250-086390905aef tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:38.777336 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-faedbb5e-a171-4a0b-9250-086390905aef tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:38.813742 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-323de6a3-9357-4d7c-8bef-236c75395dc1 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:33:38.814420 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-323de6a3-9357-4d7c-8bef-236c75395dc1 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] [instance: 8d254a92-15fa-4d98-8954-a8028647165e] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:33:38.817075 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG dbcounter [-] [125440] Writing DB stats nova_cell0:SELECT=2 {{(pid=125440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:33:38.822523 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-323de6a3-9357-4d7c-8bef-236c75395dc1 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:38.823016 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-323de6a3-9357-4d7c-8bef-236c75395dc1 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:38.823537 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-323de6a3-9357-4d7c-8bef-236c75395dc1 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:38.824283 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-323de6a3-9357-4d7c-8bef-236c75395dc1 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:38.824805 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-323de6a3-9357-4d7c-8bef-236c75395dc1 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:38.825223 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-323de6a3-9357-4d7c-8bef-236c75395dc1 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:38.906019 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-faedbb5e-a171-4a0b-9250-086390905aef tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c1beb321e44908ab987b17f7b74484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a2bf9a5a484523a700e4e6c568d4de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:33:38.914132 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-faedbb5e-a171-4a0b-9250-086390905aef tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] 10.222.0.15 "GET /compute/v2.1/servers/ff125cf8-e8a5-4f00-ade9-045b18ee33f4" status: 200 len: 1364 microversion: 2.1 time: 0.150394 Oct 31 12:33:38.914711 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 48/102] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:33:38 2022] GET /compute/v2.1/servers/ff125cf8-e8a5-4f00-ade9-045b18ee33f4 => generated 1364 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:33:38.923929 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-5cfa0494-bcbf-4db8-97ee-56d8753a08b3 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:33:38.925196 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-5cfa0494-bcbf-4db8-97ee-56d8753a08b3 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] [instance: 9906becc-a42b-4b4c-855a-450915f7a3f8] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:33:38.931765 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-5cfa0494-bcbf-4db8-97ee-56d8753a08b3 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:38.932349 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-5cfa0494-bcbf-4db8-97ee-56d8753a08b3 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:38.932883 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-5cfa0494-bcbf-4db8-97ee-56d8753a08b3 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:38.933637 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-5cfa0494-bcbf-4db8-97ee-56d8753a08b3 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:38.934152 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-5cfa0494-bcbf-4db8-97ee-56d8753a08b3 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:38.934635 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-5cfa0494-bcbf-4db8-97ee-56d8753a08b3 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:38.954210 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-323de6a3-9357-4d7c-8bef-236c75395dc1 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d59ee6f94848308665a32099cf5255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4d5cd8851dc4216b4e3e035a32decad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:33:38.962568 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-323de6a3-9357-4d7c-8bef-236c75395dc1 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] 10.222.0.15 "GET /compute/v2.1/servers/8d254a92-15fa-4d98-8954-a8028647165e" status: 200 len: 1314 microversion: 2.1 time: 0.152622 Oct 31 12:33:38.963296 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 55/103] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:33:38 2022] GET /compute/v2.1/servers/8d254a92-15fa-4d98-8954-a8028647165e => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 12:33:39.060887 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-5cfa0494-bcbf-4db8-97ee-56d8753a08b3 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c03f0365ee4a26b8c076ae365325b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfbc3a46f12942299b99cdd20c989e1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:33:39.069156 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-5cfa0494-bcbf-4db8-97ee-56d8753a08b3 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] 10.222.0.15 "GET /compute/v2.1/servers/9906becc-a42b-4b4c-855a-450915f7a3f8" status: 200 len: 1366 microversion: 2.1 time: 0.148826 Oct 31 12:33:39.069721 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 49/104] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:33:38 2022] GET /compute/v2.1/servers/9906becc-a42b-4b4c-855a-450915f7a3f8 => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 12:33:39.098970 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-4c5e4686-6127-4e9f-927d-ba3e8fbdfd5d tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:33:39.099532 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-4c5e4686-6127-4e9f-927d-ba3e8fbdfd5d tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] [instance: d0befdd2-2ecd-4006-bfdd-86d5253a7687] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:33:39.105467 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-4c5e4686-6127-4e9f-927d-ba3e8fbdfd5d tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:39.105928 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-4c5e4686-6127-4e9f-927d-ba3e8fbdfd5d tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:39.106346 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-4c5e4686-6127-4e9f-927d-ba3e8fbdfd5d tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:39.107011 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-4c5e4686-6127-4e9f-927d-ba3e8fbdfd5d tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:39.107474 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-4c5e4686-6127-4e9f-927d-ba3e8fbdfd5d tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:39.107882 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-4c5e4686-6127-4e9f-927d-ba3e8fbdfd5d tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:39.192176 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-6e59a5e4-437a-456e-8276-6e1d7d9e5650 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:33:39.192774 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-6e59a5e4-437a-456e-8276-6e1d7d9e5650 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] [instance: 852e8870-b3ec-4a21-a9b5-e31a423ddd3d] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:33:39.198764 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-6e59a5e4-437a-456e-8276-6e1d7d9e5650 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:39.199279 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-6e59a5e4-437a-456e-8276-6e1d7d9e5650 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:39.199703 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-6e59a5e4-437a-456e-8276-6e1d7d9e5650 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:39.200389 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-6e59a5e4-437a-456e-8276-6e1d7d9e5650 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:39.200865 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-6e59a5e4-437a-456e-8276-6e1d7d9e5650 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:39.201279 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-6e59a5e4-437a-456e-8276-6e1d7d9e5650 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:39.235344 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-4c5e4686-6127-4e9f-927d-ba3e8fbdfd5d tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2e978bcb824a5e9d593b861c9e3bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7573cb9c503243ab90b1649591d550e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:33:39.244135 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-4c5e4686-6127-4e9f-927d-ba3e8fbdfd5d tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] 10.222.0.15 "GET /compute/v2.1/servers/d0befdd2-2ecd-4006-bfdd-86d5253a7687" status: 200 len: 1321 microversion: 2.1 time: 0.149128 Oct 31 12:33:39.244712 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 56/105] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:33:39 2022] GET /compute/v2.1/servers/d0befdd2-2ecd-4006-bfdd-86d5253a7687 => generated 1321 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:33:39.332939 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-6e59a5e4-437a-456e-8276-6e1d7d9e5650 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:33:39.341379 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-6e59a5e4-437a-456e-8276-6e1d7d9e5650 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:33:39.342801 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-6e59a5e4-437a-456e-8276-6e1d7d9e5650 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:33:39.343934 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-6e59a5e4-437a-456e-8276-6e1d7d9e5650 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] 10.222.0.15 "GET /compute/v2.1/servers/852e8870-b3ec-4a21-a9b5-e31a423ddd3d" status: 200 len: 1408 microversion: 2.20 time: 0.156250 Oct 31 12:33:39.344492 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 50/106] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Oct 31 12:33:39 2022] GET /compute/v2.1/servers/852e8870-b3ec-4a21-a9b5-e31a423ddd3d => generated 1408 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 12:33:39.937544 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-8e4f31b3-3850-4645-abf1-b842849854f8 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:33:39.938146 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-8e4f31b3-3850-4645-abf1-b842849854f8 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] [instance: ff125cf8-e8a5-4f00-ade9-045b18ee33f4] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:33:39.944657 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-8e4f31b3-3850-4645-abf1-b842849854f8 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:39.945124 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-8e4f31b3-3850-4645-abf1-b842849854f8 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:39.945542 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-8e4f31b3-3850-4645-abf1-b842849854f8 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:39.946208 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-8e4f31b3-3850-4645-abf1-b842849854f8 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:39.946648 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-8e4f31b3-3850-4645-abf1-b842849854f8 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:39.947058 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-8e4f31b3-3850-4645-abf1-b842849854f8 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:39.984633 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-ef7c7c8d-7cce-4ff3-b7b6-73dc77ca143c tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:33:39.985239 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-ef7c7c8d-7cce-4ff3-b7b6-73dc77ca143c tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] [instance: 8d254a92-15fa-4d98-8954-a8028647165e] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:33:39.991661 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-ef7c7c8d-7cce-4ff3-b7b6-73dc77ca143c tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:39.992138 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-ef7c7c8d-7cce-4ff3-b7b6-73dc77ca143c tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:39.992556 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-ef7c7c8d-7cce-4ff3-b7b6-73dc77ca143c tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:39.993232 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-ef7c7c8d-7cce-4ff3-b7b6-73dc77ca143c tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:39.993670 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-ef7c7c8d-7cce-4ff3-b7b6-73dc77ca143c tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:39.994080 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-ef7c7c8d-7cce-4ff3-b7b6-73dc77ca143c tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:40.079426 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-8e4f31b3-3850-4645-abf1-b842849854f8 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c1beb321e44908ab987b17f7b74484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a2bf9a5a484523a700e4e6c568d4de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:33:40.086929 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-8e4f31b3-3850-4645-abf1-b842849854f8 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] 10.222.0.15 "GET /compute/v2.1/servers/ff125cf8-e8a5-4f00-ade9-045b18ee33f4" status: 200 len: 1364 microversion: 2.1 time: 0.153836 Oct 31 12:33:40.087705 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 57/107] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:33:39 2022] GET /compute/v2.1/servers/ff125cf8-e8a5-4f00-ade9-045b18ee33f4 => generated 1364 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:33:40.092232 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-8e9b6821-8685-40ff-b63c-e933df27da87 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:33:40.093241 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-8e9b6821-8685-40ff-b63c-e933df27da87 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] [instance: 9906becc-a42b-4b4c-855a-450915f7a3f8] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:33:40.098972 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-8e9b6821-8685-40ff-b63c-e933df27da87 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:40.099475 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-8e9b6821-8685-40ff-b63c-e933df27da87 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:40.099891 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-8e9b6821-8685-40ff-b63c-e933df27da87 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:40.100557 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-8e9b6821-8685-40ff-b63c-e933df27da87 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:40.100996 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-8e9b6821-8685-40ff-b63c-e933df27da87 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:40.101403 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-8e9b6821-8685-40ff-b63c-e933df27da87 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:40.126747 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-ef7c7c8d-7cce-4ff3-b7b6-73dc77ca143c tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d59ee6f94848308665a32099cf5255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4d5cd8851dc4216b4e3e035a32decad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:33:40.134563 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-ef7c7c8d-7cce-4ff3-b7b6-73dc77ca143c tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] 10.222.0.15 "GET /compute/v2.1/servers/8d254a92-15fa-4d98-8954-a8028647165e" status: 200 len: 1314 microversion: 2.1 time: 0.153651 Oct 31 12:33:40.135128 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 51/108] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:33:39 2022] GET /compute/v2.1/servers/8d254a92-15fa-4d98-8954-a8028647165e => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 12:33:40.233572 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-8e9b6821-8685-40ff-b63c-e933df27da87 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c03f0365ee4a26b8c076ae365325b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfbc3a46f12942299b99cdd20c989e1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:33:40.242944 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-8e9b6821-8685-40ff-b63c-e933df27da87 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] 10.222.0.15 "GET /compute/v2.1/servers/9906becc-a42b-4b4c-855a-450915f7a3f8" status: 200 len: 1366 microversion: 2.1 time: 0.153551 Oct 31 12:33:40.242944 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 58/109] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:33:40 2022] GET /compute/v2.1/servers/9906becc-a42b-4b4c-855a-450915f7a3f8 => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:33:40.266902 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-6f615322-c57b-4491-acb0-0e99d4b8e25e tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:33:40.267677 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-6f615322-c57b-4491-acb0-0e99d4b8e25e tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] [instance: d0befdd2-2ecd-4006-bfdd-86d5253a7687] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:33:40.274819 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-6f615322-c57b-4491-acb0-0e99d4b8e25e tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:40.275667 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-6f615322-c57b-4491-acb0-0e99d4b8e25e tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:40.276342 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-6f615322-c57b-4491-acb0-0e99d4b8e25e tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:40.277250 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-6f615322-c57b-4491-acb0-0e99d4b8e25e tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:40.277886 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-6f615322-c57b-4491-acb0-0e99d4b8e25e tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:40.278641 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-6f615322-c57b-4491-acb0-0e99d4b8e25e tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:40.368780 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-ad31be71-91f8-4a62-a6df-97b50da8dda7 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:33:40.369391 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-ad31be71-91f8-4a62-a6df-97b50da8dda7 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] [instance: 852e8870-b3ec-4a21-a9b5-e31a423ddd3d] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:33:40.377103 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-ad31be71-91f8-4a62-a6df-97b50da8dda7 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:40.377632 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-ad31be71-91f8-4a62-a6df-97b50da8dda7 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:40.378104 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-ad31be71-91f8-4a62-a6df-97b50da8dda7 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:40.378804 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-ad31be71-91f8-4a62-a6df-97b50da8dda7 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:40.379317 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-ad31be71-91f8-4a62-a6df-97b50da8dda7 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:40.379693 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-ad31be71-91f8-4a62-a6df-97b50da8dda7 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:40.658600 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-6f615322-c57b-4491-acb0-0e99d4b8e25e tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2e978bcb824a5e9d593b861c9e3bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7573cb9c503243ab90b1649591d550e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:33:40.667906 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-6f615322-c57b-4491-acb0-0e99d4b8e25e tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] 10.222.0.15 "GET /compute/v2.1/servers/d0befdd2-2ecd-4006-bfdd-86d5253a7687" status: 200 len: 1321 microversion: 2.1 time: 0.404799 Oct 31 12:33:40.668961 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 52/110] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:33:40 2022] GET /compute/v2.1/servers/d0befdd2-2ecd-4006-bfdd-86d5253a7687 => generated 1321 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:33:40.769539 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-ad31be71-91f8-4a62-a6df-97b50da8dda7 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:33:40.778142 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-ad31be71-91f8-4a62-a6df-97b50da8dda7 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:33:40.779735 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-ad31be71-91f8-4a62-a6df-97b50da8dda7 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:33:40.781650 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-ad31be71-91f8-4a62-a6df-97b50da8dda7 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] 10.222.0.15 "GET /compute/v2.1/servers/852e8870-b3ec-4a21-a9b5-e31a423ddd3d" status: 200 len: 1408 microversion: 2.20 time: 0.416317 Oct 31 12:33:40.782676 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 59/111] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Oct 31 12:33:40 2022] GET /compute/v2.1/servers/852e8870-b3ec-4a21-a9b5-e31a423ddd3d => generated 1408 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 12:33:41.111322 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-906d79d1-59bc-484c-9456-4b78c724eefd tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:33:41.112554 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-906d79d1-59bc-484c-9456-4b78c724eefd tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] [instance: ff125cf8-e8a5-4f00-ade9-045b18ee33f4] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:33:41.118765 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-906d79d1-59bc-484c-9456-4b78c724eefd tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:41.119459 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-906d79d1-59bc-484c-9456-4b78c724eefd tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:41.120265 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-906d79d1-59bc-484c-9456-4b78c724eefd tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:41.121189 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-906d79d1-59bc-484c-9456-4b78c724eefd tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:41.121633 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-906d79d1-59bc-484c-9456-4b78c724eefd tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:41.122285 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-906d79d1-59bc-484c-9456-4b78c724eefd tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:41.158381 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-cecb3662-5720-4de0-b89d-2b89b268ef1b tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:33:41.160230 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-cecb3662-5720-4de0-b89d-2b89b268ef1b tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] [instance: 8d254a92-15fa-4d98-8954-a8028647165e] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:33:41.168841 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-cecb3662-5720-4de0-b89d-2b89b268ef1b tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:41.169795 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-cecb3662-5720-4de0-b89d-2b89b268ef1b tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:41.170835 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-cecb3662-5720-4de0-b89d-2b89b268ef1b tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:41.173311 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-cecb3662-5720-4de0-b89d-2b89b268ef1b tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:41.174816 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-cecb3662-5720-4de0-b89d-2b89b268ef1b tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:41.176593 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-cecb3662-5720-4de0-b89d-2b89b268ef1b tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:41.332470 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-906d79d1-59bc-484c-9456-4b78c724eefd tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c1beb321e44908ab987b17f7b74484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a2bf9a5a484523a700e4e6c568d4de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:33:41.345228 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-906d79d1-59bc-484c-9456-4b78c724eefd tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] 10.222.0.15 "GET /compute/v2.1/servers/ff125cf8-e8a5-4f00-ade9-045b18ee33f4" status: 200 len: 1364 microversion: 2.1 time: 0.238179 Oct 31 12:33:41.357768 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 53/112] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:33:41 2022] GET /compute/v2.1/servers/ff125cf8-e8a5-4f00-ade9-045b18ee33f4 => generated 1364 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:33:41.373101 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-1a9abb51-af1d-4baa-959c-4893c03b3ceb tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:33:41.373723 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-1a9abb51-af1d-4baa-959c-4893c03b3ceb tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] [instance: 9906becc-a42b-4b4c-855a-450915f7a3f8] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:33:41.381867 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-1a9abb51-af1d-4baa-959c-4893c03b3ceb tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:41.382882 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-1a9abb51-af1d-4baa-959c-4893c03b3ceb tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:41.384835 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-1a9abb51-af1d-4baa-959c-4893c03b3ceb tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:41.385733 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-1a9abb51-af1d-4baa-959c-4893c03b3ceb tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:41.386338 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-1a9abb51-af1d-4baa-959c-4893c03b3ceb tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:41.387416 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-1a9abb51-af1d-4baa-959c-4893c03b3ceb tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:41.425226 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-cecb3662-5720-4de0-b89d-2b89b268ef1b tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d59ee6f94848308665a32099cf5255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4d5cd8851dc4216b4e3e035a32decad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:33:41.435833 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-cecb3662-5720-4de0-b89d-2b89b268ef1b tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] 10.222.0.15 "GET /compute/v2.1/servers/8d254a92-15fa-4d98-8954-a8028647165e" status: 200 len: 1314 microversion: 2.1 time: 0.281728 Oct 31 12:33:41.437011 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 60/113] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:33:41 2022] GET /compute/v2.1/servers/8d254a92-15fa-4d98-8954-a8028647165e => generated 1314 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:33:41.538122 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [req-d1781351-94b5-417d-9c7c-b2a6e2a276ad req-fcd7b3ce-e852-4095-a18c-8790ade39487 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d254a92-15fa-4d98-8954-a8028647165e", "name": "network-vif-plugged", "status": "completed", "tag": "526d397e-43ed-4b15-84f5-0072c801c1b0"}]} {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 12:33:41.550829 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [req-d1781351-94b5-417d-9c7c-b2a6e2a276ad req-fcd7b3ce-e852-4095-a18c-8790ade39487 service nova] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:41.551574 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [req-d1781351-94b5-417d-9c7c-b2a6e2a276ad req-fcd7b3ce-e852-4095-a18c-8790ade39487 service nova] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:41.568442 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [req-d1781351-94b5-417d-9c7c-b2a6e2a276ad req-fcd7b3ce-e852-4095-a18c-8790ade39487 service nova] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:41.597345 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.compute.server_external_events [req-d1781351-94b5-417d-9c7c-b2a6e2a276ad req-fcd7b3ce-e852-4095-a18c-8790ade39487 service nova] Creating event network-vif-plugged:526d397e-43ed-4b15-84f5-0072c801c1b0 for instance 8d254a92-15fa-4d98-8954-a8028647165e on hv-cinder-79617 Oct 31 12:33:41.615552 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-1a9abb51-af1d-4baa-959c-4893c03b3ceb tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c03f0365ee4a26b8c076ae365325b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfbc3a46f12942299b99cdd20c989e1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:33:41.616148 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [req-d1781351-94b5-417d-9c7c-b2a6e2a276ad req-fcd7b3ce-e852-4095-a18c-8790ade39487 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.176312 Oct 31 12:33:41.618194 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 61/114] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Oct 31 12:33:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 12:33:41.646639 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-1a9abb51-af1d-4baa-959c-4893c03b3ceb tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] 10.222.0.15 "GET /compute/v2.1/servers/9906becc-a42b-4b4c-855a-450915f7a3f8" status: 200 len: 1366 microversion: 2.1 time: 0.283143 Oct 31 12:33:41.647246 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 54/115] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:33:41 2022] GET /compute/v2.1/servers/9906becc-a42b-4b4c-855a-450915f7a3f8 => generated 1366 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:33:41.705195 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-691aa8ea-14d7-47a1-a994-99476b3556bc tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:33:41.706828 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-691aa8ea-14d7-47a1-a994-99476b3556bc tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] [instance: d0befdd2-2ecd-4006-bfdd-86d5253a7687] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:33:41.714958 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-691aa8ea-14d7-47a1-a994-99476b3556bc tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:41.715644 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-691aa8ea-14d7-47a1-a994-99476b3556bc tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:41.716167 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-691aa8ea-14d7-47a1-a994-99476b3556bc tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:41.718158 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-691aa8ea-14d7-47a1-a994-99476b3556bc tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:41.718868 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-691aa8ea-14d7-47a1-a994-99476b3556bc tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:41.719546 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-691aa8ea-14d7-47a1-a994-99476b3556bc tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:41.812067 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-4460e4de-f3cf-4a1c-9387-c95178d76381 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:33:41.812673 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-4460e4de-f3cf-4a1c-9387-c95178d76381 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] [instance: 852e8870-b3ec-4a21-a9b5-e31a423ddd3d] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:33:41.820775 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-4460e4de-f3cf-4a1c-9387-c95178d76381 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:41.821259 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-4460e4de-f3cf-4a1c-9387-c95178d76381 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:41.821788 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-4460e4de-f3cf-4a1c-9387-c95178d76381 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:41.822774 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-4460e4de-f3cf-4a1c-9387-c95178d76381 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:41.823248 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-4460e4de-f3cf-4a1c-9387-c95178d76381 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:41.824374 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-4460e4de-f3cf-4a1c-9387-c95178d76381 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:41.843506 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG dbcounter [-] [125441] Writing DB stats nova_cell1:SELECT=100 {{(pid=125441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:33:42.184672 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-4460e4de-f3cf-4a1c-9387-c95178d76381 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:33:42.192964 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-4460e4de-f3cf-4a1c-9387-c95178d76381 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:33:42.194418 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-4460e4de-f3cf-4a1c-9387-c95178d76381 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:33:42.195555 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-4460e4de-f3cf-4a1c-9387-c95178d76381 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] 10.222.0.15 "GET /compute/v2.1/servers/852e8870-b3ec-4a21-a9b5-e31a423ddd3d" status: 200 len: 1408 microversion: 2.20 time: 0.387853 Oct 31 12:33:42.196368 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 55/116] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Oct 31 12:33:41 2022] GET /compute/v2.1/servers/852e8870-b3ec-4a21-a9b5-e31a423ddd3d => generated 1408 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 12:33:42.368502 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-7f98b972-8f94-4e54-8874-7921e6d26c60 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:33:42.369358 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-7f98b972-8f94-4e54-8874-7921e6d26c60 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] [instance: ff125cf8-e8a5-4f00-ade9-045b18ee33f4] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:33:42.383680 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-7f98b972-8f94-4e54-8874-7921e6d26c60 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:42.383680 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-7f98b972-8f94-4e54-8874-7921e6d26c60 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:42.383680 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-7f98b972-8f94-4e54-8874-7921e6d26c60 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:42.383680 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-7f98b972-8f94-4e54-8874-7921e6d26c60 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:42.383945 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-7f98b972-8f94-4e54-8874-7921e6d26c60 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:42.383945 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-7f98b972-8f94-4e54-8874-7921e6d26c60 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:42.567754 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-691aa8ea-14d7-47a1-a994-99476b3556bc tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2e978bcb824a5e9d593b861c9e3bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7573cb9c503243ab90b1649591d550e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:33:42.584438 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-691aa8ea-14d7-47a1-a994-99476b3556bc tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] 10.222.0.15 "GET /compute/v2.1/servers/d0befdd2-2ecd-4006-bfdd-86d5253a7687" status: 200 len: 1321 microversion: 2.1 time: 0.885478 Oct 31 12:33:42.586669 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 62/117] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:33:41 2022] GET /compute/v2.1/servers/d0befdd2-2ecd-4006-bfdd-86d5253a7687 => generated 1321 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:33:42.612888 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-7fa1fce5-7799-4fc4-9644-ed5dfec66d33 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:33:42.613493 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-7fa1fce5-7799-4fc4-9644-ed5dfec66d33 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] [instance: 8d254a92-15fa-4d98-8954-a8028647165e] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:33:42.636534 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-7fa1fce5-7799-4fc4-9644-ed5dfec66d33 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:42.637219 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-7fa1fce5-7799-4fc4-9644-ed5dfec66d33 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:42.638851 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-7fa1fce5-7799-4fc4-9644-ed5dfec66d33 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:42.643438 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-7fa1fce5-7799-4fc4-9644-ed5dfec66d33 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:42.647890 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-7fa1fce5-7799-4fc4-9644-ed5dfec66d33 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:42.649397 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-7fa1fce5-7799-4fc4-9644-ed5dfec66d33 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:42.795182 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-7f98b972-8f94-4e54-8874-7921e6d26c60 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c1beb321e44908ab987b17f7b74484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a2bf9a5a484523a700e4e6c568d4de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:33:42.804205 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-7f98b972-8f94-4e54-8874-7921e6d26c60 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] 10.222.0.15 "GET /compute/v2.1/servers/ff125cf8-e8a5-4f00-ade9-045b18ee33f4" status: 200 len: 1364 microversion: 2.1 time: 0.439432 Oct 31 12:33:42.804795 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 56/118] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:33:42 2022] GET /compute/v2.1/servers/ff125cf8-e8a5-4f00-ade9-045b18ee33f4 => generated 1364 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:33:42.814936 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-cf4fda9c-d611-4ecb-81d3-412344d67925 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:33:42.815579 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-cf4fda9c-d611-4ecb-81d3-412344d67925 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] [instance: 9906becc-a42b-4b4c-855a-450915f7a3f8] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:33:42.829708 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-cf4fda9c-d611-4ecb-81d3-412344d67925 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:42.830234 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-cf4fda9c-d611-4ecb-81d3-412344d67925 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:42.831715 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-cf4fda9c-d611-4ecb-81d3-412344d67925 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:42.832094 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-cf4fda9c-d611-4ecb-81d3-412344d67925 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:42.844105 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-cf4fda9c-d611-4ecb-81d3-412344d67925 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:42.844654 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-cf4fda9c-d611-4ecb-81d3-412344d67925 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:43.077103 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-cf4fda9c-d611-4ecb-81d3-412344d67925 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c03f0365ee4a26b8c076ae365325b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfbc3a46f12942299b99cdd20c989e1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:33:43.089115 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-cf4fda9c-d611-4ecb-81d3-412344d67925 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] 10.222.0.15 "GET /compute/v2.1/servers/9906becc-a42b-4b4c-855a-450915f7a3f8" status: 200 len: 1366 microversion: 2.1 time: 0.280021 Oct 31 12:33:43.090532 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 57/119] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:33:42 2022] GET /compute/v2.1/servers/9906becc-a42b-4b4c-855a-450915f7a3f8 => generated 1366 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:33:43.226242 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-013646e6-2a07-47e9-8326-778135193f9b tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:33:43.227613 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-013646e6-2a07-47e9-8326-778135193f9b tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] [instance: 852e8870-b3ec-4a21-a9b5-e31a423ddd3d] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:33:43.235197 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-013646e6-2a07-47e9-8326-778135193f9b tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:43.235979 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-013646e6-2a07-47e9-8326-778135193f9b tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:43.236463 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-013646e6-2a07-47e9-8326-778135193f9b tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:43.238266 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-013646e6-2a07-47e9-8326-778135193f9b tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:43.238800 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-013646e6-2a07-47e9-8326-778135193f9b tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:43.239522 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-013646e6-2a07-47e9-8326-778135193f9b tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:43.249927 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-7fa1fce5-7799-4fc4-9644-ed5dfec66d33 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d59ee6f94848308665a32099cf5255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4d5cd8851dc4216b4e3e035a32decad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:33:43.258632 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-7fa1fce5-7799-4fc4-9644-ed5dfec66d33 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] 10.222.0.15 "GET /compute/v2.1/servers/8d254a92-15fa-4d98-8954-a8028647165e" status: 200 len: 1314 microversion: 2.1 time: 0.650206 Oct 31 12:33:43.259859 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 63/120] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:33:42 2022] GET /compute/v2.1/servers/8d254a92-15fa-4d98-8954-a8028647165e => generated 1314 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:33:43.470183 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-013646e6-2a07-47e9-8326-778135193f9b tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:33:43.490884 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-013646e6-2a07-47e9-8326-778135193f9b tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:33:43.492912 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-013646e6-2a07-47e9-8326-778135193f9b tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:33:43.494367 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-013646e6-2a07-47e9-8326-778135193f9b tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] 10.222.0.15 "GET /compute/v2.1/servers/852e8870-b3ec-4a21-a9b5-e31a423ddd3d" status: 200 len: 1408 microversion: 2.20 time: 0.272191 Oct 31 12:33:43.495137 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 58/121] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Oct 31 12:33:43 2022] GET /compute/v2.1/servers/852e8870-b3ec-4a21-a9b5-e31a423ddd3d => generated 1408 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 12:33:43.612929 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-13b496c7-f8c1-4c16-8bef-bae1c67a7029 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:33:43.613665 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-13b496c7-f8c1-4c16-8bef-bae1c67a7029 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] [instance: d0befdd2-2ecd-4006-bfdd-86d5253a7687] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:33:43.619562 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-13b496c7-f8c1-4c16-8bef-bae1c67a7029 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:43.620184 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-13b496c7-f8c1-4c16-8bef-bae1c67a7029 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:43.620433 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-13b496c7-f8c1-4c16-8bef-bae1c67a7029 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:43.621313 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-13b496c7-f8c1-4c16-8bef-bae1c67a7029 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:43.621932 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-13b496c7-f8c1-4c16-8bef-bae1c67a7029 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:43.622518 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-13b496c7-f8c1-4c16-8bef-bae1c67a7029 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:43.628350 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG dbcounter [-] [125440] Writing DB stats nova_cell1:SELECT=100 {{(pid=125440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:33:43.635106 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [req-bb78670b-75bb-4bde-8a0b-b99d26284026 req-e17c7b64-10af-4360-92e7-140926323dd9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d33a2d6b-f17c-4ce3-ad33-9086d790495d", "name": "network-vif-plugged", "status": "completed", "tag": "a33f2616-bbbf-49fa-87ab-2b1769bc0111"}, {"server_uuid": "ff125cf8-e8a5-4f00-ade9-045b18ee33f4", "name": "network-vif-plugged", "status": "completed", "tag": "f9ca4955-7ad3-407e-b90d-7bad757cb1d8"}]} {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 12:33:43.653006 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [req-bb78670b-75bb-4bde-8a0b-b99d26284026 req-e17c7b64-10af-4360-92e7-140926323dd9 service nova] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:43.653486 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [req-bb78670b-75bb-4bde-8a0b-b99d26284026 req-e17c7b64-10af-4360-92e7-140926323dd9 service nova] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:43.653903 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [req-bb78670b-75bb-4bde-8a0b-b99d26284026 req-e17c7b64-10af-4360-92e7-140926323dd9 service nova] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:43.677603 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.compute.server_external_events [req-bb78670b-75bb-4bde-8a0b-b99d26284026 req-e17c7b64-10af-4360-92e7-140926323dd9 service nova] Creating event network-vif-plugged:a33f2616-bbbf-49fa-87ab-2b1769bc0111 for instance d33a2d6b-f17c-4ce3-ad33-9086d790495d on hv-cinder-79617 Oct 31 12:33:43.678103 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.compute.server_external_events [req-bb78670b-75bb-4bde-8a0b-b99d26284026 req-e17c7b64-10af-4360-92e7-140926323dd9 service nova] Creating event network-vif-plugged:f9ca4955-7ad3-407e-b90d-7bad757cb1d8 for instance ff125cf8-e8a5-4f00-ade9-045b18ee33f4 on hv-cinder-79617 Oct 31 12:33:43.685634 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [req-bb78670b-75bb-4bde-8a0b-b99d26284026 req-e17c7b64-10af-4360-92e7-140926323dd9 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.054745 Oct 31 12:33:43.686419 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 59/122] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Oct 31 12:33:43 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 12:33:43.830434 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-42da76a2-b965-4ed0-8140-398700306dc8 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:33:43.831124 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-42da76a2-b965-4ed0-8140-398700306dc8 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] [instance: ff125cf8-e8a5-4f00-ade9-045b18ee33f4] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:33:43.843127 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-42da76a2-b965-4ed0-8140-398700306dc8 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:43.844835 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-13b496c7-f8c1-4c16-8bef-bae1c67a7029 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2e978bcb824a5e9d593b861c9e3bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7573cb9c503243ab90b1649591d550e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:33:43.848310 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-42da76a2-b965-4ed0-8140-398700306dc8 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:43.850269 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-42da76a2-b965-4ed0-8140-398700306dc8 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:43.851793 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-42da76a2-b965-4ed0-8140-398700306dc8 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:43.853567 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-13b496c7-f8c1-4c16-8bef-bae1c67a7029 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] 10.222.0.15 "GET /compute/v2.1/servers/d0befdd2-2ecd-4006-bfdd-86d5253a7687" status: 200 len: 1321 microversion: 2.1 time: 0.245042 Oct 31 12:33:43.853863 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-42da76a2-b965-4ed0-8140-398700306dc8 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:43.854169 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 64/123] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:33:43 2022] GET /compute/v2.1/servers/d0befdd2-2ecd-4006-bfdd-86d5253a7687 => generated 1321 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:33:43.856348 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-42da76a2-b965-4ed0-8140-398700306dc8 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:44.017009 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-42da76a2-b965-4ed0-8140-398700306dc8 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c1beb321e44908ab987b17f7b74484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a2bf9a5a484523a700e4e6c568d4de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:33:44.034735 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-42da76a2-b965-4ed0-8140-398700306dc8 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] 10.222.0.15 "GET /compute/v2.1/servers/ff125cf8-e8a5-4f00-ade9-045b18ee33f4" status: 200 len: 1364 microversion: 2.1 time: 0.208599 Oct 31 12:33:44.035589 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 60/124] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:33:43 2022] GET /compute/v2.1/servers/ff125cf8-e8a5-4f00-ade9-045b18ee33f4 => generated 1364 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 12:33:44.114722 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-e692834f-4926-4d5a-94ce-a282a9e663be tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:33:44.115445 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-e692834f-4926-4d5a-94ce-a282a9e663be tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] [instance: 9906becc-a42b-4b4c-855a-450915f7a3f8] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:33:44.122720 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-e692834f-4926-4d5a-94ce-a282a9e663be tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:44.123533 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-e692834f-4926-4d5a-94ce-a282a9e663be tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:44.124000 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-e692834f-4926-4d5a-94ce-a282a9e663be tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:44.124757 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-e692834f-4926-4d5a-94ce-a282a9e663be tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:44.125314 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-e692834f-4926-4d5a-94ce-a282a9e663be tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:44.126243 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-e692834f-4926-4d5a-94ce-a282a9e663be tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:44.281814 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-aac3b5a8-2784-4699-b5ab-599f59d7bf4b tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:33:44.282416 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-aac3b5a8-2784-4699-b5ab-599f59d7bf4b tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] [instance: 8d254a92-15fa-4d98-8954-a8028647165e] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:33:44.290043 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-aac3b5a8-2784-4699-b5ab-599f59d7bf4b tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:44.290790 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-aac3b5a8-2784-4699-b5ab-599f59d7bf4b tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:44.291492 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-aac3b5a8-2784-4699-b5ab-599f59d7bf4b tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:44.292175 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-aac3b5a8-2784-4699-b5ab-599f59d7bf4b tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:44.293081 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-aac3b5a8-2784-4699-b5ab-599f59d7bf4b tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:44.293767 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-aac3b5a8-2784-4699-b5ab-599f59d7bf4b tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:44.326378 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-e692834f-4926-4d5a-94ce-a282a9e663be tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c03f0365ee4a26b8c076ae365325b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfbc3a46f12942299b99cdd20c989e1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:33:44.337315 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-e692834f-4926-4d5a-94ce-a282a9e663be tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] 10.222.0.15 "GET /compute/v2.1/servers/9906becc-a42b-4b4c-855a-450915f7a3f8" status: 200 len: 1366 microversion: 2.1 time: 0.227577 Oct 31 12:33:44.351815 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 65/125] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:33:44 2022] GET /compute/v2.1/servers/9906becc-a42b-4b4c-855a-450915f7a3f8 => generated 1366 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:33:44.476405 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-aac3b5a8-2784-4699-b5ab-599f59d7bf4b tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d59ee6f94848308665a32099cf5255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4d5cd8851dc4216b4e3e035a32decad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:33:44.484035 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-aac3b5a8-2784-4699-b5ab-599f59d7bf4b tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] 10.222.0.15 "GET /compute/v2.1/servers/8d254a92-15fa-4d98-8954-a8028647165e" status: 200 len: 1314 microversion: 2.1 time: 0.206009 Oct 31 12:33:44.484603 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 61/126] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:33:44 2022] GET /compute/v2.1/servers/8d254a92-15fa-4d98-8954-a8028647165e => generated 1314 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:33:44.522511 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-08faba3a-ab12-422c-9c50-481a7a96a2a8 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:33:44.523203 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-08faba3a-ab12-422c-9c50-481a7a96a2a8 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] [instance: 852e8870-b3ec-4a21-a9b5-e31a423ddd3d] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:33:44.529498 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-08faba3a-ab12-422c-9c50-481a7a96a2a8 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:44.530192 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-08faba3a-ab12-422c-9c50-481a7a96a2a8 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:44.530788 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-08faba3a-ab12-422c-9c50-481a7a96a2a8 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:44.531554 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-08faba3a-ab12-422c-9c50-481a7a96a2a8 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:44.532004 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-08faba3a-ab12-422c-9c50-481a7a96a2a8 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:44.532546 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-08faba3a-ab12-422c-9c50-481a7a96a2a8 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:44.676008 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-08faba3a-ab12-422c-9c50-481a7a96a2a8 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:33:44.685763 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-08faba3a-ab12-422c-9c50-481a7a96a2a8 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:33:44.687328 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-08faba3a-ab12-422c-9c50-481a7a96a2a8 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:33:44.688486 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-08faba3a-ab12-422c-9c50-481a7a96a2a8 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] 10.222.0.15 "GET /compute/v2.1/servers/852e8870-b3ec-4a21-a9b5-e31a423ddd3d" status: 200 len: 1408 microversion: 2.20 time: 0.172175 Oct 31 12:33:44.689030 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 66/127] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Oct 31 12:33:44 2022] GET /compute/v2.1/servers/852e8870-b3ec-4a21-a9b5-e31a423ddd3d => generated 1408 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 12:33:44.881252 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-c092e7d0-935e-4c29-996b-c1b7237f394f tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:33:44.888085 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-c092e7d0-935e-4c29-996b-c1b7237f394f tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] [instance: d0befdd2-2ecd-4006-bfdd-86d5253a7687] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:33:44.894715 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-c092e7d0-935e-4c29-996b-c1b7237f394f tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:44.895132 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-c092e7d0-935e-4c29-996b-c1b7237f394f tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:44.895840 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-c092e7d0-935e-4c29-996b-c1b7237f394f tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:44.896523 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-c092e7d0-935e-4c29-996b-c1b7237f394f tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:44.896967 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-c092e7d0-935e-4c29-996b-c1b7237f394f tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:44.897379 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-c092e7d0-935e-4c29-996b-c1b7237f394f tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:45.052093 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-c092e7d0-935e-4c29-996b-c1b7237f394f tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2e978bcb824a5e9d593b861c9e3bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7573cb9c503243ab90b1649591d550e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:33:45.059434 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-8e2adba6-06af-489e-bfbe-2606ffcf1cdf tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:33:45.060268 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-8e2adba6-06af-489e-bfbe-2606ffcf1cdf tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] [instance: ff125cf8-e8a5-4f00-ade9-045b18ee33f4] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:33:45.062118 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-c092e7d0-935e-4c29-996b-c1b7237f394f tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] 10.222.0.15 "GET /compute/v2.1/servers/d0befdd2-2ecd-4006-bfdd-86d5253a7687" status: 200 len: 1321 microversion: 2.1 time: 0.187467 Oct 31 12:33:45.071978 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-8e2adba6-06af-489e-bfbe-2606ffcf1cdf tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:45.072657 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-8e2adba6-06af-489e-bfbe-2606ffcf1cdf tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:45.073459 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-8e2adba6-06af-489e-bfbe-2606ffcf1cdf tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:45.074078 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 62/128] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:33:44 2022] GET /compute/v2.1/servers/d0befdd2-2ecd-4006-bfdd-86d5253a7687 => generated 1321 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:33:45.075048 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-8e2adba6-06af-489e-bfbe-2606ffcf1cdf tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:45.075709 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-8e2adba6-06af-489e-bfbe-2606ffcf1cdf tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:45.076878 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-8e2adba6-06af-489e-bfbe-2606ffcf1cdf tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:45.255580 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-8e2adba6-06af-489e-bfbe-2606ffcf1cdf tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c1beb321e44908ab987b17f7b74484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a2bf9a5a484523a700e4e6c568d4de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:33:45.262840 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-8e2adba6-06af-489e-bfbe-2606ffcf1cdf tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] 10.222.0.15 "GET /compute/v2.1/servers/ff125cf8-e8a5-4f00-ade9-045b18ee33f4" status: 200 len: 1364 microversion: 2.1 time: 0.208720 Oct 31 12:33:45.263429 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 67/129] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:33:45 2022] GET /compute/v2.1/servers/ff125cf8-e8a5-4f00-ade9-045b18ee33f4 => generated 1364 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 12:33:45.360806 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-652a52d3-bc11-46e6-8ee6-24d65eb134f4 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:33:45.361438 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-652a52d3-bc11-46e6-8ee6-24d65eb134f4 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] [instance: 9906becc-a42b-4b4c-855a-450915f7a3f8] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:33:45.369029 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-652a52d3-bc11-46e6-8ee6-24d65eb134f4 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:45.369558 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-652a52d3-bc11-46e6-8ee6-24d65eb134f4 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:45.370198 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-652a52d3-bc11-46e6-8ee6-24d65eb134f4 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:45.370927 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-652a52d3-bc11-46e6-8ee6-24d65eb134f4 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:45.371559 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-652a52d3-bc11-46e6-8ee6-24d65eb134f4 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:45.372209 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-652a52d3-bc11-46e6-8ee6-24d65eb134f4 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:45.508290 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-874dccdf-9c77-4473-88a3-0809169b05b3 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:33:45.508890 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-874dccdf-9c77-4473-88a3-0809169b05b3 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] [instance: 8d254a92-15fa-4d98-8954-a8028647165e] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:33:45.514816 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-874dccdf-9c77-4473-88a3-0809169b05b3 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:45.515690 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-874dccdf-9c77-4473-88a3-0809169b05b3 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:45.516307 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-874dccdf-9c77-4473-88a3-0809169b05b3 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:45.516988 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-874dccdf-9c77-4473-88a3-0809169b05b3 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:45.517579 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-874dccdf-9c77-4473-88a3-0809169b05b3 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:45.518199 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-874dccdf-9c77-4473-88a3-0809169b05b3 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:45.526816 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-652a52d3-bc11-46e6-8ee6-24d65eb134f4 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c03f0365ee4a26b8c076ae365325b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfbc3a46f12942299b99cdd20c989e1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:33:45.535558 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-652a52d3-bc11-46e6-8ee6-24d65eb134f4 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] 10.222.0.15 "GET /compute/v2.1/servers/9906becc-a42b-4b4c-855a-450915f7a3f8" status: 200 len: 1366 microversion: 2.1 time: 0.178674 Oct 31 12:33:45.536975 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 63/130] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:33:45 2022] GET /compute/v2.1/servers/9906becc-a42b-4b4c-855a-450915f7a3f8 => generated 1366 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:33:45.716649 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-7824948a-4f5f-431b-8084-f90845ee505a tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:33:45.717690 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-7824948a-4f5f-431b-8084-f90845ee505a tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] [instance: 852e8870-b3ec-4a21-a9b5-e31a423ddd3d] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:33:45.724608 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-7824948a-4f5f-431b-8084-f90845ee505a tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:45.725526 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-7824948a-4f5f-431b-8084-f90845ee505a tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:45.726297 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-7824948a-4f5f-431b-8084-f90845ee505a tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:45.727290 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-7824948a-4f5f-431b-8084-f90845ee505a tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:45.728317 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-7824948a-4f5f-431b-8084-f90845ee505a tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:45.728942 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-7824948a-4f5f-431b-8084-f90845ee505a tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:45.746351 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-874dccdf-9c77-4473-88a3-0809169b05b3 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d59ee6f94848308665a32099cf5255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4d5cd8851dc4216b4e3e035a32decad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:33:45.754985 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-874dccdf-9c77-4473-88a3-0809169b05b3 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] 10.222.0.15 "GET /compute/v2.1/servers/8d254a92-15fa-4d98-8954-a8028647165e" status: 200 len: 1314 microversion: 2.1 time: 0.250409 Oct 31 12:33:45.771387 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 68/131] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:33:45 2022] GET /compute/v2.1/servers/8d254a92-15fa-4d98-8954-a8028647165e => generated 1314 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:33:45.899681 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-7824948a-4f5f-431b-8084-f90845ee505a tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:33:45.912078 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-7824948a-4f5f-431b-8084-f90845ee505a tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:33:45.914157 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-7824948a-4f5f-431b-8084-f90845ee505a tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:33:45.916273 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-7824948a-4f5f-431b-8084-f90845ee505a tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] 10.222.0.15 "GET /compute/v2.1/servers/852e8870-b3ec-4a21-a9b5-e31a423ddd3d" status: 200 len: 1408 microversion: 2.20 time: 0.205711 Oct 31 12:33:45.917481 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 64/132] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Oct 31 12:33:45 2022] GET /compute/v2.1/servers/852e8870-b3ec-4a21-a9b5-e31a423ddd3d => generated 1408 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 12:33:46.085762 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-e96531a0-9404-4448-98cf-1bd5678e6696 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:33:46.086644 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-e96531a0-9404-4448-98cf-1bd5678e6696 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] [instance: d0befdd2-2ecd-4006-bfdd-86d5253a7687] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:33:46.095114 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-e96531a0-9404-4448-98cf-1bd5678e6696 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:46.097364 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-e96531a0-9404-4448-98cf-1bd5678e6696 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:46.098263 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-e96531a0-9404-4448-98cf-1bd5678e6696 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:46.099098 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-e96531a0-9404-4448-98cf-1bd5678e6696 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:46.099669 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-e96531a0-9404-4448-98cf-1bd5678e6696 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:46.100759 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-e96531a0-9404-4448-98cf-1bd5678e6696 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:46.240426 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-e96531a0-9404-4448-98cf-1bd5678e6696 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2e978bcb824a5e9d593b861c9e3bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7573cb9c503243ab90b1649591d550e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:33:46.249923 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-e96531a0-9404-4448-98cf-1bd5678e6696 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] 10.222.0.15 "GET /compute/v2.1/servers/d0befdd2-2ecd-4006-bfdd-86d5253a7687" status: 200 len: 1321 microversion: 2.1 time: 0.168088 Oct 31 12:33:46.250867 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 69/133] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:33:46 2022] GET /compute/v2.1/servers/d0befdd2-2ecd-4006-bfdd-86d5253a7687 => generated 1321 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:33:46.290057 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-a22b8d81-8bf0-4e01-b153-355cdf1ae48c tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:33:46.290757 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-a22b8d81-8bf0-4e01-b153-355cdf1ae48c tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] [instance: ff125cf8-e8a5-4f00-ade9-045b18ee33f4] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:33:46.296900 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-a22b8d81-8bf0-4e01-b153-355cdf1ae48c tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:46.297467 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-a22b8d81-8bf0-4e01-b153-355cdf1ae48c tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:46.298141 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-a22b8d81-8bf0-4e01-b153-355cdf1ae48c tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:46.299230 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-a22b8d81-8bf0-4e01-b153-355cdf1ae48c tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:46.299694 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-a22b8d81-8bf0-4e01-b153-355cdf1ae48c tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:46.300115 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-a22b8d81-8bf0-4e01-b153-355cdf1ae48c tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:46.488630 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-a22b8d81-8bf0-4e01-b153-355cdf1ae48c tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c1beb321e44908ab987b17f7b74484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a2bf9a5a484523a700e4e6c568d4de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:33:46.497489 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-a22b8d81-8bf0-4e01-b153-355cdf1ae48c tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] 10.222.0.15 "GET /compute/v2.1/servers/ff125cf8-e8a5-4f00-ade9-045b18ee33f4" status: 200 len: 1364 microversion: 2.1 time: 0.213000 Oct 31 12:33:46.498202 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 65/134] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:33:46 2022] GET /compute/v2.1/servers/ff125cf8-e8a5-4f00-ade9-045b18ee33f4 => generated 1364 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:33:46.564301 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-c21e6612-5261-4188-b7a5-d32e22936cfc tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:33:46.565654 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-c21e6612-5261-4188-b7a5-d32e22936cfc tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] [instance: 9906becc-a42b-4b4c-855a-450915f7a3f8] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:33:46.576419 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-c21e6612-5261-4188-b7a5-d32e22936cfc tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:46.576897 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-c21e6612-5261-4188-b7a5-d32e22936cfc tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:46.577318 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-c21e6612-5261-4188-b7a5-d32e22936cfc tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:46.578176 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-c21e6612-5261-4188-b7a5-d32e22936cfc tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:46.578615 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-c21e6612-5261-4188-b7a5-d32e22936cfc tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:46.579021 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-c21e6612-5261-4188-b7a5-d32e22936cfc tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:46.736249 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-c21e6612-5261-4188-b7a5-d32e22936cfc tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c03f0365ee4a26b8c076ae365325b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfbc3a46f12942299b99cdd20c989e1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:33:46.745558 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-c21e6612-5261-4188-b7a5-d32e22936cfc tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] 10.222.0.15 "GET /compute/v2.1/servers/9906becc-a42b-4b4c-855a-450915f7a3f8" status: 200 len: 1366 microversion: 2.1 time: 0.185595 Oct 31 12:33:46.746526 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 70/135] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:33:46 2022] GET /compute/v2.1/servers/9906becc-a42b-4b4c-855a-450915f7a3f8 => generated 1366 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:33:46.779509 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-54b566c6-eb06-4235-9ac2-becb3b553512 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:33:46.780120 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-54b566c6-eb06-4235-9ac2-becb3b553512 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] [instance: 8d254a92-15fa-4d98-8954-a8028647165e] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:33:46.786758 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-54b566c6-eb06-4235-9ac2-becb3b553512 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:46.787529 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-54b566c6-eb06-4235-9ac2-becb3b553512 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:46.787955 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-54b566c6-eb06-4235-9ac2-becb3b553512 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:46.788655 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-54b566c6-eb06-4235-9ac2-becb3b553512 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:46.789100 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-54b566c6-eb06-4235-9ac2-becb3b553512 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:46.789680 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-54b566c6-eb06-4235-9ac2-becb3b553512 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:46.948055 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-4cd9f4dc-b003-4e12-a030-c8dea896c843 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:33:46.948535 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-54b566c6-eb06-4235-9ac2-becb3b553512 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d59ee6f94848308665a32099cf5255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4d5cd8851dc4216b4e3e035a32decad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:33:46.949082 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-4cd9f4dc-b003-4e12-a030-c8dea896c843 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] [instance: 852e8870-b3ec-4a21-a9b5-e31a423ddd3d] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:33:46.958874 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-4cd9f4dc-b003-4e12-a030-c8dea896c843 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:46.959824 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-4cd9f4dc-b003-4e12-a030-c8dea896c843 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:46.960272 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-4cd9f4dc-b003-4e12-a030-c8dea896c843 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:46.960967 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-4cd9f4dc-b003-4e12-a030-c8dea896c843 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:46.961552 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-4cd9f4dc-b003-4e12-a030-c8dea896c843 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:46.962410 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-4cd9f4dc-b003-4e12-a030-c8dea896c843 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:46.975519 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-54b566c6-eb06-4235-9ac2-becb3b553512 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] 10.222.0.15 "GET /compute/v2.1/servers/8d254a92-15fa-4d98-8954-a8028647165e" status: 200 len: 1314 microversion: 2.1 time: 0.198730 Oct 31 12:33:46.976122 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 66/136] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:33:46 2022] GET /compute/v2.1/servers/8d254a92-15fa-4d98-8954-a8028647165e => generated 1314 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:33:47.267222 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-4cd9f4dc-b003-4e12-a030-c8dea896c843 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:33:47.278501 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-3402563c-bae1-41f2-b939-05742abe8436 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:33:47.279189 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-4cd9f4dc-b003-4e12-a030-c8dea896c843 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:33:47.280343 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-3402563c-bae1-41f2-b939-05742abe8436 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] [instance: d0befdd2-2ecd-4006-bfdd-86d5253a7687] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:33:47.280611 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-4cd9f4dc-b003-4e12-a030-c8dea896c843 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:33:47.281715 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-4cd9f4dc-b003-4e12-a030-c8dea896c843 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] 10.222.0.15 "GET /compute/v2.1/servers/852e8870-b3ec-4a21-a9b5-e31a423ddd3d" status: 200 len: 1408 microversion: 2.20 time: 0.339151 Oct 31 12:33:47.282272 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 71/137] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Oct 31 12:33:46 2022] GET /compute/v2.1/servers/852e8870-b3ec-4a21-a9b5-e31a423ddd3d => generated 1408 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 12:33:47.295907 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG dbcounter [-] [125441] Writing DB stats nova_api:SELECT=100 {{(pid=125441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:33:47.298800 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-3402563c-bae1-41f2-b939-05742abe8436 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:47.306569 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-3402563c-bae1-41f2-b939-05742abe8436 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:47.309855 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-3402563c-bae1-41f2-b939-05742abe8436 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:47.310864 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-3402563c-bae1-41f2-b939-05742abe8436 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:47.311581 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-3402563c-bae1-41f2-b939-05742abe8436 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:47.312225 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-3402563c-bae1-41f2-b939-05742abe8436 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:47.521463 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-2ffc6412-ed75-4844-9529-5791e8339a8c tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:33:47.522058 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-2ffc6412-ed75-4844-9529-5791e8339a8c tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] [instance: ff125cf8-e8a5-4f00-ade9-045b18ee33f4] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:33:47.545577 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-2ffc6412-ed75-4844-9529-5791e8339a8c tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:47.546074 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-2ffc6412-ed75-4844-9529-5791e8339a8c tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:47.546506 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-2ffc6412-ed75-4844-9529-5791e8339a8c tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:47.551577 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-2ffc6412-ed75-4844-9529-5791e8339a8c tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:47.552266 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-2ffc6412-ed75-4844-9529-5791e8339a8c tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:47.552705 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-2ffc6412-ed75-4844-9529-5791e8339a8c tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:47.570431 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-3402563c-bae1-41f2-b939-05742abe8436 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2e978bcb824a5e9d593b861c9e3bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7573cb9c503243ab90b1649591d550e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:33:47.581142 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-3402563c-bae1-41f2-b939-05742abe8436 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] 10.222.0.15 "GET /compute/v2.1/servers/d0befdd2-2ecd-4006-bfdd-86d5253a7687" status: 200 len: 1321 microversion: 2.1 time: 0.307127 Oct 31 12:33:47.582053 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 67/138] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:33:47 2022] GET /compute/v2.1/servers/d0befdd2-2ecd-4006-bfdd-86d5253a7687 => generated 1321 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:33:47.769786 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-76ef3c6c-8ef7-4826-9f57-6639d2a9c376 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:33:47.770830 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-76ef3c6c-8ef7-4826-9f57-6639d2a9c376 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] [instance: 9906becc-a42b-4b4c-855a-450915f7a3f8] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:33:47.777480 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-76ef3c6c-8ef7-4826-9f57-6639d2a9c376 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:47.778218 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-76ef3c6c-8ef7-4826-9f57-6639d2a9c376 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:47.778819 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-76ef3c6c-8ef7-4826-9f57-6639d2a9c376 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:47.779854 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-76ef3c6c-8ef7-4826-9f57-6639d2a9c376 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:47.780300 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-76ef3c6c-8ef7-4826-9f57-6639d2a9c376 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:47.780712 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-76ef3c6c-8ef7-4826-9f57-6639d2a9c376 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:47.921542 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-76ef3c6c-8ef7-4826-9f57-6639d2a9c376 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c03f0365ee4a26b8c076ae365325b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfbc3a46f12942299b99cdd20c989e1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:33:47.931096 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-76ef3c6c-8ef7-4826-9f57-6639d2a9c376 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] 10.222.0.15 "GET /compute/v2.1/servers/9906becc-a42b-4b4c-855a-450915f7a3f8" status: 200 len: 1366 microversion: 2.1 time: 0.165728 Oct 31 12:33:47.931811 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 68/139] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:33:47 2022] GET /compute/v2.1/servers/9906becc-a42b-4b4c-855a-450915f7a3f8 => generated 1366 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 12:33:48.001419 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-7e8a31f5-87df-4722-8803-b4230cba9eec tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:33:48.003354 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-7e8a31f5-87df-4722-8803-b4230cba9eec tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] [instance: 8d254a92-15fa-4d98-8954-a8028647165e] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:33:48.009203 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-7e8a31f5-87df-4722-8803-b4230cba9eec tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:48.009686 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-7e8a31f5-87df-4722-8803-b4230cba9eec tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:48.010297 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-7e8a31f5-87df-4722-8803-b4230cba9eec tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:48.010990 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-7e8a31f5-87df-4722-8803-b4230cba9eec tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:48.011612 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-7e8a31f5-87df-4722-8803-b4230cba9eec tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:48.012250 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-7e8a31f5-87df-4722-8803-b4230cba9eec tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:48.176249 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-7e8a31f5-87df-4722-8803-b4230cba9eec tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d59ee6f94848308665a32099cf5255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4d5cd8851dc4216b4e3e035a32decad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:33:48.185416 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-7e8a31f5-87df-4722-8803-b4230cba9eec tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] 10.222.0.15 "GET /compute/v2.1/servers/8d254a92-15fa-4d98-8954-a8028647165e" status: 200 len: 1501 microversion: 2.1 time: 0.187752 Oct 31 12:33:48.186107 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 69/140] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:33:47 2022] GET /compute/v2.1/servers/8d254a92-15fa-4d98-8954-a8028647165e => generated 1501 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:33:48.313584 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-b1162055-b354-4ce7-9b4b-f58078ec7030 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:33:48.315129 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-b1162055-b354-4ce7-9b4b-f58078ec7030 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] [instance: 852e8870-b3ec-4a21-a9b5-e31a423ddd3d] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:33:48.318640 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-2ffc6412-ed75-4844-9529-5791e8339a8c tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c1beb321e44908ab987b17f7b74484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a2bf9a5a484523a700e4e6c568d4de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:33:48.321487 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-b1162055-b354-4ce7-9b4b-f58078ec7030 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:48.322193 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-b1162055-b354-4ce7-9b4b-f58078ec7030 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:48.322881 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-b1162055-b354-4ce7-9b4b-f58078ec7030 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:48.324441 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-b1162055-b354-4ce7-9b4b-f58078ec7030 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:48.324970 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-b1162055-b354-4ce7-9b4b-f58078ec7030 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:48.325472 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-b1162055-b354-4ce7-9b4b-f58078ec7030 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:48.326147 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-2ffc6412-ed75-4844-9529-5791e8339a8c tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] 10.222.0.15 "GET /compute/v2.1/servers/ff125cf8-e8a5-4f00-ade9-045b18ee33f4" status: 200 len: 1364 microversion: 2.1 time: 0.809522 Oct 31 12:33:48.328868 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 72/141] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:33:47 2022] GET /compute/v2.1/servers/ff125cf8-e8a5-4f00-ade9-045b18ee33f4 => generated 1364 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 12:33:48.532379 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-b1162055-b354-4ce7-9b4b-f58078ec7030 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:33:48.542668 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-b1162055-b354-4ce7-9b4b-f58078ec7030 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:33:48.544493 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-b1162055-b354-4ce7-9b4b-f58078ec7030 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:33:48.545600 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-b1162055-b354-4ce7-9b4b-f58078ec7030 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] 10.222.0.15 "GET /compute/v2.1/servers/852e8870-b3ec-4a21-a9b5-e31a423ddd3d" status: 200 len: 1408 microversion: 2.20 time: 0.237982 Oct 31 12:33:48.546192 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 70/142] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Oct 31 12:33:48 2022] GET /compute/v2.1/servers/852e8870-b3ec-4a21-a9b5-e31a423ddd3d => generated 1408 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 12:33:48.608983 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-f06d9652-4c4b-4517-907b-a042ffe1a152 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:33:48.609591 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-f06d9652-4c4b-4517-907b-a042ffe1a152 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] [instance: d0befdd2-2ecd-4006-bfdd-86d5253a7687] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:33:48.612099 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG dbcounter [-] [125440] Writing DB stats nova_api:SELECT=99 {{(pid=125440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:33:48.618642 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-f06d9652-4c4b-4517-907b-a042ffe1a152 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:48.619125 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-f06d9652-4c4b-4517-907b-a042ffe1a152 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:48.619578 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-f06d9652-4c4b-4517-907b-a042ffe1a152 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:48.620266 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-f06d9652-4c4b-4517-907b-a042ffe1a152 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:48.620712 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-f06d9652-4c4b-4517-907b-a042ffe1a152 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:48.621139 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-f06d9652-4c4b-4517-907b-a042ffe1a152 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:48.867206 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-f06d9652-4c4b-4517-907b-a042ffe1a152 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2e978bcb824a5e9d593b861c9e3bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7573cb9c503243ab90b1649591d550e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:33:48.880692 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-f06d9652-4c4b-4517-907b-a042ffe1a152 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] 10.222.0.15 "GET /compute/v2.1/servers/d0befdd2-2ecd-4006-bfdd-86d5253a7687" status: 200 len: 1321 microversion: 2.1 time: 0.275032 Oct 31 12:33:48.891871 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 73/143] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:33:48 2022] GET /compute/v2.1/servers/d0befdd2-2ecd-4006-bfdd-86d5253a7687 => generated 1321 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:33:48.958227 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-92cedd25-e1ca-4764-ace0-8a9fad625c64 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:33:48.959961 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-92cedd25-e1ca-4764-ace0-8a9fad625c64 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] [instance: 9906becc-a42b-4b4c-855a-450915f7a3f8] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:33:48.971512 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-92cedd25-e1ca-4764-ace0-8a9fad625c64 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:48.972359 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-92cedd25-e1ca-4764-ace0-8a9fad625c64 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:48.973360 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-92cedd25-e1ca-4764-ace0-8a9fad625c64 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:48.975110 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-92cedd25-e1ca-4764-ace0-8a9fad625c64 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:48.975734 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-92cedd25-e1ca-4764-ace0-8a9fad625c64 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:48.976315 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-92cedd25-e1ca-4764-ace0-8a9fad625c64 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:49.171524 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-92cedd25-e1ca-4764-ace0-8a9fad625c64 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c03f0365ee4a26b8c076ae365325b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfbc3a46f12942299b99cdd20c989e1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:33:49.179952 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-92cedd25-e1ca-4764-ace0-8a9fad625c64 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] 10.222.0.15 "GET /compute/v2.1/servers/9906becc-a42b-4b4c-855a-450915f7a3f8" status: 200 len: 1366 microversion: 2.1 time: 0.229508 Oct 31 12:33:49.180465 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 71/144] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:33:48 2022] GET /compute/v2.1/servers/9906becc-a42b-4b4c-855a-450915f7a3f8 => generated 1366 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:33:49.277438 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [req-ee1703d3-607d-4af7-8599-23b217d64a40 req-2b4c6ab0-10e6-4793-8c5d-d5e0058ed02a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0befdd2-2ecd-4006-bfdd-86d5253a7687", "name": "network-vif-plugged", "status": "completed", "tag": "8ae8e564-b3aa-4e58-8d16-d182b80edabc"}]} {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 12:33:49.288936 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [req-ee1703d3-607d-4af7-8599-23b217d64a40 req-2b4c6ab0-10e6-4793-8c5d-d5e0058ed02a service nova] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:49.290479 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [req-ee1703d3-607d-4af7-8599-23b217d64a40 req-2b4c6ab0-10e6-4793-8c5d-d5e0058ed02a service nova] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:49.291061 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [req-ee1703d3-607d-4af7-8599-23b217d64a40 req-2b4c6ab0-10e6-4793-8c5d-d5e0058ed02a service nova] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:49.305274 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.compute.server_external_events [req-ee1703d3-607d-4af7-8599-23b217d64a40 req-2b4c6ab0-10e6-4793-8c5d-d5e0058ed02a service nova] Creating event network-vif-plugged:8ae8e564-b3aa-4e58-8d16-d182b80edabc for instance d0befdd2-2ecd-4006-bfdd-86d5253a7687 on hv-cinder-79617 Oct 31 12:33:49.310811 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [req-ee1703d3-607d-4af7-8599-23b217d64a40 req-2b4c6ab0-10e6-4793-8c5d-d5e0058ed02a service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038070 Oct 31 12:33:49.312228 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 74/145] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Oct 31 12:33:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 12:33:49.351605 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-d4ce97e9-59d6-4fae-ba27-4849ce11df23 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:33:49.352216 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-d4ce97e9-59d6-4fae-ba27-4849ce11df23 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] [instance: ff125cf8-e8a5-4f00-ade9-045b18ee33f4] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:33:49.358843 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-d4ce97e9-59d6-4fae-ba27-4849ce11df23 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:49.359362 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-d4ce97e9-59d6-4fae-ba27-4849ce11df23 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:49.359794 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-d4ce97e9-59d6-4fae-ba27-4849ce11df23 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:49.360484 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-d4ce97e9-59d6-4fae-ba27-4849ce11df23 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:49.361129 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-d4ce97e9-59d6-4fae-ba27-4849ce11df23 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:49.362096 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-d4ce97e9-59d6-4fae-ba27-4849ce11df23 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:49.521236 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-d4ce97e9-59d6-4fae-ba27-4849ce11df23 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c1beb321e44908ab987b17f7b74484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a2bf9a5a484523a700e4e6c568d4de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:33:49.523936 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG dbcounter [-] [125441] Writing DB stats nova_cell1:SELECT=100 {{(pid=125441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:33:49.531719 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-d4ce97e9-59d6-4fae-ba27-4849ce11df23 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] 10.222.0.15 "GET /compute/v2.1/servers/ff125cf8-e8a5-4f00-ade9-045b18ee33f4" status: 200 len: 1364 microversion: 2.1 time: 0.184303 Oct 31 12:33:49.532303 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 72/146] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:33:49 2022] GET /compute/v2.1/servers/ff125cf8-e8a5-4f00-ade9-045b18ee33f4 => generated 1364 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:33:49.571069 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-2f1a8004-00a1-41de-85f6-98d5f20b18a5 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:33:49.571784 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-2f1a8004-00a1-41de-85f6-98d5f20b18a5 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] [instance: 852e8870-b3ec-4a21-a9b5-e31a423ddd3d] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:33:49.578178 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-2f1a8004-00a1-41de-85f6-98d5f20b18a5 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:49.578646 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-2f1a8004-00a1-41de-85f6-98d5f20b18a5 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:49.579068 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-2f1a8004-00a1-41de-85f6-98d5f20b18a5 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:49.579802 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-2f1a8004-00a1-41de-85f6-98d5f20b18a5 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:49.580261 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-2f1a8004-00a1-41de-85f6-98d5f20b18a5 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:49.580673 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-2f1a8004-00a1-41de-85f6-98d5f20b18a5 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:49.737272 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-2f1a8004-00a1-41de-85f6-98d5f20b18a5 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:33:49.737831 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-8683b1f8-da51-4ff0-99fd-9ab3439ac3a9 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7f502868-f6cd-40fb-a4d3-b45349e650e8"}} {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 12:33:49.740409 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-8683b1f8-da51-4ff0-99fd-9ab3439ac3a9 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] [instance: 8d254a92-15fa-4d98-8954-a8028647165e] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:33:49.746036 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-2f1a8004-00a1-41de-85f6-98d5f20b18a5 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:33:49.746288 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-8683b1f8-da51-4ff0-99fd-9ab3439ac3a9 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:49.746765 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-8683b1f8-da51-4ff0-99fd-9ab3439ac3a9 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:49.747216 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-8683b1f8-da51-4ff0-99fd-9ab3439ac3a9 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:49.747498 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-2f1a8004-00a1-41de-85f6-98d5f20b18a5 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:33:49.747906 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-8683b1f8-da51-4ff0-99fd-9ab3439ac3a9 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:49.748355 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-8683b1f8-da51-4ff0-99fd-9ab3439ac3a9 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:49.748587 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-2f1a8004-00a1-41de-85f6-98d5f20b18a5 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] 10.222.0.15 "GET /compute/v2.1/servers/852e8870-b3ec-4a21-a9b5-e31a423ddd3d" status: 200 len: 1408 microversion: 2.20 time: 0.181749 Oct 31 12:33:49.748812 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-8683b1f8-da51-4ff0-99fd-9ab3439ac3a9 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:49.763495 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 75/147] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Oct 31 12:33:49 2022] GET /compute/v2.1/servers/852e8870-b3ec-4a21-a9b5-e31a423ddd3d => generated 1408 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 12:33:49.909066 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-1521c904-eb25-4e1e-8987-8b9e93c69e87 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:33:49.909678 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-1521c904-eb25-4e1e-8987-8b9e93c69e87 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] [instance: d0befdd2-2ecd-4006-bfdd-86d5253a7687] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:33:49.925191 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-1521c904-eb25-4e1e-8987-8b9e93c69e87 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:49.925682 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-1521c904-eb25-4e1e-8987-8b9e93c69e87 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:49.926109 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-1521c904-eb25-4e1e-8987-8b9e93c69e87 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:49.926805 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-1521c904-eb25-4e1e-8987-8b9e93c69e87 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:49.927266 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-1521c904-eb25-4e1e-8987-8b9e93c69e87 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:49.928120 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-1521c904-eb25-4e1e-8987-8b9e93c69e87 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:50.081001 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-1521c904-eb25-4e1e-8987-8b9e93c69e87 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2e978bcb824a5e9d593b861c9e3bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7573cb9c503243ab90b1649591d550e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:33:50.094999 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-1521c904-eb25-4e1e-8987-8b9e93c69e87 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] 10.222.0.15 "GET /compute/v2.1/servers/d0befdd2-2ecd-4006-bfdd-86d5253a7687" status: 200 len: 1321 microversion: 2.1 time: 0.192996 Oct 31 12:33:50.096685 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 76/148] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:33:49 2022] GET /compute/v2.1/servers/d0befdd2-2ecd-4006-bfdd-86d5253a7687 => generated 1321 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:33:50.204670 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-0868e887-8347-4182-8de8-5e4a9eef6306 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:33:50.205272 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-0868e887-8347-4182-8de8-5e4a9eef6306 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] [instance: 9906becc-a42b-4b4c-855a-450915f7a3f8] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:33:50.211568 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-0868e887-8347-4182-8de8-5e4a9eef6306 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:50.211897 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-0868e887-8347-4182-8de8-5e4a9eef6306 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:50.212315 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-0868e887-8347-4182-8de8-5e4a9eef6306 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:50.213128 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-0868e887-8347-4182-8de8-5e4a9eef6306 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:50.213537 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-0868e887-8347-4182-8de8-5e4a9eef6306 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:50.213947 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-0868e887-8347-4182-8de8-5e4a9eef6306 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:50.528391 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-0868e887-8347-4182-8de8-5e4a9eef6306 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c03f0365ee4a26b8c076ae365325b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfbc3a46f12942299b99cdd20c989e1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:33:50.545091 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-0868e887-8347-4182-8de8-5e4a9eef6306 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] 10.222.0.15 "GET /compute/v2.1/servers/9906becc-a42b-4b4c-855a-450915f7a3f8" status: 200 len: 1366 microversion: 2.1 time: 0.345857 Oct 31 12:33:50.566834 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 77/149] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:33:50 2022] GET /compute/v2.1/servers/9906becc-a42b-4b4c-855a-450915f7a3f8 => generated 1366 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 12:33:50.573068 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-b57b8164-4ea9-4a0b-bc27-8ef065dde91a tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:33:50.573895 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-b57b8164-4ea9-4a0b-bc27-8ef065dde91a tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] [instance: ff125cf8-e8a5-4f00-ade9-045b18ee33f4] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:33:50.581028 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-b57b8164-4ea9-4a0b-bc27-8ef065dde91a tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:50.581531 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-b57b8164-4ea9-4a0b-bc27-8ef065dde91a tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:50.581950 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-b57b8164-4ea9-4a0b-bc27-8ef065dde91a tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:50.582633 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-b57b8164-4ea9-4a0b-bc27-8ef065dde91a tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:50.583071 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-b57b8164-4ea9-4a0b-bc27-8ef065dde91a tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:50.583657 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-b57b8164-4ea9-4a0b-bc27-8ef065dde91a tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:50.730043 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-b57b8164-4ea9-4a0b-bc27-8ef065dde91a tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c1beb321e44908ab987b17f7b74484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a2bf9a5a484523a700e4e6c568d4de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:33:50.739309 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-b57b8164-4ea9-4a0b-bc27-8ef065dde91a tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] 10.222.0.15 "GET /compute/v2.1/servers/ff125cf8-e8a5-4f00-ade9-045b18ee33f4" status: 200 len: 1364 microversion: 2.1 time: 0.171108 Oct 31 12:33:50.739884 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 78/150] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:33:50 2022] GET /compute/v2.1/servers/ff125cf8-e8a5-4f00-ade9-045b18ee33f4 => generated 1364 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:33:50.775624 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-abf5b75a-e3e8-468b-a46d-a42dff7ba960 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:33:50.776366 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-abf5b75a-e3e8-468b-a46d-a42dff7ba960 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] [instance: 852e8870-b3ec-4a21-a9b5-e31a423ddd3d] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:33:50.782670 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-abf5b75a-e3e8-468b-a46d-a42dff7ba960 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:50.783199 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-abf5b75a-e3e8-468b-a46d-a42dff7ba960 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:50.783628 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-abf5b75a-e3e8-468b-a46d-a42dff7ba960 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:50.784313 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-abf5b75a-e3e8-468b-a46d-a42dff7ba960 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:50.784758 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-abf5b75a-e3e8-468b-a46d-a42dff7ba960 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:50.785179 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-abf5b75a-e3e8-468b-a46d-a42dff7ba960 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:50.937281 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-abf5b75a-e3e8-468b-a46d-a42dff7ba960 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:33:50.948948 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-abf5b75a-e3e8-468b-a46d-a42dff7ba960 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:33:50.950913 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-abf5b75a-e3e8-468b-a46d-a42dff7ba960 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:33:50.952382 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-abf5b75a-e3e8-468b-a46d-a42dff7ba960 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] 10.222.0.15 "GET /compute/v2.1/servers/852e8870-b3ec-4a21-a9b5-e31a423ddd3d" status: 200 len: 1408 microversion: 2.20 time: 0.181350 Oct 31 12:33:50.953419 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 79/151] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Oct 31 12:33:50 2022] GET /compute/v2.1/servers/852e8870-b3ec-4a21-a9b5-e31a423ddd3d => generated 1408 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 12:33:51.123498 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-e2e97b02-6870-4379-83d3-1671c6f2bd57 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:33:51.123498 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-e2e97b02-6870-4379-83d3-1671c6f2bd57 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] [instance: d0befdd2-2ecd-4006-bfdd-86d5253a7687] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:33:51.130093 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-e2e97b02-6870-4379-83d3-1671c6f2bd57 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:51.130503 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-e2e97b02-6870-4379-83d3-1671c6f2bd57 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:51.130932 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-e2e97b02-6870-4379-83d3-1671c6f2bd57 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:51.131831 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-e2e97b02-6870-4379-83d3-1671c6f2bd57 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:51.133933 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-e2e97b02-6870-4379-83d3-1671c6f2bd57 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:51.140932 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-e2e97b02-6870-4379-83d3-1671c6f2bd57 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:51.477200 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-e2e97b02-6870-4379-83d3-1671c6f2bd57 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2e978bcb824a5e9d593b861c9e3bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7573cb9c503243ab90b1649591d550e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:33:51.489070 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-e2e97b02-6870-4379-83d3-1671c6f2bd57 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] 10.222.0.15 "GET /compute/v2.1/servers/d0befdd2-2ecd-4006-bfdd-86d5253a7687" status: 200 len: 1321 microversion: 2.1 time: 0.371938 Oct 31 12:33:51.500294 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 80/152] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:33:51 2022] GET /compute/v2.1/servers/d0befdd2-2ecd-4006-bfdd-86d5253a7687 => generated 1321 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:33:51.525129 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [req-cdb9d78c-3c5a-4669-8b66-bb2bc0c16ee5 req-29f91266-1a2b-4235-ada3-963009fe86ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "852e8870-b3ec-4a21-a9b5-e31a423ddd3d", "name": "network-vif-plugged", "status": "completed", "tag": "dffec82d-007b-4838-9898-19da61885395"}]} {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 12:33:51.550262 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [req-cdb9d78c-3c5a-4669-8b66-bb2bc0c16ee5 req-29f91266-1a2b-4235-ada3-963009fe86ae service nova] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:51.551063 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [req-cdb9d78c-3c5a-4669-8b66-bb2bc0c16ee5 req-29f91266-1a2b-4235-ada3-963009fe86ae service nova] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:51.552431 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [req-cdb9d78c-3c5a-4669-8b66-bb2bc0c16ee5 req-29f91266-1a2b-4235-ada3-963009fe86ae service nova] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:51.564244 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-8683b1f8-da51-4ff0-99fd-9ab3439ac3a9 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] 10.222.0.15 "POST /compute/v2.1/servers/8d254a92-15fa-4d98-8954-a8028647165e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.810104 Oct 31 12:33:51.571314 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 73/153] 10.222.0.15 () {60 vars in 1323 bytes} [Mon Oct 31 12:33:49 2022] POST /compute/v2.1/servers/8d254a92-15fa-4d98-8954-a8028647165e/os-volume_attachments => generated 194 bytes in 1835 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 12:33:51.578937 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-7ff4348a-47a0-443b-bd04-d8217c803603 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:33:51.582241 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.compute.server_external_events [req-cdb9d78c-3c5a-4669-8b66-bb2bc0c16ee5 req-29f91266-1a2b-4235-ada3-963009fe86ae service nova] Creating event network-vif-plugged:dffec82d-007b-4838-9898-19da61885395 for instance 852e8870-b3ec-4a21-a9b5-e31a423ddd3d on hv-cinder-79617 Oct 31 12:33:51.584527 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-7ff4348a-47a0-443b-bd04-d8217c803603 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] [instance: 9906becc-a42b-4b4c-855a-450915f7a3f8] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:33:51.597561 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [req-cdb9d78c-3c5a-4669-8b66-bb2bc0c16ee5 req-29f91266-1a2b-4235-ada3-963009fe86ae service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095660 Oct 31 12:33:51.598792 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 81/154] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Oct 31 12:33:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 12:33:51.599692 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-7ff4348a-47a0-443b-bd04-d8217c803603 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:51.600337 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-7ff4348a-47a0-443b-bd04-d8217c803603 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:51.601532 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-7ff4348a-47a0-443b-bd04-d8217c803603 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:51.602840 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-7ff4348a-47a0-443b-bd04-d8217c803603 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:51.603571 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-7ff4348a-47a0-443b-bd04-d8217c803603 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:51.604811 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-7ff4348a-47a0-443b-bd04-d8217c803603 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:51.769837 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-38433334-df68-41ea-9ed3-4bfd962bf4f9 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:33:51.772234 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-38433334-df68-41ea-9ed3-4bfd962bf4f9 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] [instance: ff125cf8-e8a5-4f00-ade9-045b18ee33f4] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:33:51.793391 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-38433334-df68-41ea-9ed3-4bfd962bf4f9 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:51.794169 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-38433334-df68-41ea-9ed3-4bfd962bf4f9 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:51.794902 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-38433334-df68-41ea-9ed3-4bfd962bf4f9 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:51.797970 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-38433334-df68-41ea-9ed3-4bfd962bf4f9 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:51.800964 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-38433334-df68-41ea-9ed3-4bfd962bf4f9 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:51.801405 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-38433334-df68-41ea-9ed3-4bfd962bf4f9 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:51.811356 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG dbcounter [-] [125440] Writing DB stats nova_cell1:SELECT=100 {{(pid=125440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:33:51.865417 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-7ff4348a-47a0-443b-bd04-d8217c803603 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c03f0365ee4a26b8c076ae365325b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfbc3a46f12942299b99cdd20c989e1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:33:51.877897 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-7ff4348a-47a0-443b-bd04-d8217c803603 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] 10.222.0.15 "GET /compute/v2.1/servers/9906becc-a42b-4b4c-855a-450915f7a3f8" status: 200 len: 1366 microversion: 2.1 time: 0.302102 Oct 31 12:33:51.878824 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 74/155] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:33:51 2022] GET /compute/v2.1/servers/9906becc-a42b-4b4c-855a-450915f7a3f8 => generated 1366 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:33:51.978618 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-fcb2388b-cbec-4709-8621-8f6322cdf390 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:33:51.979733 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-fcb2388b-cbec-4709-8621-8f6322cdf390 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] [instance: 852e8870-b3ec-4a21-a9b5-e31a423ddd3d] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:33:51.981384 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-38433334-df68-41ea-9ed3-4bfd962bf4f9 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c1beb321e44908ab987b17f7b74484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a2bf9a5a484523a700e4e6c568d4de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:33:51.986859 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-fcb2388b-cbec-4709-8621-8f6322cdf390 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:51.987896 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-fcb2388b-cbec-4709-8621-8f6322cdf390 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:51.988949 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-fcb2388b-cbec-4709-8621-8f6322cdf390 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:51.990283 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-fcb2388b-cbec-4709-8621-8f6322cdf390 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:51.990943 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-fcb2388b-cbec-4709-8621-8f6322cdf390 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:51.991636 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-fcb2388b-cbec-4709-8621-8f6322cdf390 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:51.998713 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-38433334-df68-41ea-9ed3-4bfd962bf4f9 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] 10.222.0.15 "GET /compute/v2.1/servers/ff125cf8-e8a5-4f00-ade9-045b18ee33f4" status: 200 len: 1550 microversion: 2.1 time: 0.237584 Oct 31 12:33:51.999687 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 82/156] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:33:51 2022] GET /compute/v2.1/servers/ff125cf8-e8a5-4f00-ade9-045b18ee33f4 => generated 1550 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 12:33:52.030497 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-f4cc381a-78ae-40f5-8c46-7c58d58b1f31 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:33:52.031099 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-f4cc381a-78ae-40f5-8c46-7c58d58b1f31 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] [instance: ff125cf8-e8a5-4f00-ade9-045b18ee33f4] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:33:52.047491 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-f4cc381a-78ae-40f5-8c46-7c58d58b1f31 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:52.048947 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-f4cc381a-78ae-40f5-8c46-7c58d58b1f31 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:52.050957 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-f4cc381a-78ae-40f5-8c46-7c58d58b1f31 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:52.052002 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-f4cc381a-78ae-40f5-8c46-7c58d58b1f31 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:52.052819 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-f4cc381a-78ae-40f5-8c46-7c58d58b1f31 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:52.053533 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-f4cc381a-78ae-40f5-8c46-7c58d58b1f31 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:52.188133 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-fcb2388b-cbec-4709-8621-8f6322cdf390 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:33:52.198116 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-fcb2388b-cbec-4709-8621-8f6322cdf390 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:33:52.200350 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-fcb2388b-cbec-4709-8621-8f6322cdf390 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:33:52.201985 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-fcb2388b-cbec-4709-8621-8f6322cdf390 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] 10.222.0.15 "GET /compute/v2.1/servers/852e8870-b3ec-4a21-a9b5-e31a423ddd3d" status: 200 len: 1408 microversion: 2.20 time: 0.227618 Oct 31 12:33:52.203232 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 75/157] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Oct 31 12:33:51 2022] GET /compute/v2.1/servers/852e8870-b3ec-4a21-a9b5-e31a423ddd3d => generated 1408 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 12:33:52.228016 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-f4cc381a-78ae-40f5-8c46-7c58d58b1f31 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] 10.222.0.15 "GET /compute/v2.1/servers/ff125cf8-e8a5-4f00-ade9-045b18ee33f4/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.204113 Oct 31 12:33:52.229221 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 83/158] 10.222.0.15 () {58 vars in 1275 bytes} [Mon Oct 31 12:33:52 2022] GET /compute/v2.1/servers/ff125cf8-e8a5-4f00-ade9-045b18ee33f4/os-interface => generated 285 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 12:33:52.513662 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-be6c048a-fb7d-4890-b371-57564c2ee252 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:33:52.514253 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-be6c048a-fb7d-4890-b371-57564c2ee252 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] [instance: d0befdd2-2ecd-4006-bfdd-86d5253a7687] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:33:52.525601 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-be6c048a-fb7d-4890-b371-57564c2ee252 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:52.526299 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-be6c048a-fb7d-4890-b371-57564c2ee252 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:52.526812 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-be6c048a-fb7d-4890-b371-57564c2ee252 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:52.527565 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-be6c048a-fb7d-4890-b371-57564c2ee252 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:52.528023 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-be6c048a-fb7d-4890-b371-57564c2ee252 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:52.528440 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-be6c048a-fb7d-4890-b371-57564c2ee252 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:52.867727 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-be6c048a-fb7d-4890-b371-57564c2ee252 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2e978bcb824a5e9d593b861c9e3bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7573cb9c503243ab90b1649591d550e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:33:52.897608 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-be6c048a-fb7d-4890-b371-57564c2ee252 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] 10.222.0.15 "GET /compute/v2.1/servers/d0befdd2-2ecd-4006-bfdd-86d5253a7687" status: 200 len: 1321 microversion: 2.1 time: 0.387425 Oct 31 12:33:52.898492 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 76/159] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:33:52 2022] GET /compute/v2.1/servers/d0befdd2-2ecd-4006-bfdd-86d5253a7687 => generated 1321 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:33:52.905047 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-80bf24ba-451f-45da-8320-158a0f4200c4 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:33:52.905594 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-80bf24ba-451f-45da-8320-158a0f4200c4 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] [instance: 9906becc-a42b-4b4c-855a-450915f7a3f8] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:33:52.917701 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-80bf24ba-451f-45da-8320-158a0f4200c4 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:52.918175 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-80bf24ba-451f-45da-8320-158a0f4200c4 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:52.918766 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-80bf24ba-451f-45da-8320-158a0f4200c4 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:52.919761 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-80bf24ba-451f-45da-8320-158a0f4200c4 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:52.920374 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-80bf24ba-451f-45da-8320-158a0f4200c4 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:52.920935 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-80bf24ba-451f-45da-8320-158a0f4200c4 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:53.228132 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-1d2e79f9-b991-4069-985f-6b2d47ee375b tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:33:53.228970 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-1d2e79f9-b991-4069-985f-6b2d47ee375b tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] [instance: 852e8870-b3ec-4a21-a9b5-e31a423ddd3d] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:33:53.238033 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-1d2e79f9-b991-4069-985f-6b2d47ee375b tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:53.242507 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-1d2e79f9-b991-4069-985f-6b2d47ee375b tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:53.243095 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-1d2e79f9-b991-4069-985f-6b2d47ee375b tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:53.244000 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-1d2e79f9-b991-4069-985f-6b2d47ee375b tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:53.244587 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-1d2e79f9-b991-4069-985f-6b2d47ee375b tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:53.248575 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-1d2e79f9-b991-4069-985f-6b2d47ee375b tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:53.462769 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-80bf24ba-451f-45da-8320-158a0f4200c4 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c03f0365ee4a26b8c076ae365325b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfbc3a46f12942299b99cdd20c989e1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:33:53.477022 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-80bf24ba-451f-45da-8320-158a0f4200c4 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] 10.222.0.15 "GET /compute/v2.1/servers/9906becc-a42b-4b4c-855a-450915f7a3f8" status: 200 len: 1366 microversion: 2.1 time: 0.575663 Oct 31 12:33:53.478512 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 84/160] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:33:52 2022] GET /compute/v2.1/servers/9906becc-a42b-4b4c-855a-450915f7a3f8 => generated 1366 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:33:53.625402 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [req-318565bc-f283-4d3f-97a0-ab76ce0c4d52 req-05007cac-480b-44d0-a821-9d6ac602310e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9906becc-a42b-4b4c-855a-450915f7a3f8", "name": "network-vif-plugged", "status": "completed", "tag": "ffe46aaf-72a4-4c15-9506-ca33161dddf3"}]} {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 12:33:53.642428 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [req-318565bc-f283-4d3f-97a0-ab76ce0c4d52 req-05007cac-480b-44d0-a821-9d6ac602310e service nova] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:53.642991 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [req-318565bc-f283-4d3f-97a0-ab76ce0c4d52 req-05007cac-480b-44d0-a821-9d6ac602310e service nova] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:53.643546 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [req-318565bc-f283-4d3f-97a0-ab76ce0c4d52 req-05007cac-480b-44d0-a821-9d6ac602310e service nova] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:53.674979 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-1d2e79f9-b991-4069-985f-6b2d47ee375b tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:33:53.675226 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.compute.server_external_events [req-318565bc-f283-4d3f-97a0-ab76ce0c4d52 req-05007cac-480b-44d0-a821-9d6ac602310e service nova] Creating event network-vif-plugged:ffe46aaf-72a4-4c15-9506-ca33161dddf3 for instance 9906becc-a42b-4b4c-855a-450915f7a3f8 on hv-cinder-79617 Oct 31 12:33:53.686022 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [req-318565bc-f283-4d3f-97a0-ab76ce0c4d52 req-05007cac-480b-44d0-a821-9d6ac602310e service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065278 Oct 31 12:33:53.688404 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-1d2e79f9-b991-4069-985f-6b2d47ee375b tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:33:53.691257 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-1d2e79f9-b991-4069-985f-6b2d47ee375b tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:33:53.691839 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 85/161] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Oct 31 12:33:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 12:33:53.694203 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-1d2e79f9-b991-4069-985f-6b2d47ee375b tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] 10.222.0.15 "GET /compute/v2.1/servers/852e8870-b3ec-4a21-a9b5-e31a423ddd3d" status: 200 len: 1408 microversion: 2.20 time: 0.470291 Oct 31 12:33:53.697765 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 77/162] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Oct 31 12:33:53 2022] GET /compute/v2.1/servers/852e8870-b3ec-4a21-a9b5-e31a423ddd3d => generated 1408 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 12:33:53.922234 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-a55430cc-04a3-4fe1-8531-cbb38bd3d039 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:33:53.922926 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-a55430cc-04a3-4fe1-8531-cbb38bd3d039 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] [instance: d0befdd2-2ecd-4006-bfdd-86d5253a7687] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:33:53.937332 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-a55430cc-04a3-4fe1-8531-cbb38bd3d039 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:53.937893 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-a55430cc-04a3-4fe1-8531-cbb38bd3d039 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:53.940031 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-a55430cc-04a3-4fe1-8531-cbb38bd3d039 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:53.941447 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-a55430cc-04a3-4fe1-8531-cbb38bd3d039 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:53.941907 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-a55430cc-04a3-4fe1-8531-cbb38bd3d039 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:53.943300 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-a55430cc-04a3-4fe1-8531-cbb38bd3d039 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:54.115927 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-a55430cc-04a3-4fe1-8531-cbb38bd3d039 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2e978bcb824a5e9d593b861c9e3bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7573cb9c503243ab90b1649591d550e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:33:54.123624 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-a55430cc-04a3-4fe1-8531-cbb38bd3d039 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] 10.222.0.15 "GET /compute/v2.1/servers/d0befdd2-2ecd-4006-bfdd-86d5253a7687" status: 200 len: 1516 microversion: 2.1 time: 0.205662 Oct 31 12:33:54.124560 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 86/163] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:33:53 2022] GET /compute/v2.1/servers/d0befdd2-2ecd-4006-bfdd-86d5253a7687 => generated 1516 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:33:54.153764 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-3334e362-2196-4b74-8a38-f47509b11f16 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 12:33:54.156449 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-3334e362-2196-4b74-8a38-f47509b11f16 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] [instance: d0befdd2-2ecd-4006-bfdd-86d5253a7687] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:33:54.164852 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-3334e362-2196-4b74-8a38-f47509b11f16 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:54.165643 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-3334e362-2196-4b74-8a38-f47509b11f16 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:54.166145 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-3334e362-2196-4b74-8a38-f47509b11f16 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:54.166857 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-3334e362-2196-4b74-8a38-f47509b11f16 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:54.167456 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-3334e362-2196-4b74-8a38-f47509b11f16 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:54.167880 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-3334e362-2196-4b74-8a38-f47509b11f16 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:54.195862 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.objects.instance [None req-3334e362-2196-4b74-8a38-f47509b11f16 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lazy-loading 'flavor' on Instance uuid d0befdd2-2ecd-4006-bfdd-86d5253a7687 {{(pid=125441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 12:33:54.226888 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [req-0ef8d55a-dfca-4fe2-864e-285f4eae7fbd req-7e1f443f-8abf-4363-a2c1-45e9ec3cf300 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff125cf8-e8a5-4f00-ade9-045b18ee33f4", "tag": "f9ca4955-7ad3-407e-b90d-7bad757cb1d8"}]} {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 12:33:54.238388 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [req-0ef8d55a-dfca-4fe2-864e-285f4eae7fbd req-7e1f443f-8abf-4363-a2c1-45e9ec3cf300 service nova] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:54.239789 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [req-0ef8d55a-dfca-4fe2-864e-285f4eae7fbd req-7e1f443f-8abf-4363-a2c1-45e9ec3cf300 service nova] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:54.240471 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [req-0ef8d55a-dfca-4fe2-864e-285f4eae7fbd req-7e1f443f-8abf-4363-a2c1-45e9ec3cf300 service nova] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:54.256595 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.compute.server_external_events [req-0ef8d55a-dfca-4fe2-864e-285f4eae7fbd req-7e1f443f-8abf-4363-a2c1-45e9ec3cf300 service nova] Creating event network-changed:f9ca4955-7ad3-407e-b90d-7bad757cb1d8 for instance ff125cf8-e8a5-4f00-ade9-045b18ee33f4 on hv-cinder-79617 Oct 31 12:33:54.262314 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [req-0ef8d55a-dfca-4fe2-864e-285f4eae7fbd req-7e1f443f-8abf-4363-a2c1-45e9ec3cf300 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039730 Oct 31 12:33:54.263597 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 87/164] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Oct 31 12:33:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 12:33:54.337008 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-3334e362-2196-4b74-8a38-f47509b11f16 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] 10.222.0.15 "POST /compute/v2.1/servers/d0befdd2-2ecd-4006-bfdd-86d5253a7687/action" status: 200 len: 32 microversion: 2.1 time: 0.189283 Oct 31 12:33:54.337855 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 78/165] 10.222.0.15 () {60 vars in 1278 bytes} [Mon Oct 31 12:33:54 2022] POST /compute/v2.1/servers/d0befdd2-2ecd-4006-bfdd-86d5253a7687/action => generated 32 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 31 12:33:54.349232 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-47cd52a4-b447-4b59-85ab-b800ef172fe1 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:33:54.350176 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-47cd52a4-b447-4b59-85ab-b800ef172fe1 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] [instance: d0befdd2-2ecd-4006-bfdd-86d5253a7687] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:33:54.356583 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-47cd52a4-b447-4b59-85ab-b800ef172fe1 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:54.368139 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-47cd52a4-b447-4b59-85ab-b800ef172fe1 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:54.370406 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-47cd52a4-b447-4b59-85ab-b800ef172fe1 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:54.371470 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-47cd52a4-b447-4b59-85ab-b800ef172fe1 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:54.376281 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-47cd52a4-b447-4b59-85ab-b800ef172fe1 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:54.377670 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-47cd52a4-b447-4b59-85ab-b800ef172fe1 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:54.502358 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-71cff2cc-88e0-4ba7-b824-743e5c1aa7eb tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:33:54.503445 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-71cff2cc-88e0-4ba7-b824-743e5c1aa7eb tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] [instance: 9906becc-a42b-4b4c-855a-450915f7a3f8] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:33:54.510660 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-71cff2cc-88e0-4ba7-b824-743e5c1aa7eb tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:54.511435 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-71cff2cc-88e0-4ba7-b824-743e5c1aa7eb tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:54.512047 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-71cff2cc-88e0-4ba7-b824-743e5c1aa7eb tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:54.512950 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-71cff2cc-88e0-4ba7-b824-743e5c1aa7eb tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:54.513574 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-71cff2cc-88e0-4ba7-b824-743e5c1aa7eb tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:54.514167 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-71cff2cc-88e0-4ba7-b824-743e5c1aa7eb tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:54.612518 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-47cd52a4-b447-4b59-85ab-b800ef172fe1 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2e978bcb824a5e9d593b861c9e3bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7573cb9c503243ab90b1649591d550e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:33:54.625143 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-47cd52a4-b447-4b59-85ab-b800ef172fe1 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] 10.222.0.15 "GET /compute/v2.1/servers/d0befdd2-2ecd-4006-bfdd-86d5253a7687" status: 200 len: 1522 microversion: 2.1 time: 0.279822 Oct 31 12:33:54.629273 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 88/166] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:33:54 2022] GET /compute/v2.1/servers/d0befdd2-2ecd-4006-bfdd-86d5253a7687 => generated 1522 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:33:54.722674 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-563fe93c-051b-4801-a650-d4560245a19d tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:33:54.723441 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-563fe93c-051b-4801-a650-d4560245a19d tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] [instance: 852e8870-b3ec-4a21-a9b5-e31a423ddd3d] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:33:54.733585 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-563fe93c-051b-4801-a650-d4560245a19d tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:54.734072 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-563fe93c-051b-4801-a650-d4560245a19d tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:54.737087 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-563fe93c-051b-4801-a650-d4560245a19d tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:54.737539 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-563fe93c-051b-4801-a650-d4560245a19d tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:54.739141 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-563fe93c-051b-4801-a650-d4560245a19d tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:54.741746 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-563fe93c-051b-4801-a650-d4560245a19d tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:54.951988 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-563fe93c-051b-4801-a650-d4560245a19d tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:33:54.968411 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-563fe93c-051b-4801-a650-d4560245a19d tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:33:54.972868 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-563fe93c-051b-4801-a650-d4560245a19d tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:33:54.976028 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-563fe93c-051b-4801-a650-d4560245a19d tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] 10.222.0.15 "GET /compute/v2.1/servers/852e8870-b3ec-4a21-a9b5-e31a423ddd3d" status: 200 len: 1408 microversion: 2.20 time: 0.257180 Oct 31 12:33:54.976634 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 89/167] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Oct 31 12:33:54 2022] GET /compute/v2.1/servers/852e8870-b3ec-4a21-a9b5-e31a423ddd3d => generated 1408 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 12:33:54.978236 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-71cff2cc-88e0-4ba7-b824-743e5c1aa7eb tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c03f0365ee4a26b8c076ae365325b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfbc3a46f12942299b99cdd20c989e1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:33:54.987320 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-71cff2cc-88e0-4ba7-b824-743e5c1aa7eb tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] 10.222.0.15 "GET /compute/v2.1/servers/9906becc-a42b-4b4c-855a-450915f7a3f8" status: 200 len: 1366 microversion: 2.1 time: 0.489466 Oct 31 12:33:54.988252 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 79/168] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:33:54 2022] GET /compute/v2.1/servers/9906becc-a42b-4b4c-855a-450915f7a3f8 => generated 1366 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 12:33:55.656237 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-893199fd-99e4-4790-a4ad-5d8ab269162d tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:33:55.656840 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-893199fd-99e4-4790-a4ad-5d8ab269162d tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] [instance: d0befdd2-2ecd-4006-bfdd-86d5253a7687] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:33:55.664303 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-893199fd-99e4-4790-a4ad-5d8ab269162d tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:55.665383 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-893199fd-99e4-4790-a4ad-5d8ab269162d tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:55.666021 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-893199fd-99e4-4790-a4ad-5d8ab269162d tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:55.666945 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-893199fd-99e4-4790-a4ad-5d8ab269162d tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:55.668312 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-893199fd-99e4-4790-a4ad-5d8ab269162d tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:55.669070 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-893199fd-99e4-4790-a4ad-5d8ab269162d tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:56.002771 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-8c4cc98b-708a-4506-b072-20ea87a30639 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:33:56.004098 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-8c4cc98b-708a-4506-b072-20ea87a30639 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] [instance: 852e8870-b3ec-4a21-a9b5-e31a423ddd3d] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:33:56.036356 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-8c4cc98b-708a-4506-b072-20ea87a30639 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:56.037092 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-8c4cc98b-708a-4506-b072-20ea87a30639 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:56.037671 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-8c4cc98b-708a-4506-b072-20ea87a30639 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:56.038530 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-8c4cc98b-708a-4506-b072-20ea87a30639 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:56.039132 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-8c4cc98b-708a-4506-b072-20ea87a30639 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:56.039722 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-8c4cc98b-708a-4506-b072-20ea87a30639 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:56.059419 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-893199fd-99e4-4790-a4ad-5d8ab269162d tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2e978bcb824a5e9d593b861c9e3bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7573cb9c503243ab90b1649591d550e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:33:56.075082 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-893199fd-99e4-4790-a4ad-5d8ab269162d tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] 10.222.0.15 "GET /compute/v2.1/servers/d0befdd2-2ecd-4006-bfdd-86d5253a7687" status: 200 len: 1522 microversion: 2.1 time: 0.419927 Oct 31 12:33:56.077652 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 90/169] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:33:55 2022] GET /compute/v2.1/servers/d0befdd2-2ecd-4006-bfdd-86d5253a7687 => generated 1522 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:33:56.088641 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-a8991e60-0b58-47ea-b7b7-7c287fa64470 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:33:56.089337 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-a8991e60-0b58-47ea-b7b7-7c287fa64470 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] [instance: 9906becc-a42b-4b4c-855a-450915f7a3f8] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:33:56.097641 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-a8991e60-0b58-47ea-b7b7-7c287fa64470 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:56.097888 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-a8991e60-0b58-47ea-b7b7-7c287fa64470 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:56.098313 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-a8991e60-0b58-47ea-b7b7-7c287fa64470 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:56.099083 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-a8991e60-0b58-47ea-b7b7-7c287fa64470 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:56.099491 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-a8991e60-0b58-47ea-b7b7-7c287fa64470 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:56.099904 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-a8991e60-0b58-47ea-b7b7-7c287fa64470 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:56.305994 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-8c4cc98b-708a-4506-b072-20ea87a30639 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:33:56.317779 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-8c4cc98b-708a-4506-b072-20ea87a30639 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:33:56.319451 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-8c4cc98b-708a-4506-b072-20ea87a30639 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:33:56.320771 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-8c4cc98b-708a-4506-b072-20ea87a30639 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] 10.222.0.15 "GET /compute/v2.1/servers/852e8870-b3ec-4a21-a9b5-e31a423ddd3d" status: 200 len: 1599 microversion: 2.20 time: 0.322983 Oct 31 12:33:56.322282 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 80/170] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Oct 31 12:33:55 2022] GET /compute/v2.1/servers/852e8870-b3ec-4a21-a9b5-e31a423ddd3d => generated 1599 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 12:33:56.347087 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-a8991e60-0b58-47ea-b7b7-7c287fa64470 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c03f0365ee4a26b8c076ae365325b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfbc3a46f12942299b99cdd20c989e1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:33:56.349651 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-a52a3a92-54dd-4d91-8620-2bf207136e8b tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:33:56.350114 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-a52a3a92-54dd-4d91-8620-2bf207136e8b tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] [instance: 852e8870-b3ec-4a21-a9b5-e31a423ddd3d] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:33:56.356656 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-a8991e60-0b58-47ea-b7b7-7c287fa64470 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] 10.222.0.15 "GET /compute/v2.1/servers/9906becc-a42b-4b4c-855a-450915f7a3f8" status: 200 len: 1366 microversion: 2.1 time: 0.277638 Oct 31 12:33:56.357465 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-a52a3a92-54dd-4d91-8620-2bf207136e8b tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:56.358092 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-a52a3a92-54dd-4d91-8620-2bf207136e8b tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:56.358526 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-a52a3a92-54dd-4d91-8620-2bf207136e8b tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:56.359292 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 91/171] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:33:56 2022] GET /compute/v2.1/servers/9906becc-a42b-4b4c-855a-450915f7a3f8 => generated 1366 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:33:56.359873 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-a52a3a92-54dd-4d91-8620-2bf207136e8b tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:56.360323 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-a52a3a92-54dd-4d91-8620-2bf207136e8b tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:56.360740 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-a52a3a92-54dd-4d91-8620-2bf207136e8b tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:56.452937 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-a52a3a92-54dd-4d91-8620-2bf207136e8b tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] 10.222.0.15 "GET /compute/v2.1/servers/852e8870-b3ec-4a21-a9b5-e31a423ddd3d/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.108195 Oct 31 12:33:56.454272 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 81/172] 10.222.0.15 () {60 vars in 1316 bytes} [Mon Oct 31 12:33:56 2022] GET /compute/v2.1/servers/852e8870-b3ec-4a21-a9b5-e31a423ddd3d/os-interface => generated 284 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 31 12:33:57.106993 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-0702b412-4194-49fd-973f-a726150b63c5 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:33:57.107976 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-0702b412-4194-49fd-973f-a726150b63c5 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] [instance: d0befdd2-2ecd-4006-bfdd-86d5253a7687] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:33:57.122069 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-0702b412-4194-49fd-973f-a726150b63c5 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:57.123517 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-0702b412-4194-49fd-973f-a726150b63c5 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:57.124142 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-0702b412-4194-49fd-973f-a726150b63c5 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:57.125828 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-0702b412-4194-49fd-973f-a726150b63c5 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:57.126494 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-0702b412-4194-49fd-973f-a726150b63c5 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:57.128012 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-0702b412-4194-49fd-973f-a726150b63c5 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:57.384843 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-0da3ccfc-55ce-4d4e-9fad-9a10e5e60a8f tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:33:57.386279 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-0da3ccfc-55ce-4d4e-9fad-9a10e5e60a8f tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] [instance: 9906becc-a42b-4b4c-855a-450915f7a3f8] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:33:57.393656 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-0da3ccfc-55ce-4d4e-9fad-9a10e5e60a8f tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:57.394426 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-0da3ccfc-55ce-4d4e-9fad-9a10e5e60a8f tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:57.395103 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-0da3ccfc-55ce-4d4e-9fad-9a10e5e60a8f tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:57.396287 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-0da3ccfc-55ce-4d4e-9fad-9a10e5e60a8f tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:57.396942 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-0da3ccfc-55ce-4d4e-9fad-9a10e5e60a8f tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:57.397586 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-0da3ccfc-55ce-4d4e-9fad-9a10e5e60a8f tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:57.847146 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-0da3ccfc-55ce-4d4e-9fad-9a10e5e60a8f tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c03f0365ee4a26b8c076ae365325b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfbc3a46f12942299b99cdd20c989e1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:33:57.855973 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-0da3ccfc-55ce-4d4e-9fad-9a10e5e60a8f tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] 10.222.0.15 "GET /compute/v2.1/servers/9906becc-a42b-4b4c-855a-450915f7a3f8" status: 200 len: 1366 microversion: 2.1 time: 0.476399 Oct 31 12:33:57.860806 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 82/173] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:33:57 2022] GET /compute/v2.1/servers/9906becc-a42b-4b4c-855a-450915f7a3f8 => generated 1366 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:33:57.884656 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-0702b412-4194-49fd-973f-a726150b63c5 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2e978bcb824a5e9d593b861c9e3bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7573cb9c503243ab90b1649591d550e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:33:57.896140 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-0702b412-4194-49fd-973f-a726150b63c5 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] 10.222.0.15 "GET /compute/v2.1/servers/d0befdd2-2ecd-4006-bfdd-86d5253a7687" status: 200 len: 1522 microversion: 2.1 time: 0.793651 Oct 31 12:33:57.896842 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 92/174] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:33:57 2022] GET /compute/v2.1/servers/d0befdd2-2ecd-4006-bfdd-86d5253a7687 => generated 1522 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:33:58.385832 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-798a4278-f98d-4b1d-80be-782458f5b6e4 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:33:58.387061 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-798a4278-f98d-4b1d-80be-782458f5b6e4 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] [instance: 8d254a92-15fa-4d98-8954-a8028647165e] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:33:58.398131 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-798a4278-f98d-4b1d-80be-782458f5b6e4 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:58.399907 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-798a4278-f98d-4b1d-80be-782458f5b6e4 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:58.400919 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-798a4278-f98d-4b1d-80be-782458f5b6e4 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:58.403277 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-798a4278-f98d-4b1d-80be-782458f5b6e4 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:58.404101 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-798a4278-f98d-4b1d-80be-782458f5b6e4 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:58.405021 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-798a4278-f98d-4b1d-80be-782458f5b6e4 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:58.472084 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-798a4278-f98d-4b1d-80be-782458f5b6e4 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] [instance: 8d254a92-15fa-4d98-8954-a8028647165e] Going to try to terminate instance {{(pid=125441) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 12:33:58.524835 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [req-a32710b4-d809-44c1-88bc-fd777dd56ffb req-f5b6d532-d858-4a49-b266-b305affb003b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "852e8870-b3ec-4a21-a9b5-e31a423ddd3d", "tag": "dffec82d-007b-4838-9898-19da61885395"}]} {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 12:33:58.548109 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [req-a32710b4-d809-44c1-88bc-fd777dd56ffb req-f5b6d532-d858-4a49-b266-b305affb003b service nova] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:58.549736 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [req-a32710b4-d809-44c1-88bc-fd777dd56ffb req-f5b6d532-d858-4a49-b266-b305affb003b service nova] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:58.551926 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [req-a32710b4-d809-44c1-88bc-fd777dd56ffb req-f5b6d532-d858-4a49-b266-b305affb003b service nova] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:58.602766 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.compute.server_external_events [req-a32710b4-d809-44c1-88bc-fd777dd56ffb req-f5b6d532-d858-4a49-b266-b305affb003b service nova] Creating event network-changed:dffec82d-007b-4838-9898-19da61885395 for instance 852e8870-b3ec-4a21-a9b5-e31a423ddd3d on hv-cinder-79617 Oct 31 12:33:58.621730 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [req-a32710b4-d809-44c1-88bc-fd777dd56ffb req-f5b6d532-d858-4a49-b266-b305affb003b service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103022 Oct 31 12:33:58.629520 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 93/175] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Oct 31 12:33:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 12:33:58.670029 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-798a4278-f98d-4b1d-80be-782458f5b6e4 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] 10.222.0.15 "DELETE /compute/v2.1/servers/8d254a92-15fa-4d98-8954-a8028647165e" status: 204 len: 0 microversion: 2.1 time: 0.288919 Oct 31 12:33:58.670831 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 83/176] 10.222.0.15 () {58 vars in 1239 bytes} [Mon Oct 31 12:33:58 2022] DELETE /compute/v2.1/servers/8d254a92-15fa-4d98-8954-a8028647165e => generated 0 bytes in 291 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 12:33:58.681160 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-b6c0f4bf-f4d3-4598-a6f0-9f7986f1405c tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:33:58.681899 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-b6c0f4bf-f4d3-4598-a6f0-9f7986f1405c tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] [instance: 8d254a92-15fa-4d98-8954-a8028647165e] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:33:58.698156 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-b6c0f4bf-f4d3-4598-a6f0-9f7986f1405c tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:58.698675 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-b6c0f4bf-f4d3-4598-a6f0-9f7986f1405c tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:58.699111 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-b6c0f4bf-f4d3-4598-a6f0-9f7986f1405c tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:58.702319 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-b6c0f4bf-f4d3-4598-a6f0-9f7986f1405c tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:58.702790 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-b6c0f4bf-f4d3-4598-a6f0-9f7986f1405c tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:58.706954 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-b6c0f4bf-f4d3-4598-a6f0-9f7986f1405c tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:58.888050 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-6d4247d7-ab3d-4f85-aeeb-9cf331d3637c tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:33:58.889035 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-6d4247d7-ab3d-4f85-aeeb-9cf331d3637c tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] [instance: 9906becc-a42b-4b4c-855a-450915f7a3f8] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:33:58.894088 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-b6c0f4bf-f4d3-4598-a6f0-9f7986f1405c tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d59ee6f94848308665a32099cf5255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4d5cd8851dc4216b4e3e035a32decad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:33:58.904668 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-b6c0f4bf-f4d3-4598-a6f0-9f7986f1405c tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] 10.222.0.15 "GET /compute/v2.1/servers/8d254a92-15fa-4d98-8954-a8028647165e" status: 200 len: 1553 microversion: 2.1 time: 0.228940 Oct 31 12:33:58.905784 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 94/177] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:33:58 2022] GET /compute/v2.1/servers/8d254a92-15fa-4d98-8954-a8028647165e => generated 1553 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:33:58.919575 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-6d4247d7-ab3d-4f85-aeeb-9cf331d3637c tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:58.925482 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-6d4247d7-ab3d-4f85-aeeb-9cf331d3637c tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:58.927806 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-da4a8cfe-e79a-466e-8e7e-6ed77c9334fa tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:33:58.928381 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-6d4247d7-ab3d-4f85-aeeb-9cf331d3637c tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:58.929110 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-6d4247d7-ab3d-4f85-aeeb-9cf331d3637c tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:58.929567 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-6d4247d7-ab3d-4f85-aeeb-9cf331d3637c tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:58.929980 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-6d4247d7-ab3d-4f85-aeeb-9cf331d3637c tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:58.933150 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-da4a8cfe-e79a-466e-8e7e-6ed77c9334fa tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] [instance: d0befdd2-2ecd-4006-bfdd-86d5253a7687] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:33:58.940874 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-da4a8cfe-e79a-466e-8e7e-6ed77c9334fa tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:58.941358 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-da4a8cfe-e79a-466e-8e7e-6ed77c9334fa tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:58.941781 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-da4a8cfe-e79a-466e-8e7e-6ed77c9334fa tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:58.942474 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-da4a8cfe-e79a-466e-8e7e-6ed77c9334fa tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:58.942916 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-da4a8cfe-e79a-466e-8e7e-6ed77c9334fa tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:58.946221 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-da4a8cfe-e79a-466e-8e7e-6ed77c9334fa tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:59.187449 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-6d4247d7-ab3d-4f85-aeeb-9cf331d3637c tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c03f0365ee4a26b8c076ae365325b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfbc3a46f12942299b99cdd20c989e1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:33:59.191066 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG dbcounter [-] [125441] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=125441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:33:59.202266 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-6d4247d7-ab3d-4f85-aeeb-9cf331d3637c tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] 10.222.0.15 "GET /compute/v2.1/servers/9906becc-a42b-4b4c-855a-450915f7a3f8" status: 200 len: 1366 microversion: 2.1 time: 0.321200 Oct 31 12:33:59.203352 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 84/178] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:33:58 2022] GET /compute/v2.1/servers/9906becc-a42b-4b4c-855a-450915f7a3f8 => generated 1366 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 12:33:59.592146 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-da4a8cfe-e79a-466e-8e7e-6ed77c9334fa tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2e978bcb824a5e9d593b861c9e3bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7573cb9c503243ab90b1649591d550e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:33:59.601841 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-da4a8cfe-e79a-466e-8e7e-6ed77c9334fa tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] 10.222.0.15 "GET /compute/v2.1/servers/d0befdd2-2ecd-4006-bfdd-86d5253a7687" status: 200 len: 1522 microversion: 2.1 time: 0.680274 Oct 31 12:33:59.603092 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 95/179] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:33:58 2022] GET /compute/v2.1/servers/d0befdd2-2ecd-4006-bfdd-86d5253a7687 => generated 1522 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 12:33:59.933455 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-e2d6ee5f-25aa-4c42-bab0-14a3e938e384 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:33:59.934413 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-e2d6ee5f-25aa-4c42-bab0-14a3e938e384 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] [instance: 8d254a92-15fa-4d98-8954-a8028647165e] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:33:59.942107 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-e2d6ee5f-25aa-4c42-bab0-14a3e938e384 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:59.942874 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-e2d6ee5f-25aa-4c42-bab0-14a3e938e384 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:59.943336 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-e2d6ee5f-25aa-4c42-bab0-14a3e938e384 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:33:59.944263 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-e2d6ee5f-25aa-4c42-bab0-14a3e938e384 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:33:59.944926 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-e2d6ee5f-25aa-4c42-bab0-14a3e938e384 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:33:59.945579 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-e2d6ee5f-25aa-4c42-bab0-14a3e938e384 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:34:00.097969 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-e2d6ee5f-25aa-4c42-bab0-14a3e938e384 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d59ee6f94848308665a32099cf5255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4d5cd8851dc4216b4e3e035a32decad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:34:00.106240 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-e2d6ee5f-25aa-4c42-bab0-14a3e938e384 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] 10.222.0.15 "GET /compute/v2.1/servers/8d254a92-15fa-4d98-8954-a8028647165e" status: 200 len: 1553 microversion: 2.1 time: 0.179282 Oct 31 12:34:00.106822 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 85/180] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:33:59 2022] GET /compute/v2.1/servers/8d254a92-15fa-4d98-8954-a8028647165e => generated 1553 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:34:00.226793 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-517b2c46-49a5-43e3-a44c-c643301400ac tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:34:00.227425 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-517b2c46-49a5-43e3-a44c-c643301400ac tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] [instance: 9906becc-a42b-4b4c-855a-450915f7a3f8] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:34:00.234030 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-517b2c46-49a5-43e3-a44c-c643301400ac tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:34:00.234512 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-517b2c46-49a5-43e3-a44c-c643301400ac tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:34:00.234949 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-517b2c46-49a5-43e3-a44c-c643301400ac tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:34:00.235703 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-517b2c46-49a5-43e3-a44c-c643301400ac tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:34:00.236733 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-517b2c46-49a5-43e3-a44c-c643301400ac tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:34:00.237402 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-517b2c46-49a5-43e3-a44c-c643301400ac tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:34:00.378336 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-517b2c46-49a5-43e3-a44c-c643301400ac tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c03f0365ee4a26b8c076ae365325b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfbc3a46f12942299b99cdd20c989e1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:34:00.386031 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-517b2c46-49a5-43e3-a44c-c643301400ac tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] 10.222.0.15 "GET /compute/v2.1/servers/9906becc-a42b-4b4c-855a-450915f7a3f8" status: 200 len: 1366 microversion: 2.1 time: 0.163051 Oct 31 12:34:00.386797 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 96/181] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:34:00 2022] GET /compute/v2.1/servers/9906becc-a42b-4b4c-855a-450915f7a3f8 => generated 1366 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:34:00.633507 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-3cad8bc1-c407-4937-a88b-108886049da1 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:34:00.648665 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-3cad8bc1-c407-4937-a88b-108886049da1 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] [instance: d0befdd2-2ecd-4006-bfdd-86d5253a7687] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:34:00.657017 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-3cad8bc1-c407-4937-a88b-108886049da1 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:34:00.659009 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-3cad8bc1-c407-4937-a88b-108886049da1 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:34:00.659689 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-3cad8bc1-c407-4937-a88b-108886049da1 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:34:00.660738 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-3cad8bc1-c407-4937-a88b-108886049da1 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:34:00.661422 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-3cad8bc1-c407-4937-a88b-108886049da1 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:34:00.662370 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-3cad8bc1-c407-4937-a88b-108886049da1 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:34:00.750738 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-c27d71ee-40b3-4b7e-9e95-3531a11427a1 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-600080988", "imageRef": "fbbea321-8f0d-4092-b070-b67a6931d610", "flavorRef": "452", "networks": [{"uuid": "73b5b0af-fcc7-400d-b4a0-01ab3625769f"}]}} {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 12:34:00.831350 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.network.neutron [None req-c27d71ee-40b3-4b7e-9e95-3531a11427a1 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] validate_networks() for [('73b5b0af-fcc7-400d-b4a0-01ab3625769f', None, None, None, None, None)] {{(pid=125440) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 12:34:00.835714 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-3cad8bc1-c407-4937-a88b-108886049da1 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2e978bcb824a5e9d593b861c9e3bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7573cb9c503243ab90b1649591d550e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:34:00.843984 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-3cad8bc1-c407-4937-a88b-108886049da1 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] 10.222.0.15 "GET /compute/v2.1/servers/d0befdd2-2ecd-4006-bfdd-86d5253a7687" status: 200 len: 1522 microversion: 2.1 time: 0.222242 Oct 31 12:34:00.844539 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 86/182] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:34:00 2022] GET /compute/v2.1/servers/d0befdd2-2ecd-4006-bfdd-86d5253a7687 => generated 1522 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 12:34:01.129927 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-9bdd594e-d71b-47ab-adae-a25aec4addc4 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:34:01.130576 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-9bdd594e-d71b-47ab-adae-a25aec4addc4 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] [instance: 8d254a92-15fa-4d98-8954-a8028647165e] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:34:01.137090 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-9bdd594e-d71b-47ab-adae-a25aec4addc4 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:34:01.137571 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-9bdd594e-d71b-47ab-adae-a25aec4addc4 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:34:01.138000 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-9bdd594e-d71b-47ab-adae-a25aec4addc4 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:34:01.138688 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-9bdd594e-d71b-47ab-adae-a25aec4addc4 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:34:01.139140 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-9bdd594e-d71b-47ab-adae-a25aec4addc4 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:34:01.139723 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-9bdd594e-d71b-47ab-adae-a25aec4addc4 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:34:01.382774 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-9bdd594e-d71b-47ab-adae-a25aec4addc4 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d59ee6f94848308665a32099cf5255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4d5cd8851dc4216b4e3e035a32decad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:34:01.391662 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-9bdd594e-d71b-47ab-adae-a25aec4addc4 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] 10.222.0.15 "GET /compute/v2.1/servers/8d254a92-15fa-4d98-8954-a8028647165e" status: 200 len: 1553 microversion: 2.1 time: 0.265882 Oct 31 12:34:01.394940 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 87/183] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:34:01 2022] GET /compute/v2.1/servers/8d254a92-15fa-4d98-8954-a8028647165e => generated 1553 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 12:34:01.432040 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-794d1a5a-db3e-4150-982c-79f28dd7e48e tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:34:01.432967 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-794d1a5a-db3e-4150-982c-79f28dd7e48e tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] [instance: 9906becc-a42b-4b4c-855a-450915f7a3f8] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:34:01.440833 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-794d1a5a-db3e-4150-982c-79f28dd7e48e tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:34:01.441653 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-794d1a5a-db3e-4150-982c-79f28dd7e48e tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:34:01.442513 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-794d1a5a-db3e-4150-982c-79f28dd7e48e tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:34:01.443368 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-794d1a5a-db3e-4150-982c-79f28dd7e48e tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:34:01.444055 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-794d1a5a-db3e-4150-982c-79f28dd7e48e tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:34:01.444747 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-794d1a5a-db3e-4150-982c-79f28dd7e48e tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:34:01.747493 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-794d1a5a-db3e-4150-982c-79f28dd7e48e tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c03f0365ee4a26b8c076ae365325b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfbc3a46f12942299b99cdd20c989e1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:34:01.756837 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-794d1a5a-db3e-4150-982c-79f28dd7e48e tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] 10.222.0.15 "GET /compute/v2.1/servers/9906becc-a42b-4b4c-855a-450915f7a3f8" status: 200 len: 1557 microversion: 2.1 time: 0.329688 Oct 31 12:34:01.776734 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 88/184] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:34:01 2022] GET /compute/v2.1/servers/9906becc-a42b-4b4c-855a-450915f7a3f8 => generated 1557 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:34:01.785097 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-0236092d-b200-44db-a64b-f44c0bd829a1 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:34:01.785786 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-0236092d-b200-44db-a64b-f44c0bd829a1 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] [instance: 9906becc-a42b-4b4c-855a-450915f7a3f8] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:34:01.794835 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-0236092d-b200-44db-a64b-f44c0bd829a1 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:34:01.801677 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-0236092d-b200-44db-a64b-f44c0bd829a1 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:34:01.802598 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-0236092d-b200-44db-a64b-f44c0bd829a1 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:34:01.806285 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-0236092d-b200-44db-a64b-f44c0bd829a1 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:34:01.807009 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-0236092d-b200-44db-a64b-f44c0bd829a1 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:34:01.808553 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-0236092d-b200-44db-a64b-f44c0bd829a1 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:34:01.869432 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.virt.hardware [None req-c27d71ee-40b3-4b7e-9e95-3531a11427a1 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Flavor limits 0:0:0 {{(pid=125440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 12:34:01.870423 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.virt.hardware [None req-c27d71ee-40b3-4b7e-9e95-3531a11427a1 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Image limits 0:0:0 {{(pid=125440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 12:34:01.871273 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.virt.hardware [None req-c27d71ee-40b3-4b7e-9e95-3531a11427a1 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Flavor pref 0:0:0 {{(pid=125440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 12:34:01.872035 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.virt.hardware [None req-c27d71ee-40b3-4b7e-9e95-3531a11427a1 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Image pref 0:0:0 {{(pid=125440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 12:34:01.872591 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.virt.hardware [None req-c27d71ee-40b3-4b7e-9e95-3531a11427a1 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 12:34:01.882340 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-c27d71ee-40b3-4b7e-9e95-3531a11427a1 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:34:01.883059 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-c27d71ee-40b3-4b7e-9e95-3531a11427a1 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:34:01.884416 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-c27d71ee-40b3-4b7e-9e95-3531a11427a1 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:34:01.885307 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-c27d71ee-40b3-4b7e-9e95-3531a11427a1 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:34:01.885943 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-c27d71ee-40b3-4b7e-9e95-3531a11427a1 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:34:01.886512 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-c27d71ee-40b3-4b7e-9e95-3531a11427a1 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:34:01.911806 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.quota [None req-c27d71ee-40b3-4b7e-9e95-3531a11427a1 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Getting quotas for project 4fe4270c111747be8d61e4ae993bd7ba. Resources: {'instances', 'cores', 'ram'} {{(pid=125440) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 12:34:01.917476 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.quota [None req-c27d71ee-40b3-4b7e-9e95-3531a11427a1 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Getting quotas for user 1918cb60ccd04e909b78dca9b0166be9 and project 4fe4270c111747be8d61e4ae993bd7ba. Resources: {'instances', 'cores', 'ram'} {{(pid=125440) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 12:34:01.924158 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-0236092d-b200-44db-a64b-f44c0bd829a1 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] 10.222.0.15 "GET /compute/v2.1/servers/9906becc-a42b-4b4c-855a-450915f7a3f8/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.145359 Oct 31 12:34:01.924942 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 89/185] 10.222.0.15 () {58 vars in 1275 bytes} [Mon Oct 31 12:34:01 2022] GET /compute/v2.1/servers/9906becc-a42b-4b4c-855a-450915f7a3f8/os-interface => generated 285 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 12:34:01.940414 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-6a707cba-d3c2-4687-9a7b-4f2e5becd2a4 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:34:01.940414 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-6a707cba-d3c2-4687-9a7b-4f2e5becd2a4 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] [instance: d0befdd2-2ecd-4006-bfdd-86d5253a7687] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:34:01.945867 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-c27d71ee-40b3-4b7e-9e95-3531a11427a1 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Going to run 1 instances... {{(pid=125440) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 12:34:01.948236 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-c27d71ee-40b3-4b7e-9e95-3531a11427a1 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] [instance: 6f831a26-c1a4-4518-870e-6dd64516719c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fbbea321-8f0d-4092-b070-b67a6931d610',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125440) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 12:34:01.961254 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-6a707cba-d3c2-4687-9a7b-4f2e5becd2a4 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:34:01.961770 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-6a707cba-d3c2-4687-9a7b-4f2e5becd2a4 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:34:01.967045 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-6a707cba-d3c2-4687-9a7b-4f2e5becd2a4 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:34:01.968124 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-6a707cba-d3c2-4687-9a7b-4f2e5becd2a4 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:34:01.968792 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-6a707cba-d3c2-4687-9a7b-4f2e5becd2a4 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:34:01.969384 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-6a707cba-d3c2-4687-9a7b-4f2e5becd2a4 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:34:02.041198 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-c27d71ee-40b3-4b7e-9e95-3531a11427a1 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.294617 Oct 31 12:34:02.043021 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 97/186] 10.222.0.15 () {60 vars in 1147 bytes} [Mon Oct 31 12:34:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 1296 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 12:34:02.054769 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-37504268-528d-4bf1-a285-95579db9de1a tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:34:02.055409 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-37504268-528d-4bf1-a285-95579db9de1a tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] [instance: 6f831a26-c1a4-4518-870e-6dd64516719c] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:34:02.203129 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-37504268-528d-4bf1-a285-95579db9de1a tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1918cb60ccd04e909b78dca9b0166be9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe4270c111747be8d61e4ae993bd7ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:34:02.217076 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-37504268-528d-4bf1-a285-95579db9de1a tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] 10.222.0.15 "GET /compute/v2.1/servers/6f831a26-c1a4-4518-870e-6dd64516719c" status: 200 len: 1213 microversion: 2.1 time: 0.166327 Oct 31 12:34:02.223377 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 98/187] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:34:02 2022] GET /compute/v2.1/servers/6f831a26-c1a4-4518-870e-6dd64516719c => generated 1213 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 12:34:02.423462 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-6fc89144-837e-4416-98eb-4f0045b7d437 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:34:02.424833 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-6fc89144-837e-4416-98eb-4f0045b7d437 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] [instance: 8d254a92-15fa-4d98-8954-a8028647165e] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:34:02.431764 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-6fc89144-837e-4416-98eb-4f0045b7d437 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:34:02.432472 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-6fc89144-837e-4416-98eb-4f0045b7d437 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:34:02.433060 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-6fc89144-837e-4416-98eb-4f0045b7d437 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:34:02.433980 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-6fc89144-837e-4416-98eb-4f0045b7d437 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:34:02.434852 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-6fc89144-837e-4416-98eb-4f0045b7d437 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:34:02.435700 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-6fc89144-837e-4416-98eb-4f0045b7d437 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:34:02.882370 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-6fc89144-837e-4416-98eb-4f0045b7d437 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d59ee6f94848308665a32099cf5255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4d5cd8851dc4216b4e3e035a32decad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:34:02.899796 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-6fc89144-837e-4416-98eb-4f0045b7d437 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] 10.222.0.15 "GET /compute/v2.1/servers/8d254a92-15fa-4d98-8954-a8028647165e" status: 200 len: 1553 microversion: 2.1 time: 0.473444 Oct 31 12:34:02.900490 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 99/188] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:34:02 2022] GET /compute/v2.1/servers/8d254a92-15fa-4d98-8954-a8028647165e => generated 1553 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 12:34:03.133571 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-6a707cba-d3c2-4687-9a7b-4f2e5becd2a4 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2e978bcb824a5e9d593b861c9e3bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7573cb9c503243ab90b1649591d550e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:34:03.154648 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-6a707cba-d3c2-4687-9a7b-4f2e5becd2a4 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] 10.222.0.15 "GET /compute/v2.1/servers/d0befdd2-2ecd-4006-bfdd-86d5253a7687" status: 200 len: 1522 microversion: 2.1 time: 1.222115 Oct 31 12:34:03.158793 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 90/189] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:34:01 2022] GET /compute/v2.1/servers/d0befdd2-2ecd-4006-bfdd-86d5253a7687 => generated 1522 bytes in 1227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:34:03.222314 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [req-d3f45525-ef18-41ff-b873-3062635eaf9a req-4461dea1-a1b1-4cd3-bcbf-214cf69c9ae2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d254a92-15fa-4d98-8954-a8028647165e", "name": "network-vif-deleted", "tag": "526d397e-43ed-4b15-84f5-0072c801c1b0"}]} {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 12:34:03.232866 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [req-d3f45525-ef18-41ff-b873-3062635eaf9a req-4461dea1-a1b1-4cd3-bcbf-214cf69c9ae2 service nova] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:34:03.233610 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [req-d3f45525-ef18-41ff-b873-3062635eaf9a req-4461dea1-a1b1-4cd3-bcbf-214cf69c9ae2 service nova] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:34:03.234207 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [req-d3f45525-ef18-41ff-b873-3062635eaf9a req-4461dea1-a1b1-4cd3-bcbf-214cf69c9ae2 service nova] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:34:03.269683 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.compute.server_external_events [req-d3f45525-ef18-41ff-b873-3062635eaf9a req-4461dea1-a1b1-4cd3-bcbf-214cf69c9ae2 service nova] Creating event network-vif-deleted:526d397e-43ed-4b15-84f5-0072c801c1b0 for instance 8d254a92-15fa-4d98-8954-a8028647165e on hv-cinder-79617 Oct 31 12:34:03.283793 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-e15aa846-82fe-49a9-8c81-8ee8a8811668 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:34:03.283793 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-e15aa846-82fe-49a9-8c81-8ee8a8811668 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] [instance: 6f831a26-c1a4-4518-870e-6dd64516719c] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:34:03.299601 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [req-d3f45525-ef18-41ff-b873-3062635eaf9a req-4461dea1-a1b1-4cd3-bcbf-214cf69c9ae2 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080441 Oct 31 12:34:03.302306 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-e15aa846-82fe-49a9-8c81-8ee8a8811668 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:34:03.302791 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-e15aa846-82fe-49a9-8c81-8ee8a8811668 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:34:03.303245 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-e15aa846-82fe-49a9-8c81-8ee8a8811668 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:34:03.303944 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-e15aa846-82fe-49a9-8c81-8ee8a8811668 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:34:03.306694 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 100/190] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Oct 31 12:34:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 12:34:03.316103 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-e15aa846-82fe-49a9-8c81-8ee8a8811668 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:34:03.319682 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-e15aa846-82fe-49a9-8c81-8ee8a8811668 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:34:03.488924 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-e15aa846-82fe-49a9-8c81-8ee8a8811668 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1918cb60ccd04e909b78dca9b0166be9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe4270c111747be8d61e4ae993bd7ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:34:03.497754 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-e15aa846-82fe-49a9-8c81-8ee8a8811668 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] 10.222.0.15 "GET /compute/v2.1/servers/6f831a26-c1a4-4518-870e-6dd64516719c" status: 200 len: 1265 microversion: 2.1 time: 0.253460 Oct 31 12:34:03.521308 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 91/191] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:34:03 2022] GET /compute/v2.1/servers/6f831a26-c1a4-4518-870e-6dd64516719c => generated 1265 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 12:34:03.925989 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-0de062ca-9fa7-4519-b5a3-a7fd7c6edb4c tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:34:03.926885 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-0de062ca-9fa7-4519-b5a3-a7fd7c6edb4c tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] [instance: 8d254a92-15fa-4d98-8954-a8028647165e] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:34:03.933596 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-0de062ca-9fa7-4519-b5a3-a7fd7c6edb4c tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:34:03.934599 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-0de062ca-9fa7-4519-b5a3-a7fd7c6edb4c tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:34:03.935187 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-0de062ca-9fa7-4519-b5a3-a7fd7c6edb4c tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:34:03.937724 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-0de062ca-9fa7-4519-b5a3-a7fd7c6edb4c tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:34:03.938252 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-0de062ca-9fa7-4519-b5a3-a7fd7c6edb4c tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:34:03.938742 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-0de062ca-9fa7-4519-b5a3-a7fd7c6edb4c tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:34:03.992126 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-0de062ca-9fa7-4519-b5a3-a7fd7c6edb4c tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:34:03.992524 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-0de062ca-9fa7-4519-b5a3-a7fd7c6edb4c tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:34:03.993003 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-0de062ca-9fa7-4519-b5a3-a7fd7c6edb4c tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:34:03.993463 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.objects.instance [None req-0de062ca-9fa7-4519-b5a3-a7fd7c6edb4c tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Lazy-loading 'fault' on Instance uuid 8d254a92-15fa-4d98-8954-a8028647165e {{(pid=125440) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 12:34:04.183478 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-0de062ca-9fa7-4519-b5a3-a7fd7c6edb4c tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d59ee6f94848308665a32099cf5255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4d5cd8851dc4216b4e3e035a32decad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:34:04.190622 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-edb6f21e-2715-401f-9694-daf2e36e06a5 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:34:04.191211 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-edb6f21e-2715-401f-9694-daf2e36e06a5 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] [instance: d0befdd2-2ecd-4006-bfdd-86d5253a7687] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:34:04.214240 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-0de062ca-9fa7-4519-b5a3-a7fd7c6edb4c tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] 10.222.0.15 "GET /compute/v2.1/servers/8d254a92-15fa-4d98-8954-a8028647165e" status: 200 len: 1350 microversion: 2.1 time: 0.293749 Oct 31 12:34:04.215210 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 101/192] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:34:03 2022] GET /compute/v2.1/servers/8d254a92-15fa-4d98-8954-a8028647165e => generated 1350 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:34:04.216639 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-edb6f21e-2715-401f-9694-daf2e36e06a5 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:34:04.221105 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-edb6f21e-2715-401f-9694-daf2e36e06a5 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:34:04.223002 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-edb6f21e-2715-401f-9694-daf2e36e06a5 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:34:04.226079 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-edb6f21e-2715-401f-9694-daf2e36e06a5 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:34:04.227693 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-edb6f21e-2715-401f-9694-daf2e36e06a5 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:34:04.231148 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-edb6f21e-2715-401f-9694-daf2e36e06a5 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:34:04.530021 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-0790084e-3236-497a-b941-ed1b32135d51 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:34:04.530929 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-0790084e-3236-497a-b941-ed1b32135d51 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] [instance: 6f831a26-c1a4-4518-870e-6dd64516719c] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:34:04.542514 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-0790084e-3236-497a-b941-ed1b32135d51 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:34:04.543033 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-0790084e-3236-497a-b941-ed1b32135d51 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:34:04.543643 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-0790084e-3236-497a-b941-ed1b32135d51 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:34:04.544488 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-0790084e-3236-497a-b941-ed1b32135d51 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:34:04.545086 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-0790084e-3236-497a-b941-ed1b32135d51 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:34:04.545671 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-0790084e-3236-497a-b941-ed1b32135d51 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:34:04.644945 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-edb6f21e-2715-401f-9694-daf2e36e06a5 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2e978bcb824a5e9d593b861c9e3bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7573cb9c503243ab90b1649591d550e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:34:04.656000 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-edb6f21e-2715-401f-9694-daf2e36e06a5 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] 10.222.0.15 "GET /compute/v2.1/servers/d0befdd2-2ecd-4006-bfdd-86d5253a7687" status: 200 len: 1522 microversion: 2.1 time: 0.480748 Oct 31 12:34:04.659101 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 92/193] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:34:04 2022] GET /compute/v2.1/servers/d0befdd2-2ecd-4006-bfdd-86d5253a7687 => generated 1522 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:34:04.967611 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-0790084e-3236-497a-b941-ed1b32135d51 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1918cb60ccd04e909b78dca9b0166be9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe4270c111747be8d61e4ae993bd7ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:34:04.981560 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-0790084e-3236-497a-b941-ed1b32135d51 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] 10.222.0.15 "GET /compute/v2.1/servers/6f831a26-c1a4-4518-870e-6dd64516719c" status: 200 len: 1271 microversion: 2.1 time: 0.457151 Oct 31 12:34:04.983438 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 102/194] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:34:04 2022] GET /compute/v2.1/servers/6f831a26-c1a4-4518-870e-6dd64516719c => generated 1271 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:34:05.073314 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [req-10723af4-6b37-41ca-ba94-7c5da752d89a req-7e9854d5-e307-4c58-8363-271f2e7defbd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9906becc-a42b-4b4c-855a-450915f7a3f8", "tag": "ffe46aaf-72a4-4c15-9506-ca33161dddf3"}]} {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 12:34:05.087650 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [req-10723af4-6b37-41ca-ba94-7c5da752d89a req-7e9854d5-e307-4c58-8363-271f2e7defbd service nova] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:34:05.088546 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [req-10723af4-6b37-41ca-ba94-7c5da752d89a req-7e9854d5-e307-4c58-8363-271f2e7defbd service nova] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:34:05.089245 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [req-10723af4-6b37-41ca-ba94-7c5da752d89a req-7e9854d5-e307-4c58-8363-271f2e7defbd service nova] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:34:05.104179 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.compute.server_external_events [req-10723af4-6b37-41ca-ba94-7c5da752d89a req-7e9854d5-e307-4c58-8363-271f2e7defbd service nova] Creating event network-changed:ffe46aaf-72a4-4c15-9506-ca33161dddf3 for instance 9906becc-a42b-4b4c-855a-450915f7a3f8 on hv-cinder-79617 Oct 31 12:34:05.110937 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [req-10723af4-6b37-41ca-ba94-7c5da752d89a req-7e9854d5-e307-4c58-8363-271f2e7defbd service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040965 Oct 31 12:34:05.111995 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 93/195] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Oct 31 12:34:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 12:34:05.241921 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-df771515-e619-4841-9dff-03feb7bf0ed1 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:34:05.242930 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-df771515-e619-4841-9dff-03feb7bf0ed1 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] [instance: 8d254a92-15fa-4d98-8954-a8028647165e] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:34:05.252547 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-df771515-e619-4841-9dff-03feb7bf0ed1 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:34:05.253617 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-df771515-e619-4841-9dff-03feb7bf0ed1 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:34:05.254529 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-df771515-e619-4841-9dff-03feb7bf0ed1 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:34:05.255665 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-df771515-e619-4841-9dff-03feb7bf0ed1 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:34:05.256350 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-df771515-e619-4841-9dff-03feb7bf0ed1 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:34:05.257028 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-df771515-e619-4841-9dff-03feb7bf0ed1 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:34:05.261978 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG dbcounter [-] [125440] Writing DB stats nova_cell1:SELECT=100 {{(pid=125440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:34:05.275884 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.wsgi [None req-df771515-e619-4841-9dff-03feb7bf0ed1 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] HTTP exception thrown: Instance 8d254a92-15fa-4d98-8954-a8028647165e could not be found. Oct 31 12:34:05.281312 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-df771515-e619-4841-9dff-03feb7bf0ed1 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Request method failure captured: Oct 31 12:34:05.281312 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: request: GET /compute/v2.1/servers/8d254a92-15fa-4d98-8954-a8028647165e HTTP/1.1 Oct 31 12:34:05.281312 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: Accept: application/json Oct 31 12:34:05.281312 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: Accept-Encoding: identity Oct 31 12:34:05.281312 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: Connection: close Oct 31 12:34:05.281312 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: Content-Length: 0 Oct 31 12:34:05.281312 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: Content-Type: application/json Oct 31 12:34:05.281312 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: Host: 10.222.0.15 Oct 31 12:34:05.281312 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: Openstack-System-Scope: None Oct 31 12:34:05.281312 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: User-Agent: python-urllib3/1.26.12 Oct 31 12:34:05.281312 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Auth-Token: gAAAAABjX8B7EZr063h332d-KLmp2IUH7ewwTYpDnRljBBH09kW7KExUGfRIe4eMMDvWgKqga4kG8dxF84srOJK_9NzQc8ZBAOidVwMG_FbTNGcdIcaZkydv5mA8afhZ29ls2aboD3EWQuFGXdZDSiVgeHEYo06yHVZjcaMhIUYFjSGv-FYmTa8 Oct 31 12:34:05.281312 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Domain-Id: None Oct 31 12:34:05.281312 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Domain-Name: None Oct 31 12:34:05.281312 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Identity-Status: Confirmed Oct 31 12:34:05.281312 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Is-Admin-Project: True Oct 31 12:34:05.281312 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Project-Domain-Id: default Oct 31 12:34:05.281312 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Project-Domain-Name: Default Oct 31 12:34:05.281312 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Project-Id: a4d5cd8851dc4216b4e3e035a32decad Oct 31 12:34:05.281312 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Project-Name: tempest-DeleteServersTestJSON-1374602671 Oct 31 12:34:05.281312 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Role: reader,member Oct 31 12:34:05.281312 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Roles: reader,member Oct 31 12:34:05.282593 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/a4d5cd8851dc4216b4e3e035a32decad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_a4d5cd8851dc4216b4e3e035a32decad", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/a4d5cd8851dc4216b4e3e035a32decad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/a4d5cd8851dc4216b4e3e035a32decad"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Oct 31 12:34:05.282593 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Tenant: tempest-DeleteServersTestJSON-1374602671 Oct 31 12:34:05.282593 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Tenant-Id: a4d5cd8851dc4216b4e3e035a32decad Oct 31 12:34:05.282593 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Tenant-Name: tempest-DeleteServersTestJSON-1374602671 Oct 31 12:34:05.282593 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-User: tempest-DeleteServersTestJSON-1374602671-project Oct 31 12:34:05.282593 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-User-Domain-Id: default Oct 31 12:34:05.282593 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-User-Domain-Name: Default Oct 31 12:34:05.282593 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-User-Id: 70d59ee6f94848308665a32099cf5255 Oct 31 12:34:05.282593 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-User-Name: tempest-DeleteServersTestJSON-1374602671-project Oct 31 12:34:05.282593 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: method: > Oct 31 12:34:05.282593 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: exception: Instance 8d254a92-15fa-4d98-8954-a8028647165e could not be found. Oct 31 12:34:05.282593 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: action_args: {'id': '8d254a92-15fa-4d98-8954-a8028647165e'} Oct 31 12:34:05.283553 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 12:34:05.283553 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 12:34:05.283553 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 12:34:05.283553 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 12:34:05.283553 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 12:34:05.283553 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 12:34:05.283553 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 12:34:05.283553 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 12:34:05.283553 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 12:34:05.283553 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 12:34:05.283553 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d254a92-15fa-4d98-8954-a8028647165e could not be found. Oct 31 12:34:05.283553 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Oct 31 12:34:05.283553 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 12:34:05.283553 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Oct 31 12:34:05.283553 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 12:34:05.283553 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 12:34:05.283553 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 12:34:05.283553 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 12:34:05.283553 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 12:34:05.283553 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 12:34:05.285031 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 12:34:05.285031 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 12:34:05.285031 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 12:34:05.285031 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 12:34:05.285031 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 12:34:05.285031 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 12:34:05.285031 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 12:34:05.285031 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d254a92-15fa-4d98-8954-a8028647165e could not be found. Oct 31 12:34:05.285031 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Oct 31 12:34:05.285031 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 12:34:05.285031 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Oct 31 12:34:05.285031 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 12:34:05.285031 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 12:34:05.285031 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 12:34:05.285031 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 12:34:05.285031 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 12:34:05.285031 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d254a92-15fa-4d98-8954-a8028647165e could not be found. Oct 31 12:34:05.285031 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Oct 31 12:34:05.287816 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-df771515-e619-4841-9dff-03feb7bf0ed1 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Returning 404 to user: Instance 8d254a92-15fa-4d98-8954-a8028647165e could not be found. {{(pid=125440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 12:34:05.288920 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-df771515-e619-4841-9dff-03feb7bf0ed1 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] 10.222.0.15 "GET /compute/v2.1/servers/8d254a92-15fa-4d98-8954-a8028647165e" status: 404 len: 111 microversion: 2.1 time: 0.052154 Oct 31 12:34:05.293283 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 103/196] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:34:05 2022] GET /compute/v2.1/servers/8d254a92-15fa-4d98-8954-a8028647165e => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 12:34:05.476071 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-5b64e2d5-b6d9-4803-af67-3b4669884fc6 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:34:05.478551 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-5b64e2d5-b6d9-4803-af67-3b4669884fc6 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] [instance: 8d254a92-15fa-4d98-8954-a8028647165e] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:34:05.488183 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-5b64e2d5-b6d9-4803-af67-3b4669884fc6 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:34:05.488673 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-5b64e2d5-b6d9-4803-af67-3b4669884fc6 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:34:05.489107 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-5b64e2d5-b6d9-4803-af67-3b4669884fc6 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:34:05.489815 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-5b64e2d5-b6d9-4803-af67-3b4669884fc6 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:34:05.490264 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-5b64e2d5-b6d9-4803-af67-3b4669884fc6 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:34:05.490844 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-5b64e2d5-b6d9-4803-af67-3b4669884fc6 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:34:05.507994 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.wsgi [None req-5b64e2d5-b6d9-4803-af67-3b4669884fc6 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] HTTP exception thrown: Instance 8d254a92-15fa-4d98-8954-a8028647165e could not be found. Oct 31 12:34:05.515801 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-5b64e2d5-b6d9-4803-af67-3b4669884fc6 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Request method failure captured: Oct 31 12:34:05.515801 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: request: GET /compute/v2.1/servers/8d254a92-15fa-4d98-8954-a8028647165e/os-volume_attachments HTTP/1.1 Oct 31 12:34:05.515801 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: Accept: application/json Oct 31 12:34:05.515801 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: Accept-Encoding: identity Oct 31 12:34:05.515801 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: Connection: close Oct 31 12:34:05.515801 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: Content-Length: 0 Oct 31 12:34:05.515801 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: Content-Type: application/json Oct 31 12:34:05.515801 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: Host: 10.222.0.15 Oct 31 12:34:05.515801 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: Openstack-System-Scope: None Oct 31 12:34:05.515801 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: User-Agent: python-urllib3/1.26.12 Oct 31 12:34:05.515801 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Auth-Token: gAAAAABjX8B7EZr063h332d-KLmp2IUH7ewwTYpDnRljBBH09kW7KExUGfRIe4eMMDvWgKqga4kG8dxF84srOJK_9NzQc8ZBAOidVwMG_FbTNGcdIcaZkydv5mA8afhZ29ls2aboD3EWQuFGXdZDSiVgeHEYo06yHVZjcaMhIUYFjSGv-FYmTa8 Oct 31 12:34:05.515801 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Domain-Id: None Oct 31 12:34:05.515801 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Domain-Name: None Oct 31 12:34:05.515801 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Identity-Status: Confirmed Oct 31 12:34:05.515801 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Is-Admin-Project: True Oct 31 12:34:05.515801 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Project-Domain-Id: default Oct 31 12:34:05.515801 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Project-Domain-Name: Default Oct 31 12:34:05.515801 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Project-Id: a4d5cd8851dc4216b4e3e035a32decad Oct 31 12:34:05.515801 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Project-Name: tempest-DeleteServersTestJSON-1374602671 Oct 31 12:34:05.515801 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Role: reader,member Oct 31 12:34:05.515801 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Roles: reader,member Oct 31 12:34:05.517619 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/a4d5cd8851dc4216b4e3e035a32decad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_a4d5cd8851dc4216b4e3e035a32decad", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/a4d5cd8851dc4216b4e3e035a32decad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/a4d5cd8851dc4216b4e3e035a32decad"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Oct 31 12:34:05.517619 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Tenant: tempest-DeleteServersTestJSON-1374602671 Oct 31 12:34:05.517619 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Tenant-Id: a4d5cd8851dc4216b4e3e035a32decad Oct 31 12:34:05.517619 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Tenant-Name: tempest-DeleteServersTestJSON-1374602671 Oct 31 12:34:05.517619 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-User: tempest-DeleteServersTestJSON-1374602671-project Oct 31 12:34:05.517619 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-User-Domain-Id: default Oct 31 12:34:05.517619 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-User-Domain-Name: Default Oct 31 12:34:05.517619 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-User-Id: 70d59ee6f94848308665a32099cf5255 Oct 31 12:34:05.517619 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-User-Name: tempest-DeleteServersTestJSON-1374602671-project Oct 31 12:34:05.517619 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: method: > Oct 31 12:34:05.517619 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: exception: Instance 8d254a92-15fa-4d98-8954-a8028647165e could not be found. Oct 31 12:34:05.517619 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: action_args: {'server_id': '8d254a92-15fa-4d98-8954-a8028647165e'} Oct 31 12:34:05.518472 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 12:34:05.518472 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 12:34:05.518472 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 12:34:05.518472 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 12:34:05.518472 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 12:34:05.518472 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 12:34:05.518472 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 12:34:05.518472 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 12:34:05.518472 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 12:34:05.518472 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 12:34:05.518472 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d254a92-15fa-4d98-8954-a8028647165e could not be found. Oct 31 12:34:05.518472 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Oct 31 12:34:05.518472 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 12:34:05.518472 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Oct 31 12:34:05.518472 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 12:34:05.518472 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 12:34:05.518472 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 12:34:05.518472 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 12:34:05.518472 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 12:34:05.518472 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 12:34:05.519849 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 12:34:05.519849 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 31 12:34:05.519849 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 12:34:05.519849 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 31 12:34:05.519849 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 12:34:05.519849 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Oct 31 12:34:05.519849 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Oct 31 12:34:05.519849 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 12:34:05.519849 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 12:34:05.519849 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d254a92-15fa-4d98-8954-a8028647165e could not be found. Oct 31 12:34:05.519849 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Oct 31 12:34:05.519849 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 12:34:05.519849 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Oct 31 12:34:05.519849 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 12:34:05.519849 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 12:34:05.519849 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 12:34:05.519849 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 12:34:05.519849 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 12:34:05.519849 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d254a92-15fa-4d98-8954-a8028647165e could not be found. Oct 31 12:34:05.519849 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Oct 31 12:34:05.521427 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-5b64e2d5-b6d9-4803-af67-3b4669884fc6 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Returning 404 to user: Instance 8d254a92-15fa-4d98-8954-a8028647165e could not be found. {{(pid=125441) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 12:34:05.521427 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-5b64e2d5-b6d9-4803-af67-3b4669884fc6 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] 10.222.0.15 "GET /compute/v2.1/servers/8d254a92-15fa-4d98-8954-a8028647165e/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.048683 Oct 31 12:34:05.527647 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 94/197] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Oct 31 12:34:05 2022] GET /compute/v2.1/servers/8d254a92-15fa-4d98-8954-a8028647165e/os-volume_attachments => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 12:34:05.696465 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-46f6ef39-5cb0-40eb-9665-99522a9c7a0c tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:34:05.697994 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-46f6ef39-5cb0-40eb-9665-99522a9c7a0c tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] [instance: d0befdd2-2ecd-4006-bfdd-86d5253a7687] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:34:05.712681 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-46f6ef39-5cb0-40eb-9665-99522a9c7a0c tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:34:05.713483 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-46f6ef39-5cb0-40eb-9665-99522a9c7a0c tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:34:05.719049 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-46f6ef39-5cb0-40eb-9665-99522a9c7a0c tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:34:05.720958 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-46f6ef39-5cb0-40eb-9665-99522a9c7a0c tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:34:05.723567 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-46f6ef39-5cb0-40eb-9665-99522a9c7a0c tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:34:05.724555 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-46f6ef39-5cb0-40eb-9665-99522a9c7a0c tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:34:06.008300 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-bbdda052-0b7e-4ee4-8836-c1d48c77dc13 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:34:06.009697 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-bbdda052-0b7e-4ee4-8836-c1d48c77dc13 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] [instance: 6f831a26-c1a4-4518-870e-6dd64516719c] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:34:06.015590 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-bbdda052-0b7e-4ee4-8836-c1d48c77dc13 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:34:06.016475 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-bbdda052-0b7e-4ee4-8836-c1d48c77dc13 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:34:06.017320 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-bbdda052-0b7e-4ee4-8836-c1d48c77dc13 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:34:06.018217 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-bbdda052-0b7e-4ee4-8836-c1d48c77dc13 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:34:06.018880 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-bbdda052-0b7e-4ee4-8836-c1d48c77dc13 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:34:06.019619 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-bbdda052-0b7e-4ee4-8836-c1d48c77dc13 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:34:06.251247 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-bbdda052-0b7e-4ee4-8836-c1d48c77dc13 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1918cb60ccd04e909b78dca9b0166be9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe4270c111747be8d61e4ae993bd7ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:34:06.263270 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-bbdda052-0b7e-4ee4-8836-c1d48c77dc13 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] 10.222.0.15 "GET /compute/v2.1/servers/6f831a26-c1a4-4518-870e-6dd64516719c" status: 200 len: 1313 microversion: 2.1 time: 0.258687 Oct 31 12:34:06.279916 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 95/198] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:34:06 2022] GET /compute/v2.1/servers/6f831a26-c1a4-4518-870e-6dd64516719c => generated 1313 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:34:06.374495 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-46f6ef39-5cb0-40eb-9665-99522a9c7a0c tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2e978bcb824a5e9d593b861c9e3bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7573cb9c503243ab90b1649591d550e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:34:06.384497 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-46f6ef39-5cb0-40eb-9665-99522a9c7a0c tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] 10.222.0.15 "GET /compute/v2.1/servers/d0befdd2-2ecd-4006-bfdd-86d5253a7687" status: 200 len: 1522 microversion: 2.1 time: 0.708832 Oct 31 12:34:06.385896 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 104/199] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:34:05 2022] GET /compute/v2.1/servers/d0befdd2-2ecd-4006-bfdd-86d5253a7687 => generated 1522 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:34:06.847837 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-fbc93184-dc81-4c22-8b45-85805484bd73 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:34:06.848370 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-fbc93184-dc81-4c22-8b45-85805484bd73 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] [instance: 8d254a92-15fa-4d98-8954-a8028647165e] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:34:06.855352 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-fbc93184-dc81-4c22-8b45-85805484bd73 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:34:06.855841 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-fbc93184-dc81-4c22-8b45-85805484bd73 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:34:06.856271 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-fbc93184-dc81-4c22-8b45-85805484bd73 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:34:06.856969 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-fbc93184-dc81-4c22-8b45-85805484bd73 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:34:06.857421 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-fbc93184-dc81-4c22-8b45-85805484bd73 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:34:06.857841 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-fbc93184-dc81-4c22-8b45-85805484bd73 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:34:06.871938 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.wsgi [None req-fbc93184-dc81-4c22-8b45-85805484bd73 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] HTTP exception thrown: Instance 8d254a92-15fa-4d98-8954-a8028647165e could not be found. Oct 31 12:34:06.874295 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-fbc93184-dc81-4c22-8b45-85805484bd73 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Request method failure captured: Oct 31 12:34:06.874295 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: request: DELETE /compute/v2.1/servers/8d254a92-15fa-4d98-8954-a8028647165e HTTP/1.1 Oct 31 12:34:06.874295 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: Accept: application/json Oct 31 12:34:06.874295 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: Accept-Encoding: identity Oct 31 12:34:06.874295 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: Connection: close Oct 31 12:34:06.874295 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: Content-Length: 0 Oct 31 12:34:06.874295 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: Content-Type: application/json Oct 31 12:34:06.874295 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: Host: 10.222.0.15 Oct 31 12:34:06.874295 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: Openstack-System-Scope: None Oct 31 12:34:06.874295 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: User-Agent: python-urllib3/1.26.12 Oct 31 12:34:06.874295 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Auth-Token: gAAAAABjX8B7EZr063h332d-KLmp2IUH7ewwTYpDnRljBBH09kW7KExUGfRIe4eMMDvWgKqga4kG8dxF84srOJK_9NzQc8ZBAOidVwMG_FbTNGcdIcaZkydv5mA8afhZ29ls2aboD3EWQuFGXdZDSiVgeHEYo06yHVZjcaMhIUYFjSGv-FYmTa8 Oct 31 12:34:06.874295 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Domain-Id: None Oct 31 12:34:06.874295 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Domain-Name: None Oct 31 12:34:06.874295 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Identity-Status: Confirmed Oct 31 12:34:06.874295 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Is-Admin-Project: True Oct 31 12:34:06.874295 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Project-Domain-Id: default Oct 31 12:34:06.874295 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Project-Domain-Name: Default Oct 31 12:34:06.874295 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Project-Id: a4d5cd8851dc4216b4e3e035a32decad Oct 31 12:34:06.874295 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Project-Name: tempest-DeleteServersTestJSON-1374602671 Oct 31 12:34:06.874295 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Role: reader,member Oct 31 12:34:06.874295 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Roles: reader,member Oct 31 12:34:06.875771 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/a4d5cd8851dc4216b4e3e035a32decad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_a4d5cd8851dc4216b4e3e035a32decad", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/a4d5cd8851dc4216b4e3e035a32decad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/a4d5cd8851dc4216b4e3e035a32decad"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Oct 31 12:34:06.875771 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Tenant: tempest-DeleteServersTestJSON-1374602671 Oct 31 12:34:06.875771 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Tenant-Id: a4d5cd8851dc4216b4e3e035a32decad Oct 31 12:34:06.875771 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Tenant-Name: tempest-DeleteServersTestJSON-1374602671 Oct 31 12:34:06.875771 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-User: tempest-DeleteServersTestJSON-1374602671-project Oct 31 12:34:06.875771 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-User-Domain-Id: default Oct 31 12:34:06.875771 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-User-Domain-Name: Default Oct 31 12:34:06.875771 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-User-Id: 70d59ee6f94848308665a32099cf5255 Oct 31 12:34:06.875771 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-User-Name: tempest-DeleteServersTestJSON-1374602671-project Oct 31 12:34:06.875771 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: method: > Oct 31 12:34:06.875771 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: exception: Instance 8d254a92-15fa-4d98-8954-a8028647165e could not be found. Oct 31 12:34:06.875771 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: action_args: {'id': '8d254a92-15fa-4d98-8954-a8028647165e'} Oct 31 12:34:06.876595 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 12:34:06.876595 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 12:34:06.876595 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 12:34:06.876595 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 12:34:06.876595 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 12:34:06.876595 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 12:34:06.876595 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 12:34:06.876595 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 12:34:06.876595 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 12:34:06.876595 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 12:34:06.876595 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d254a92-15fa-4d98-8954-a8028647165e could not be found. Oct 31 12:34:06.876595 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Oct 31 12:34:06.876595 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 12:34:06.876595 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Oct 31 12:34:06.876595 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 12:34:06.876595 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 12:34:06.876595 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 12:34:06.876595 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 12:34:06.876595 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 12:34:06.876595 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 12:34:06.877997 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 12:34:06.877997 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 31 12:34:06.877997 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 31 12:34:06.877997 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 31 12:34:06.877997 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 31 12:34:06.877997 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 12:34:06.877997 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 12:34:06.877997 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 12:34:06.877997 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 12:34:06.877997 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d254a92-15fa-4d98-8954-a8028647165e could not be found. Oct 31 12:34:06.877997 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Oct 31 12:34:06.877997 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 12:34:06.877997 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Oct 31 12:34:06.877997 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 12:34:06.877997 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 12:34:06.877997 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 12:34:06.877997 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 12:34:06.877997 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 12:34:06.877997 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d254a92-15fa-4d98-8954-a8028647165e could not be found. Oct 31 12:34:06.877997 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Oct 31 12:34:06.879594 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-fbc93184-dc81-4c22-8b45-85805484bd73 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Returning 404 to user: Instance 8d254a92-15fa-4d98-8954-a8028647165e could not be found. {{(pid=125441) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 12:34:06.879594 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-fbc93184-dc81-4c22-8b45-85805484bd73 tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] 10.222.0.15 "DELETE /compute/v2.1/servers/8d254a92-15fa-4d98-8954-a8028647165e" status: 404 len: 111 microversion: 2.1 time: 0.032730 Oct 31 12:34:06.879594 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 96/200] 10.222.0.15 () {58 vars in 1239 bytes} [Mon Oct 31 12:34:06 2022] DELETE /compute/v2.1/servers/8d254a92-15fa-4d98-8954-a8028647165e => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 12:34:06.884216 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-1a6ee01a-5218-4c8d-93e8-23b64a87853d tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:34:06.884828 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-1a6ee01a-5218-4c8d-93e8-23b64a87853d tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] [instance: 8d254a92-15fa-4d98-8954-a8028647165e] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:34:06.890662 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-1a6ee01a-5218-4c8d-93e8-23b64a87853d tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:34:06.891147 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-1a6ee01a-5218-4c8d-93e8-23b64a87853d tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:34:06.891644 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-1a6ee01a-5218-4c8d-93e8-23b64a87853d tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:34:06.892907 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-1a6ee01a-5218-4c8d-93e8-23b64a87853d tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:34:06.893544 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-1a6ee01a-5218-4c8d-93e8-23b64a87853d tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:34:06.894159 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-1a6ee01a-5218-4c8d-93e8-23b64a87853d tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:34:06.908515 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.wsgi [None req-1a6ee01a-5218-4c8d-93e8-23b64a87853d tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] HTTP exception thrown: Instance 8d254a92-15fa-4d98-8954-a8028647165e could not be found. Oct 31 12:34:06.910077 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-1a6ee01a-5218-4c8d-93e8-23b64a87853d tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Request method failure captured: Oct 31 12:34:06.910077 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: request: GET /compute/v2.1/servers/8d254a92-15fa-4d98-8954-a8028647165e HTTP/1.1 Oct 31 12:34:06.910077 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: Accept: application/json Oct 31 12:34:06.910077 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: Accept-Encoding: identity Oct 31 12:34:06.910077 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: Connection: close Oct 31 12:34:06.910077 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: Content-Length: 0 Oct 31 12:34:06.910077 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: Content-Type: application/json Oct 31 12:34:06.910077 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: Host: 10.222.0.15 Oct 31 12:34:06.910077 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: Openstack-System-Scope: None Oct 31 12:34:06.910077 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: User-Agent: python-urllib3/1.26.12 Oct 31 12:34:06.910077 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Auth-Token: gAAAAABjX8B7EZr063h332d-KLmp2IUH7ewwTYpDnRljBBH09kW7KExUGfRIe4eMMDvWgKqga4kG8dxF84srOJK_9NzQc8ZBAOidVwMG_FbTNGcdIcaZkydv5mA8afhZ29ls2aboD3EWQuFGXdZDSiVgeHEYo06yHVZjcaMhIUYFjSGv-FYmTa8 Oct 31 12:34:06.910077 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Domain-Id: None Oct 31 12:34:06.910077 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Domain-Name: None Oct 31 12:34:06.910077 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Identity-Status: Confirmed Oct 31 12:34:06.910077 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Is-Admin-Project: True Oct 31 12:34:06.910077 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Project-Domain-Id: default Oct 31 12:34:06.910077 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Project-Domain-Name: Default Oct 31 12:34:06.910077 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Project-Id: a4d5cd8851dc4216b4e3e035a32decad Oct 31 12:34:06.910077 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Project-Name: tempest-DeleteServersTestJSON-1374602671 Oct 31 12:34:06.910077 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Role: reader,member Oct 31 12:34:06.910077 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Roles: reader,member Oct 31 12:34:06.911303 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/a4d5cd8851dc4216b4e3e035a32decad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_a4d5cd8851dc4216b4e3e035a32decad", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/a4d5cd8851dc4216b4e3e035a32decad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/a4d5cd8851dc4216b4e3e035a32decad"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Oct 31 12:34:06.911303 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Tenant: tempest-DeleteServersTestJSON-1374602671 Oct 31 12:34:06.911303 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Tenant-Id: a4d5cd8851dc4216b4e3e035a32decad Oct 31 12:34:06.911303 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Tenant-Name: tempest-DeleteServersTestJSON-1374602671 Oct 31 12:34:06.911303 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-User: tempest-DeleteServersTestJSON-1374602671-project Oct 31 12:34:06.911303 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-User-Domain-Id: default Oct 31 12:34:06.911303 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-User-Domain-Name: Default Oct 31 12:34:06.911303 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-User-Id: 70d59ee6f94848308665a32099cf5255 Oct 31 12:34:06.911303 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-User-Name: tempest-DeleteServersTestJSON-1374602671-project Oct 31 12:34:06.911303 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: method: > Oct 31 12:34:06.911303 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: exception: Instance 8d254a92-15fa-4d98-8954-a8028647165e could not be found. Oct 31 12:34:06.911303 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: action_args: {'id': '8d254a92-15fa-4d98-8954-a8028647165e'} Oct 31 12:34:06.911962 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 12:34:06.911962 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 12:34:06.911962 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 12:34:06.911962 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 12:34:06.911962 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 12:34:06.911962 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 12:34:06.911962 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 12:34:06.911962 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 12:34:06.911962 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 12:34:06.911962 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 12:34:06.911962 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d254a92-15fa-4d98-8954-a8028647165e could not be found. Oct 31 12:34:06.911962 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Oct 31 12:34:06.911962 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 12:34:06.911962 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Oct 31 12:34:06.911962 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 12:34:06.911962 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 12:34:06.911962 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 12:34:06.911962 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 12:34:06.911962 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 12:34:06.911962 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 12:34:06.916625 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 12:34:06.916625 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 12:34:06.916625 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 12:34:06.916625 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 12:34:06.916625 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 12:34:06.916625 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 12:34:06.916625 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 12:34:06.916625 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d254a92-15fa-4d98-8954-a8028647165e could not be found. Oct 31 12:34:06.916625 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Oct 31 12:34:06.916625 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 12:34:06.916625 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Oct 31 12:34:06.916625 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 12:34:06.916625 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 12:34:06.916625 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 12:34:06.916625 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 12:34:06.916625 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 12:34:06.916625 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d254a92-15fa-4d98-8954-a8028647165e could not be found. Oct 31 12:34:06.916625 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Oct 31 12:34:06.918306 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-1a6ee01a-5218-4c8d-93e8-23b64a87853d tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] Returning 404 to user: Instance 8d254a92-15fa-4d98-8954-a8028647165e could not be found. {{(pid=125440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 12:34:06.918306 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-1a6ee01a-5218-4c8d-93e8-23b64a87853d tempest-DeleteServersTestJSON-1374602671 tempest-DeleteServersTestJSON-1374602671-project] 10.222.0.15 "GET /compute/v2.1/servers/8d254a92-15fa-4d98-8954-a8028647165e" status: 404 len: 111 microversion: 2.1 time: 0.031086 Oct 31 12:34:06.918306 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 105/201] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:34:06 2022] GET /compute/v2.1/servers/8d254a92-15fa-4d98-8954-a8028647165e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 12:34:07.273626 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [req-0ac2be1f-5145-4a6d-9846-7ee3edb68e0e req-2aa25415-6ba8-497e-bee1-1ff79b642619 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f831a26-c1a4-4518-870e-6dd64516719c", "tag": "ce23525c-19f9-4b3b-bdc6-f5c09ca3e19c"}]} {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 12:34:07.290855 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-a7dd69f7-4d88-44c0-9642-d74cc103b150 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:34:07.291570 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-a7dd69f7-4d88-44c0-9642-d74cc103b150 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] [instance: 6f831a26-c1a4-4518-870e-6dd64516719c] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:34:07.291836 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [req-0ac2be1f-5145-4a6d-9846-7ee3edb68e0e req-2aa25415-6ba8-497e-bee1-1ff79b642619 service nova] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:34:07.293139 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [req-0ac2be1f-5145-4a6d-9846-7ee3edb68e0e req-2aa25415-6ba8-497e-bee1-1ff79b642619 service nova] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:34:07.293816 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [req-0ac2be1f-5145-4a6d-9846-7ee3edb68e0e req-2aa25415-6ba8-497e-bee1-1ff79b642619 service nova] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:34:07.303298 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-a7dd69f7-4d88-44c0-9642-d74cc103b150 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:34:07.303790 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-a7dd69f7-4d88-44c0-9642-d74cc103b150 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:34:07.306546 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-a7dd69f7-4d88-44c0-9642-d74cc103b150 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:34:07.308034 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-a7dd69f7-4d88-44c0-9642-d74cc103b150 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:34:07.311216 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-a7dd69f7-4d88-44c0-9642-d74cc103b150 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:34:07.311831 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-a7dd69f7-4d88-44c0-9642-d74cc103b150 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:34:07.315340 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.compute.server_external_events [req-0ac2be1f-5145-4a6d-9846-7ee3edb68e0e req-2aa25415-6ba8-497e-bee1-1ff79b642619 service nova] Creating event network-changed:ce23525c-19f9-4b3b-bdc6-f5c09ca3e19c for instance 6f831a26-c1a4-4518-870e-6dd64516719c on hv-cinder-79617 Oct 31 12:34:07.323393 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [req-0ac2be1f-5145-4a6d-9846-7ee3edb68e0e req-2aa25415-6ba8-497e-bee1-1ff79b642619 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053608 Oct 31 12:34:07.324856 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 97/202] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Oct 31 12:34:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 12:34:07.413667 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-3f87e57b-114b-4a82-9af5-cb86b90aeea1 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:34:07.414687 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-3f87e57b-114b-4a82-9af5-cb86b90aeea1 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] [instance: d0befdd2-2ecd-4006-bfdd-86d5253a7687] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:34:07.425188 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-3f87e57b-114b-4a82-9af5-cb86b90aeea1 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:34:07.425909 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-3f87e57b-114b-4a82-9af5-cb86b90aeea1 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:34:07.426975 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-3f87e57b-114b-4a82-9af5-cb86b90aeea1 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:34:07.427713 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-3f87e57b-114b-4a82-9af5-cb86b90aeea1 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:34:07.428321 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-3f87e57b-114b-4a82-9af5-cb86b90aeea1 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:34:07.429392 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-3f87e57b-114b-4a82-9af5-cb86b90aeea1 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:34:07.667768 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-a7dd69f7-4d88-44c0-9642-d74cc103b150 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1918cb60ccd04e909b78dca9b0166be9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe4270c111747be8d61e4ae993bd7ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:34:07.678304 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-a7dd69f7-4d88-44c0-9642-d74cc103b150 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] 10.222.0.15 "GET /compute/v2.1/servers/6f831a26-c1a4-4518-870e-6dd64516719c" status: 200 len: 1313 microversion: 2.1 time: 0.393407 Oct 31 12:34:07.679585 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 106/203] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:34:07 2022] GET /compute/v2.1/servers/6f831a26-c1a4-4518-870e-6dd64516719c => generated 1313 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 12:34:07.748855 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-3f87e57b-114b-4a82-9af5-cb86b90aeea1 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2e978bcb824a5e9d593b861c9e3bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7573cb9c503243ab90b1649591d550e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:34:07.760159 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-3f87e57b-114b-4a82-9af5-cb86b90aeea1 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] 10.222.0.15 "GET /compute/v2.1/servers/d0befdd2-2ecd-4006-bfdd-86d5253a7687" status: 200 len: 1522 microversion: 2.1 time: 0.351375 Oct 31 12:34:07.761259 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 98/204] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:34:07 2022] GET /compute/v2.1/servers/d0befdd2-2ecd-4006-bfdd-86d5253a7687 => generated 1522 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 12:34:08.712989 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-20717ffc-abe1-449d-b376-66c5c6656e48 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:34:08.713754 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-20717ffc-abe1-449d-b376-66c5c6656e48 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] [instance: 6f831a26-c1a4-4518-870e-6dd64516719c] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:34:08.721177 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-20717ffc-abe1-449d-b376-66c5c6656e48 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:34:08.721757 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-20717ffc-abe1-449d-b376-66c5c6656e48 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:34:08.722193 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-20717ffc-abe1-449d-b376-66c5c6656e48 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:34:08.722897 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-20717ffc-abe1-449d-b376-66c5c6656e48 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:34:08.723378 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-20717ffc-abe1-449d-b376-66c5c6656e48 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:34:08.724089 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-20717ffc-abe1-449d-b376-66c5c6656e48 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:34:08.785068 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-4f560db9-784b-4295-8e7c-3e7cb77aad68 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:34:08.785826 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-4f560db9-784b-4295-8e7c-3e7cb77aad68 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] [instance: d0befdd2-2ecd-4006-bfdd-86d5253a7687] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:34:08.801690 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-4f560db9-784b-4295-8e7c-3e7cb77aad68 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:34:08.802191 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-4f560db9-784b-4295-8e7c-3e7cb77aad68 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:34:08.802629 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-4f560db9-784b-4295-8e7c-3e7cb77aad68 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:34:08.803385 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-4f560db9-784b-4295-8e7c-3e7cb77aad68 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:34:08.803842 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-4f560db9-784b-4295-8e7c-3e7cb77aad68 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:34:08.804274 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-4f560db9-784b-4295-8e7c-3e7cb77aad68 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:34:09.014840 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-20717ffc-abe1-449d-b376-66c5c6656e48 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1918cb60ccd04e909b78dca9b0166be9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe4270c111747be8d61e4ae993bd7ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:34:09.034735 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-20717ffc-abe1-449d-b376-66c5c6656e48 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] 10.222.0.15 "GET /compute/v2.1/servers/6f831a26-c1a4-4518-870e-6dd64516719c" status: 200 len: 1313 microversion: 2.1 time: 0.324671 Oct 31 12:34:09.039725 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 107/205] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:34:08 2022] GET /compute/v2.1/servers/6f831a26-c1a4-4518-870e-6dd64516719c => generated 1313 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:34:09.104139 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-4f560db9-784b-4295-8e7c-3e7cb77aad68 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2e978bcb824a5e9d593b861c9e3bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7573cb9c503243ab90b1649591d550e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:34:09.118644 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-4f560db9-784b-4295-8e7c-3e7cb77aad68 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] 10.222.0.15 "GET /compute/v2.1/servers/d0befdd2-2ecd-4006-bfdd-86d5253a7687" status: 200 len: 1522 microversion: 2.1 time: 0.338701 Oct 31 12:34:09.135351 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 99/206] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:34:08 2022] GET /compute/v2.1/servers/d0befdd2-2ecd-4006-bfdd-86d5253a7687 => generated 1522 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 12:34:10.069943 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-494711ae-c0f8-4b16-aef1-732b71bf8d71 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:34:10.070580 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-494711ae-c0f8-4b16-aef1-732b71bf8d71 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] [instance: 6f831a26-c1a4-4518-870e-6dd64516719c] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:34:10.090040 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-494711ae-c0f8-4b16-aef1-732b71bf8d71 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:34:10.090939 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-494711ae-c0f8-4b16-aef1-732b71bf8d71 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:34:10.091604 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-494711ae-c0f8-4b16-aef1-732b71bf8d71 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:34:10.092564 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-494711ae-c0f8-4b16-aef1-732b71bf8d71 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:34:10.096698 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-494711ae-c0f8-4b16-aef1-732b71bf8d71 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:34:10.097563 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-494711ae-c0f8-4b16-aef1-732b71bf8d71 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:34:10.142626 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-8c8e8757-a235-4e82-b2b2-17aa93bb41d7 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:34:10.143951 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-8c8e8757-a235-4e82-b2b2-17aa93bb41d7 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] [instance: d0befdd2-2ecd-4006-bfdd-86d5253a7687] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:34:10.179545 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-8c8e8757-a235-4e82-b2b2-17aa93bb41d7 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:34:10.180047 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-8c8e8757-a235-4e82-b2b2-17aa93bb41d7 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:34:10.180505 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-8c8e8757-a235-4e82-b2b2-17aa93bb41d7 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:34:10.193370 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-8c8e8757-a235-4e82-b2b2-17aa93bb41d7 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:34:10.193898 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-8c8e8757-a235-4e82-b2b2-17aa93bb41d7 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:34:10.194339 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-8c8e8757-a235-4e82-b2b2-17aa93bb41d7 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:34:10.649405 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-8c8e8757-a235-4e82-b2b2-17aa93bb41d7 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2e978bcb824a5e9d593b861c9e3bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7573cb9c503243ab90b1649591d550e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:34:10.664415 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-8c8e8757-a235-4e82-b2b2-17aa93bb41d7 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] 10.222.0.15 "GET /compute/v2.1/servers/d0befdd2-2ecd-4006-bfdd-86d5253a7687" status: 200 len: 1522 microversion: 2.1 time: 0.526121 Oct 31 12:34:10.666484 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 100/207] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:34:10 2022] GET /compute/v2.1/servers/d0befdd2-2ecd-4006-bfdd-86d5253a7687 => generated 1522 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 12:34:10.836874 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-494711ae-c0f8-4b16-aef1-732b71bf8d71 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1918cb60ccd04e909b78dca9b0166be9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe4270c111747be8d61e4ae993bd7ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:34:10.847443 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-494711ae-c0f8-4b16-aef1-732b71bf8d71 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] 10.222.0.15 "GET /compute/v2.1/servers/6f831a26-c1a4-4518-870e-6dd64516719c" status: 200 len: 1313 microversion: 2.1 time: 0.785470 Oct 31 12:34:10.848660 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 108/208] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:34:10 2022] GET /compute/v2.1/servers/6f831a26-c1a4-4518-870e-6dd64516719c => generated 1313 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:34:11.695342 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-c353ea7c-d588-4c2f-829a-9b5280b14fec tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:34:11.695993 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-c353ea7c-d588-4c2f-829a-9b5280b14fec tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] [instance: d0befdd2-2ecd-4006-bfdd-86d5253a7687] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:34:11.702600 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-c353ea7c-d588-4c2f-829a-9b5280b14fec tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:34:11.703320 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-c353ea7c-d588-4c2f-829a-9b5280b14fec tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:34:11.703958 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-c353ea7c-d588-4c2f-829a-9b5280b14fec tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:34:11.706501 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-c353ea7c-d588-4c2f-829a-9b5280b14fec tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:34:11.707222 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-c353ea7c-d588-4c2f-829a-9b5280b14fec tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:34:11.707871 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-c353ea7c-d588-4c2f-829a-9b5280b14fec tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:34:11.873939 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-bcf604f2-f48d-4392-b34a-766761a496cf tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:34:11.874547 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-bcf604f2-f48d-4392-b34a-766761a496cf tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] [instance: 6f831a26-c1a4-4518-870e-6dd64516719c] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:34:11.888035 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-bcf604f2-f48d-4392-b34a-766761a496cf tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:34:11.895429 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-bcf604f2-f48d-4392-b34a-766761a496cf tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:34:11.897273 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-bcf604f2-f48d-4392-b34a-766761a496cf tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:34:11.899572 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-bcf604f2-f48d-4392-b34a-766761a496cf tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:34:11.900240 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-bcf604f2-f48d-4392-b34a-766761a496cf tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:34:11.900844 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-bcf604f2-f48d-4392-b34a-766761a496cf tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:34:11.901463 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG dbcounter [-] [125440] Writing DB stats nova_cell0:SELECT=2 {{(pid=125440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:34:12.210308 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG dbcounter [-] [125440] Writing DB stats nova_cell0:SELECT=8 {{(pid=125440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:34:12.497380 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-bcf604f2-f48d-4392-b34a-766761a496cf tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1918cb60ccd04e909b78dca9b0166be9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe4270c111747be8d61e4ae993bd7ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:34:12.498190 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-c353ea7c-d588-4c2f-829a-9b5280b14fec tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2e978bcb824a5e9d593b861c9e3bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7573cb9c503243ab90b1649591d550e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:34:12.508534 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-bcf604f2-f48d-4392-b34a-766761a496cf tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] 10.222.0.15 "GET /compute/v2.1/servers/6f831a26-c1a4-4518-870e-6dd64516719c" status: 200 len: 1313 microversion: 2.1 time: 0.636781 Oct 31 12:34:12.514823 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-c353ea7c-d588-4c2f-829a-9b5280b14fec tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] 10.222.0.15 "GET /compute/v2.1/servers/d0befdd2-2ecd-4006-bfdd-86d5253a7687" status: 200 len: 1522 microversion: 2.1 time: 0.823751 Oct 31 12:34:12.518993 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 109/209] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:34:11 2022] GET /compute/v2.1/servers/6f831a26-c1a4-4518-870e-6dd64516719c => generated 1313 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:34:12.536333 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 101/210] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:34:11 2022] GET /compute/v2.1/servers/d0befdd2-2ecd-4006-bfdd-86d5253a7687 => generated 1522 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:34:13.542760 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-89cd139f-a643-408c-a8e6-bd10510ea983 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:34:13.543405 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-89cd139f-a643-408c-a8e6-bd10510ea983 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] [instance: d0befdd2-2ecd-4006-bfdd-86d5253a7687] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:34:13.551468 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-fad2c42e-f1c2-4e7d-8316-44b02cf96475 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:34:13.552827 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-fad2c42e-f1c2-4e7d-8316-44b02cf96475 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] [instance: 6f831a26-c1a4-4518-870e-6dd64516719c] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:34:13.557263 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-89cd139f-a643-408c-a8e6-bd10510ea983 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:34:13.564585 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-89cd139f-a643-408c-a8e6-bd10510ea983 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:34:13.564585 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-89cd139f-a643-408c-a8e6-bd10510ea983 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:34:13.565813 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-89cd139f-a643-408c-a8e6-bd10510ea983 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:34:13.566272 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-89cd139f-a643-408c-a8e6-bd10510ea983 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:34:13.566815 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-89cd139f-a643-408c-a8e6-bd10510ea983 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:34:13.571465 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-fad2c42e-f1c2-4e7d-8316-44b02cf96475 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:34:13.572128 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-fad2c42e-f1c2-4e7d-8316-44b02cf96475 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:34:13.572566 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-fad2c42e-f1c2-4e7d-8316-44b02cf96475 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:34:13.573411 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-fad2c42e-f1c2-4e7d-8316-44b02cf96475 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:34:13.574362 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-fad2c42e-f1c2-4e7d-8316-44b02cf96475 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:34:13.575027 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-fad2c42e-f1c2-4e7d-8316-44b02cf96475 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:34:13.878637 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-89cd139f-a643-408c-a8e6-bd10510ea983 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2e978bcb824a5e9d593b861c9e3bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7573cb9c503243ab90b1649591d550e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:34:13.886941 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-89cd139f-a643-408c-a8e6-bd10510ea983 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] 10.222.0.15 "GET /compute/v2.1/servers/d0befdd2-2ecd-4006-bfdd-86d5253a7687" status: 200 len: 1522 microversion: 2.1 time: 0.347916 Oct 31 12:34:13.888861 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 102/211] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:34:13 2022] GET /compute/v2.1/servers/d0befdd2-2ecd-4006-bfdd-86d5253a7687 => generated 1522 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 12:34:14.065802 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [req-51b2d97b-6527-4044-b45a-6592f2e6efe0 req-548dbae4-e945-4831-bb36-6b6e5b1697a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f831a26-c1a4-4518-870e-6dd64516719c", "name": "network-vif-plugged", "status": "completed", "tag": "ce23525c-19f9-4b3b-bdc6-f5c09ca3e19c"}]} {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 12:34:14.094119 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [req-51b2d97b-6527-4044-b45a-6592f2e6efe0 req-548dbae4-e945-4831-bb36-6b6e5b1697a3 service nova] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:34:14.094783 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [req-51b2d97b-6527-4044-b45a-6592f2e6efe0 req-548dbae4-e945-4831-bb36-6b6e5b1697a3 service nova] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:34:14.096054 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [req-51b2d97b-6527-4044-b45a-6592f2e6efe0 req-548dbae4-e945-4831-bb36-6b6e5b1697a3 service nova] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:34:14.140173 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.compute.server_external_events [req-51b2d97b-6527-4044-b45a-6592f2e6efe0 req-548dbae4-e945-4831-bb36-6b6e5b1697a3 service nova] Creating event network-vif-plugged:ce23525c-19f9-4b3b-bdc6-f5c09ca3e19c for instance 6f831a26-c1a4-4518-870e-6dd64516719c on hv-cinder-79617 Oct 31 12:34:14.145822 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [req-51b2d97b-6527-4044-b45a-6592f2e6efe0 req-548dbae4-e945-4831-bb36-6b6e5b1697a3 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087044 Oct 31 12:34:14.146833 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 103/212] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Oct 31 12:34:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 12:34:14.167385 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-fad2c42e-f1c2-4e7d-8316-44b02cf96475 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1918cb60ccd04e909b78dca9b0166be9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe4270c111747be8d61e4ae993bd7ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:34:14.179372 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-fad2c42e-f1c2-4e7d-8316-44b02cf96475 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] 10.222.0.15 "GET /compute/v2.1/servers/6f831a26-c1a4-4518-870e-6dd64516719c" status: 200 len: 1313 microversion: 2.1 time: 0.643903 Oct 31 12:34:14.195706 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 110/213] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:34:13 2022] GET /compute/v2.1/servers/6f831a26-c1a4-4518-870e-6dd64516719c => generated 1313 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:34:14.685779 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-f5904c5b-0a52-4988-8a9c-c4cec666a134 tempest-VolumesSnapshotsTestJSON-540358646 tempest-VolumesSnapshotsTestJSON-540358646-project] Action: 'create', calling method: .version_select at 0x7f2aa527f8b0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-975902050"}} {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 12:34:14.913605 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-8be06c05-b109-451b-a1d4-728511c17ebb tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:34:14.914495 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-8be06c05-b109-451b-a1d4-728511c17ebb tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] [instance: d0befdd2-2ecd-4006-bfdd-86d5253a7687] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:34:14.921470 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-8be06c05-b109-451b-a1d4-728511c17ebb tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:34:14.922466 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-8be06c05-b109-451b-a1d4-728511c17ebb tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:34:14.924477 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-8be06c05-b109-451b-a1d4-728511c17ebb tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:34:14.925602 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-8be06c05-b109-451b-a1d4-728511c17ebb tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:34:14.926236 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-8be06c05-b109-451b-a1d4-728511c17ebb tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:34:14.926879 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-8be06c05-b109-451b-a1d4-728511c17ebb tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:34:15.102958 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-8be06c05-b109-451b-a1d4-728511c17ebb tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2e978bcb824a5e9d593b861c9e3bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7573cb9c503243ab90b1649591d550e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:34:15.125721 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-8be06c05-b109-451b-a1d4-728511c17ebb tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] 10.222.0.15 "GET /compute/v2.1/servers/d0befdd2-2ecd-4006-bfdd-86d5253a7687" status: 200 len: 1522 microversion: 2.1 time: 0.216205 Oct 31 12:34:15.134843 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 111/214] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:34:14 2022] GET /compute/v2.1/servers/d0befdd2-2ecd-4006-bfdd-86d5253a7687 => generated 1522 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 12:34:15.178542 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-f5904c5b-0a52-4988-8a9c-c4cec666a134 tempest-VolumesSnapshotsTestJSON-540358646 tempest-VolumesSnapshotsTestJSON-540358646-project] 10.222.0.15 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.664363 Oct 31 12:34:15.179187 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 104/215] 10.222.0.15 () {60 vars in 1155 bytes} [Mon Oct 31 12:34:14 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 666 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 31 12:34:15.192618 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-01b24da7-9c1f-4bd7-ac58-9840d149772a tempest-VolumesSnapshotsTestJSON-540358646 tempest-VolumesSnapshotsTestJSON-540358646-project] Calling method '.version_select at 0x7f2aa5305820>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:34:15.204658 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-405f93be-03a8-494d-b3e4-763c1ab52c97 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:34:15.205534 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-405f93be-03a8-494d-b3e4-763c1ab52c97 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] [instance: 6f831a26-c1a4-4518-870e-6dd64516719c] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:34:15.216254 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-405f93be-03a8-494d-b3e4-763c1ab52c97 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:34:15.216736 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-405f93be-03a8-494d-b3e4-763c1ab52c97 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:34:15.219520 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-405f93be-03a8-494d-b3e4-763c1ab52c97 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:34:15.223932 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-405f93be-03a8-494d-b3e4-763c1ab52c97 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:34:15.224458 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-405f93be-03a8-494d-b3e4-763c1ab52c97 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:34:15.224863 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-405f93be-03a8-494d-b3e4-763c1ab52c97 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:34:15.263616 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-01b24da7-9c1f-4bd7-ac58-9840d149772a tempest-VolumesSnapshotsTestJSON-540358646 tempest-VolumesSnapshotsTestJSON-540358646-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/199962ce-9eb5-48d2-8113-55e65e8bff48" status: 200 len: 344 microversion: 2.1 time: 0.074887 Oct 31 12:34:15.267254 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 112/216] 10.222.0.15 () {58 vars in 1245 bytes} [Mon Oct 31 12:34:15 2022] GET /compute/v2.1/os-volumes/199962ce-9eb5-48d2-8113-55e65e8bff48 => generated 344 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 12:34:15.437794 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-405f93be-03a8-494d-b3e4-763c1ab52c97 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1918cb60ccd04e909b78dca9b0166be9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe4270c111747be8d61e4ae993bd7ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:34:15.450105 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-405f93be-03a8-494d-b3e4-763c1ab52c97 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] 10.222.0.15 "GET /compute/v2.1/servers/6f831a26-c1a4-4518-870e-6dd64516719c" status: 200 len: 1313 microversion: 2.1 time: 0.248736 Oct 31 12:34:15.471444 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 105/217] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:34:15 2022] GET /compute/v2.1/servers/6f831a26-c1a4-4518-870e-6dd64516719c => generated 1313 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:34:16.156519 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-86e10552-53ec-46d0-8377-3aea1252dd0b tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:34:16.157140 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-86e10552-53ec-46d0-8377-3aea1252dd0b tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] [instance: d0befdd2-2ecd-4006-bfdd-86d5253a7687] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:34:16.167919 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-86e10552-53ec-46d0-8377-3aea1252dd0b tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:34:16.168414 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-86e10552-53ec-46d0-8377-3aea1252dd0b tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:34:16.168848 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-86e10552-53ec-46d0-8377-3aea1252dd0b tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:34:16.169550 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-86e10552-53ec-46d0-8377-3aea1252dd0b tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:34:16.170005 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-86e10552-53ec-46d0-8377-3aea1252dd0b tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:34:16.170424 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-86e10552-53ec-46d0-8377-3aea1252dd0b tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:34:16.278812 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-e66d34c7-48cc-4b1b-b370-faa88e8539b8 tempest-VolumesSnapshotsTestJSON-540358646 tempest-VolumesSnapshotsTestJSON-540358646-project] Calling method '.version_select at 0x7f2aa5230940>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:34:16.351999 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-e66d34c7-48cc-4b1b-b370-faa88e8539b8 tempest-VolumesSnapshotsTestJSON-540358646 tempest-VolumesSnapshotsTestJSON-540358646-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/199962ce-9eb5-48d2-8113-55e65e8bff48" status: 200 len: 344 microversion: 2.1 time: 0.077896 Oct 31 12:34:16.353111 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 106/218] 10.222.0.15 () {58 vars in 1245 bytes} [Mon Oct 31 12:34:16 2022] GET /compute/v2.1/os-volumes/199962ce-9eb5-48d2-8113-55e65e8bff48 => generated 344 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 12:34:16.368671 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-86e10552-53ec-46d0-8377-3aea1252dd0b tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2e978bcb824a5e9d593b861c9e3bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7573cb9c503243ab90b1649591d550e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:34:16.377851 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-86e10552-53ec-46d0-8377-3aea1252dd0b tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] 10.222.0.15 "GET /compute/v2.1/servers/d0befdd2-2ecd-4006-bfdd-86d5253a7687" status: 200 len: 1522 microversion: 2.1 time: 0.231108 Oct 31 12:34:16.378440 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 113/219] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:34:16 2022] GET /compute/v2.1/servers/d0befdd2-2ecd-4006-bfdd-86d5253a7687 => generated 1522 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:34:16.478636 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-7323af30-98b3-4c41-aaaf-0353d12f5f83 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:34:16.479578 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-7323af30-98b3-4c41-aaaf-0353d12f5f83 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] [instance: 6f831a26-c1a4-4518-870e-6dd64516719c] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:34:16.486767 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-7323af30-98b3-4c41-aaaf-0353d12f5f83 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:34:16.487561 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-7323af30-98b3-4c41-aaaf-0353d12f5f83 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:34:16.488480 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-7323af30-98b3-4c41-aaaf-0353d12f5f83 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:34:16.489361 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-7323af30-98b3-4c41-aaaf-0353d12f5f83 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:34:16.489971 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-7323af30-98b3-4c41-aaaf-0353d12f5f83 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:34:16.491338 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-7323af30-98b3-4c41-aaaf-0353d12f5f83 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:34:16.496948 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG dbcounter [-] [125441] Writing DB stats nova_cell1:SELECT=100 {{(pid=125441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:34:16.873096 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-7323af30-98b3-4c41-aaaf-0353d12f5f83 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1918cb60ccd04e909b78dca9b0166be9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe4270c111747be8d61e4ae993bd7ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:34:16.881909 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-7323af30-98b3-4c41-aaaf-0353d12f5f83 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] 10.222.0.15 "GET /compute/v2.1/servers/6f831a26-c1a4-4518-870e-6dd64516719c" status: 200 len: 1313 microversion: 2.1 time: 0.409033 Oct 31 12:34:16.882788 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 107/220] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:34:16 2022] GET /compute/v2.1/servers/6f831a26-c1a4-4518-870e-6dd64516719c => generated 1313 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 12:34:17.195995 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-6d167330-19be-4d5b-a4ec-e6c64336c7ce tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Action: 'create', calling method: .version_select at 0x7f2aa5534160>, body: {"keypair": {"name": "tempest-TestShelveInstance-1538609029", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA88jPPcAKgXDYssp8OMlBGbz54qmryVpE3SdK/28IbQzTFfuWUjThVvW8k8Hw1DyQXwRnjYYYcz2A0RykeWuy9jogMKPcoKsSuBJ3F+KpE6hAtfXqnhZMD9c+k9tJ+sgg=="}} {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 12:34:17.206184 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG dbcounter [-] [125440] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=125440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:34:17.214658 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.quota [None req-6d167330-19be-4d5b-a4ec-e6c64336c7ce tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Getting quotas for project b14b98f006574deabc030c2e93c680c4. Resources: {'key_pairs'} {{(pid=125440) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 12:34:17.218847 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.quota [None req-6d167330-19be-4d5b-a4ec-e6c64336c7ce tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Getting quotas for user 825059319a204b6da5bc7004b3a09361 and project b14b98f006574deabc030c2e93c680c4. Resources: {'key_pairs'} {{(pid=125440) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 12:34:17.243280 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-6d167330-19be-4d5b-a4ec-e6c64336c7ce tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.161065 Oct 31 12:34:17.243880 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 114/221] 10.222.0.15 () {60 vars in 1159 bytes} [Mon Oct 31 12:34:17 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 12:34:17.370135 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-33a77290-f0c2-4430-89af-e80b181cba24 tempest-VolumesSnapshotsTestJSON-540358646 tempest-VolumesSnapshotsTestJSON-540358646-project] Calling method '.version_select at 0x7f2aa691c430>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:34:17.402663 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-59418a8f-bfe9-4d80-9399-7e720924a155 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:34:17.403880 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-59418a8f-bfe9-4d80-9399-7e720924a155 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] [instance: d0befdd2-2ecd-4006-bfdd-86d5253a7687] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:34:17.411985 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-59418a8f-bfe9-4d80-9399-7e720924a155 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:34:17.412654 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-59418a8f-bfe9-4d80-9399-7e720924a155 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:34:17.413263 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-59418a8f-bfe9-4d80-9399-7e720924a155 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:34:17.414266 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-59418a8f-bfe9-4d80-9399-7e720924a155 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:34:17.415256 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-59418a8f-bfe9-4d80-9399-7e720924a155 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:34:17.415957 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-59418a8f-bfe9-4d80-9399-7e720924a155 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:34:17.425574 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-33a77290-f0c2-4430-89af-e80b181cba24 tempest-VolumesSnapshotsTestJSON-540358646 tempest-VolumesSnapshotsTestJSON-540358646-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/199962ce-9eb5-48d2-8113-55e65e8bff48" status: 200 len: 344 microversion: 2.1 time: 0.062805 Oct 31 12:34:17.440270 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 108/222] 10.222.0.15 () {58 vars in 1245 bytes} [Mon Oct 31 12:34:17 2022] GET /compute/v2.1/os-volumes/199962ce-9eb5-48d2-8113-55e65e8bff48 => generated 344 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 12:34:17.607186 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-59418a8f-bfe9-4d80-9399-7e720924a155 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2e978bcb824a5e9d593b861c9e3bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7573cb9c503243ab90b1649591d550e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:34:17.616305 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-59418a8f-bfe9-4d80-9399-7e720924a155 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] 10.222.0.15 "GET /compute/v2.1/servers/d0befdd2-2ecd-4006-bfdd-86d5253a7687" status: 200 len: 1522 microversion: 2.1 time: 0.218021 Oct 31 12:34:17.616922 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 115/223] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:34:17 2022] GET /compute/v2.1/servers/d0befdd2-2ecd-4006-bfdd-86d5253a7687 => generated 1522 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:34:17.904457 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-85570ecf-2aa0-4a17-8580-f8d994882da8 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:34:17.905069 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-85570ecf-2aa0-4a17-8580-f8d994882da8 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] [instance: 6f831a26-c1a4-4518-870e-6dd64516719c] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:34:17.906917 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG dbcounter [-] [125441] Writing DB stats nova_api:SELECT=82,nova_api:UPDATE=1 {{(pid=125441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:34:17.912662 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-85570ecf-2aa0-4a17-8580-f8d994882da8 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:34:17.913150 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-85570ecf-2aa0-4a17-8580-f8d994882da8 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:34:17.913583 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-85570ecf-2aa0-4a17-8580-f8d994882da8 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:34:17.914282 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-85570ecf-2aa0-4a17-8580-f8d994882da8 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:34:17.914736 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-85570ecf-2aa0-4a17-8580-f8d994882da8 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:34:17.915187 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-85570ecf-2aa0-4a17-8580-f8d994882da8 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:34:18.064754 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-85570ecf-2aa0-4a17-8580-f8d994882da8 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1918cb60ccd04e909b78dca9b0166be9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe4270c111747be8d61e4ae993bd7ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:34:18.072561 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-85570ecf-2aa0-4a17-8580-f8d994882da8 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] 10.222.0.15 "GET /compute/v2.1/servers/6f831a26-c1a4-4518-870e-6dd64516719c" status: 200 len: 1313 microversion: 2.1 time: 0.172013 Oct 31 12:34:18.073147 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 109/224] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:34:17 2022] GET /compute/v2.1/servers/6f831a26-c1a4-4518-870e-6dd64516719c => generated 1313 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:34:18.454167 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-9230392f-5ccd-44f5-8e66-da5276f5addb tempest-VolumesSnapshotsTestJSON-540358646 tempest-VolumesSnapshotsTestJSON-540358646-project] Calling method '.version_select at 0x7f2aa530f310>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:34:18.507138 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-9230392f-5ccd-44f5-8e66-da5276f5addb tempest-VolumesSnapshotsTestJSON-540358646 tempest-VolumesSnapshotsTestJSON-540358646-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/199962ce-9eb5-48d2-8113-55e65e8bff48" status: 200 len: 344 microversion: 2.1 time: 0.057553 Oct 31 12:34:18.507799 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 116/225] 10.222.0.15 () {58 vars in 1245 bytes} [Mon Oct 31 12:34:18 2022] GET /compute/v2.1/os-volumes/199962ce-9eb5-48d2-8113-55e65e8bff48 => generated 344 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 12:34:18.640250 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-8ce19ae6-7e4a-4a8e-87db-e41040523637 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:34:18.640998 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-8ce19ae6-7e4a-4a8e-87db-e41040523637 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] [instance: d0befdd2-2ecd-4006-bfdd-86d5253a7687] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:34:18.648050 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-8ce19ae6-7e4a-4a8e-87db-e41040523637 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:34:18.648607 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-8ce19ae6-7e4a-4a8e-87db-e41040523637 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:34:18.649119 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-8ce19ae6-7e4a-4a8e-87db-e41040523637 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:34:18.649843 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-8ce19ae6-7e4a-4a8e-87db-e41040523637 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:34:18.650289 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-8ce19ae6-7e4a-4a8e-87db-e41040523637 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:34:18.650703 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-8ce19ae6-7e4a-4a8e-87db-e41040523637 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:34:18.802055 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-8ce19ae6-7e4a-4a8e-87db-e41040523637 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2e978bcb824a5e9d593b861c9e3bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7573cb9c503243ab90b1649591d550e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:34:18.809934 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-8ce19ae6-7e4a-4a8e-87db-e41040523637 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] 10.222.0.15 "GET /compute/v2.1/servers/d0befdd2-2ecd-4006-bfdd-86d5253a7687" status: 200 len: 1522 microversion: 2.1 time: 0.173691 Oct 31 12:34:18.810517 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 110/226] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:34:18 2022] GET /compute/v2.1/servers/d0befdd2-2ecd-4006-bfdd-86d5253a7687 => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:34:19.096806 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-75b2329c-7841-432e-921e-fb5b3d540e0e tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:34:19.097432 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-75b2329c-7841-432e-921e-fb5b3d540e0e tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] [instance: 6f831a26-c1a4-4518-870e-6dd64516719c] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:34:19.103861 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-75b2329c-7841-432e-921e-fb5b3d540e0e tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:34:19.104619 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-75b2329c-7841-432e-921e-fb5b3d540e0e tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:34:19.105269 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-75b2329c-7841-432e-921e-fb5b3d540e0e tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:34:19.106044 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-75b2329c-7841-432e-921e-fb5b3d540e0e tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:34:19.106580 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-75b2329c-7841-432e-921e-fb5b3d540e0e tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:34:19.107182 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-75b2329c-7841-432e-921e-fb5b3d540e0e tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:34:19.255632 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-75b2329c-7841-432e-921e-fb5b3d540e0e tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1918cb60ccd04e909b78dca9b0166be9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe4270c111747be8d61e4ae993bd7ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:34:19.263346 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-75b2329c-7841-432e-921e-fb5b3d540e0e tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] 10.222.0.15 "GET /compute/v2.1/servers/6f831a26-c1a4-4518-870e-6dd64516719c" status: 200 len: 1496 microversion: 2.1 time: 0.171107 Oct 31 12:34:19.263909 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 117/227] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:34:19 2022] GET /compute/v2.1/servers/6f831a26-c1a4-4518-870e-6dd64516719c => generated 1496 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:34:19.522974 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-cf2226ff-dd74-4700-a613-2e1fc251c75f tempest-VolumesSnapshotsTestJSON-540358646 tempest-VolumesSnapshotsTestJSON-540358646-project] Calling method '.version_select at 0x7f2aa5225940>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:34:19.576796 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-cf2226ff-dd74-4700-a613-2e1fc251c75f tempest-VolumesSnapshotsTestJSON-540358646 tempest-VolumesSnapshotsTestJSON-540358646-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/199962ce-9eb5-48d2-8113-55e65e8bff48" status: 200 len: 345 microversion: 2.1 time: 0.057922 Oct 31 12:34:19.577577 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 111/228] 10.222.0.15 () {58 vars in 1245 bytes} [Mon Oct 31 12:34:19 2022] GET /compute/v2.1/os-volumes/199962ce-9eb5-48d2-8113-55e65e8bff48 => generated 345 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 12:34:19.592586 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-0592e481-0dee-4f22-ba69-b39ad2871c8a tempest-VolumesSnapshotsTestJSON-540358646 tempest-VolumesSnapshotsTestJSON-540358646-project] Action: 'create', calling method: .version_select at 0x7f2aa530f280>, body: {"snapshot": {"volume_id": "199962ce-9eb5-48d2-8113-55e65e8bff48", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-508811770"}} {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 12:34:19.764923 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-0592e481-0dee-4f22-ba69-b39ad2871c8a tempest-VolumesSnapshotsTestJSON-540358646 tempest-VolumesSnapshotsTestJSON-540358646-project] 10.222.0.15 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.176346 Oct 31 12:34:19.772688 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 118/229] 10.222.0.15 () {60 vars in 1162 bytes} [Mon Oct 31 12:34:19 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 12:34:19.778286 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-b4e4a79e-fa0a-4a74-bbe1-83ccdbec4748 tempest-VolumesSnapshotsTestJSON-540358646 tempest-VolumesSnapshotsTestJSON-540358646-project] Calling method '.version_select at 0x7f2aa5225160>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:34:19.851433 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-da6e906f-a2f4-434b-a4dd-354f78077253 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:34:19.851926 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-da6e906f-a2f4-434b-a4dd-354f78077253 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] [instance: d0befdd2-2ecd-4006-bfdd-86d5253a7687] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:34:19.852699 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-b4e4a79e-fa0a-4a74-bbe1-83ccdbec4748 tempest-VolumesSnapshotsTestJSON-540358646 tempest-VolumesSnapshotsTestJSON-540358646-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots/b01ad853-a2f4-4bcd-a63f-808846410820" status: 200 len: 286 microversion: 2.1 time: 0.078380 Oct 31 12:34:19.853270 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 112/230] 10.222.0.15 () {58 vars in 1251 bytes} [Mon Oct 31 12:34:19 2022] GET /compute/v2.1/os-snapshots/b01ad853-a2f4-4bcd-a63f-808846410820 => generated 286 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 12:34:19.861646 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-da6e906f-a2f4-434b-a4dd-354f78077253 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:34:19.862146 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-da6e906f-a2f4-434b-a4dd-354f78077253 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:34:19.862579 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-da6e906f-a2f4-434b-a4dd-354f78077253 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:34:19.863304 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-da6e906f-a2f4-434b-a4dd-354f78077253 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:34:19.863758 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-da6e906f-a2f4-434b-a4dd-354f78077253 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:34:19.864178 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-da6e906f-a2f4-434b-a4dd-354f78077253 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:34:19.865123 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-dd03f1d6-5ae4-47ab-a5e5-47e465ea7082 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:34:19.865632 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-dd03f1d6-5ae4-47ab-a5e5-47e465ea7082 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] [instance: 6f831a26-c1a4-4518-870e-6dd64516719c] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:34:19.872666 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-dd03f1d6-5ae4-47ab-a5e5-47e465ea7082 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:34:19.873151 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-dd03f1d6-5ae4-47ab-a5e5-47e465ea7082 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:34:19.873586 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-dd03f1d6-5ae4-47ab-a5e5-47e465ea7082 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:34:19.874281 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-dd03f1d6-5ae4-47ab-a5e5-47e465ea7082 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:34:19.874764 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-dd03f1d6-5ae4-47ab-a5e5-47e465ea7082 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:34:19.875202 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-dd03f1d6-5ae4-47ab-a5e5-47e465ea7082 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:34:19.902234 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-dd03f1d6-5ae4-47ab-a5e5-47e465ea7082 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] [instance: 6f831a26-c1a4-4518-870e-6dd64516719c] Going to try to terminate instance {{(pid=125441) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 12:34:19.989874 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-dd03f1d6-5ae4-47ab-a5e5-47e465ea7082 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] 10.222.0.15 "DELETE /compute/v2.1/servers/6f831a26-c1a4-4518-870e-6dd64516719c" status: 204 len: 0 microversion: 2.1 time: 0.128314 Oct 31 12:34:19.993404 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 113/231] 10.222.0.15 () {58 vars in 1239 bytes} [Mon Oct 31 12:34:19 2022] DELETE /compute/v2.1/servers/6f831a26-c1a4-4518-870e-6dd64516719c => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 31 12:34:19.999938 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-92f7b616-5ac1-41f7-9c2a-0726b2756019 tempest-VolumesSnapshotsTestJSON-540358646 tempest-VolumesSnapshotsTestJSON-540358646-project] Calling method '.version_select at 0x7f2aa6771af0>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:34:20.018091 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-da6e906f-a2f4-434b-a4dd-354f78077253 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2e978bcb824a5e9d593b861c9e3bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7573cb9c503243ab90b1649591d550e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:34:20.035817 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-92f7b616-5ac1-41f7-9c2a-0726b2756019 tempest-VolumesSnapshotsTestJSON-540358646 tempest-VolumesSnapshotsTestJSON-540358646-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.041025 Oct 31 12:34:20.036296 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-da6e906f-a2f4-434b-a4dd-354f78077253 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] 10.222.0.15 "GET /compute/v2.1/servers/d0befdd2-2ecd-4006-bfdd-86d5253a7687" status: 200 len: 1522 microversion: 2.1 time: 0.203791 Oct 31 12:34:20.036419 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 114/232] 10.222.0.15 () {58 vars in 1140 bytes} [Mon Oct 31 12:34:19 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 12:34:20.040811 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-c9896eea-f58e-443d-ba2e-d2ec4d40d5f8 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:34:20.041515 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-c9896eea-f58e-443d-ba2e-d2ec4d40d5f8 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] [instance: 6f831a26-c1a4-4518-870e-6dd64516719c] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:34:20.041887 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 119/233] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:34:19 2022] GET /compute/v2.1/servers/d0befdd2-2ecd-4006-bfdd-86d5253a7687 => generated 1522 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:34:20.051006 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-c9896eea-f58e-443d-ba2e-d2ec4d40d5f8 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:34:20.051893 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-c9896eea-f58e-443d-ba2e-d2ec4d40d5f8 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:34:20.052498 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-c9896eea-f58e-443d-ba2e-d2ec4d40d5f8 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:34:20.053823 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-c9896eea-f58e-443d-ba2e-d2ec4d40d5f8 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:34:20.054455 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-c9896eea-f58e-443d-ba2e-d2ec4d40d5f8 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:34:20.055011 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-c9896eea-f58e-443d-ba2e-d2ec4d40d5f8 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:34:20.062828 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-3510e40f-4196-4a8c-b4b3-af80fd6083fe tempest-VolumesSnapshotsTestJSON-540358646 tempest-VolumesSnapshotsTestJSON-540358646-project] Calling method '.version_select at 0x7f2aa53e7940>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:34:20.108275 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-3510e40f-4196-4a8c-b4b3-af80fd6083fe tempest-VolumesSnapshotsTestJSON-540358646 tempest-VolumesSnapshotsTestJSON-540358646-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots/b01ad853-a2f4-4bcd-a63f-808846410820" status: 200 len: 286 microversion: 2.1 time: 0.056958 Oct 31 12:34:20.114714 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 120/234] 10.222.0.15 () {58 vars in 1251 bytes} [Mon Oct 31 12:34:20 2022] GET /compute/v2.1/os-snapshots/b01ad853-a2f4-4bcd-a63f-808846410820 => generated 286 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 12:34:20.202184 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-c9896eea-f58e-443d-ba2e-d2ec4d40d5f8 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1918cb60ccd04e909b78dca9b0166be9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe4270c111747be8d61e4ae993bd7ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:34:20.215829 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-c9896eea-f58e-443d-ba2e-d2ec4d40d5f8 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] 10.222.0.15 "GET /compute/v2.1/servers/6f831a26-c1a4-4518-870e-6dd64516719c" status: 200 len: 1502 microversion: 2.1 time: 0.178424 Oct 31 12:34:20.216914 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 115/235] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:34:20 2022] GET /compute/v2.1/servers/6f831a26-c1a4-4518-870e-6dd64516719c => generated 1502 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:34:21.064834 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-e415c7ff-2166-442a-9270-edd4f550bdf4 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:34:21.065429 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-e415c7ff-2166-442a-9270-edd4f550bdf4 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] [instance: d0befdd2-2ecd-4006-bfdd-86d5253a7687] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:34:21.071368 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-e415c7ff-2166-442a-9270-edd4f550bdf4 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:34:21.071844 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-e415c7ff-2166-442a-9270-edd4f550bdf4 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:34:21.072270 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-e415c7ff-2166-442a-9270-edd4f550bdf4 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:34:21.072947 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-e415c7ff-2166-442a-9270-edd4f550bdf4 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:34:21.073387 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-e415c7ff-2166-442a-9270-edd4f550bdf4 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:34:21.073802 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-e415c7ff-2166-442a-9270-edd4f550bdf4 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:34:21.121957 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-ef323e5d-0737-42a3-b0d6-4f1bbb5c81c2 tempest-VolumesSnapshotsTestJSON-540358646 tempest-VolumesSnapshotsTestJSON-540358646-project] Calling method '.version_select at 0x7f2aa5225940>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:34:21.155509 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-ef323e5d-0737-42a3-b0d6-4f1bbb5c81c2 tempest-VolumesSnapshotsTestJSON-540358646 tempest-VolumesSnapshotsTestJSON-540358646-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots/b01ad853-a2f4-4bcd-a63f-808846410820" status: 200 len: 286 microversion: 2.1 time: 0.037263 Oct 31 12:34:21.159102 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 116/236] 10.222.0.15 () {58 vars in 1251 bytes} [Mon Oct 31 12:34:21 2022] GET /compute/v2.1/os-snapshots/b01ad853-a2f4-4bcd-a63f-808846410820 => generated 286 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 12:34:21.208040 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-e415c7ff-2166-442a-9270-edd4f550bdf4 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2e978bcb824a5e9d593b861c9e3bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7573cb9c503243ab90b1649591d550e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:34:21.216329 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-e415c7ff-2166-442a-9270-edd4f550bdf4 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] 10.222.0.15 "GET /compute/v2.1/servers/d0befdd2-2ecd-4006-bfdd-86d5253a7687" status: 200 len: 1522 microversion: 2.1 time: 0.155529 Oct 31 12:34:21.216921 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 121/237] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:34:21 2022] GET /compute/v2.1/servers/d0befdd2-2ecd-4006-bfdd-86d5253a7687 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:34:21.238823 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-3b43d5fd-58bd-4996-9412-4dc441ccef43 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:34:21.239472 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-3b43d5fd-58bd-4996-9412-4dc441ccef43 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] [instance: 6f831a26-c1a4-4518-870e-6dd64516719c] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:34:21.245631 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-3b43d5fd-58bd-4996-9412-4dc441ccef43 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:34:21.246110 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-3b43d5fd-58bd-4996-9412-4dc441ccef43 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:34:21.246540 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-3b43d5fd-58bd-4996-9412-4dc441ccef43 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:34:21.247295 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-3b43d5fd-58bd-4996-9412-4dc441ccef43 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:34:21.247745 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-3b43d5fd-58bd-4996-9412-4dc441ccef43 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:34:21.248160 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-3b43d5fd-58bd-4996-9412-4dc441ccef43 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:34:21.382200 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-3b43d5fd-58bd-4996-9412-4dc441ccef43 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1918cb60ccd04e909b78dca9b0166be9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe4270c111747be8d61e4ae993bd7ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:34:21.389765 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-3b43d5fd-58bd-4996-9412-4dc441ccef43 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] 10.222.0.15 "GET /compute/v2.1/servers/6f831a26-c1a4-4518-870e-6dd64516719c" status: 200 len: 1502 microversion: 2.1 time: 0.155210 Oct 31 12:34:21.390334 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 117/238] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:34:21 2022] GET /compute/v2.1/servers/6f831a26-c1a4-4518-870e-6dd64516719c => generated 1502 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:34:22.168442 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-c507ca1c-ce39-4ddc-9185-334a33a5e2bc tempest-VolumesSnapshotsTestJSON-540358646 tempest-VolumesSnapshotsTestJSON-540358646-project] Calling method '.version_select at 0x7f2aa54aff70>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:34:22.198698 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-c507ca1c-ce39-4ddc-9185-334a33a5e2bc tempest-VolumesSnapshotsTestJSON-540358646 tempest-VolumesSnapshotsTestJSON-540358646-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots/b01ad853-a2f4-4bcd-a63f-808846410820" status: 200 len: 286 microversion: 2.1 time: 0.034145 Oct 31 12:34:22.199426 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 122/239] 10.222.0.15 () {58 vars in 1251 bytes} [Mon Oct 31 12:34:22 2022] GET /compute/v2.1/os-snapshots/b01ad853-a2f4-4bcd-a63f-808846410820 => generated 286 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 12:34:22.239322 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-96e829fd-ebd1-4407-b12c-11101125ca97 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:34:22.240022 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-96e829fd-ebd1-4407-b12c-11101125ca97 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] [instance: d0befdd2-2ecd-4006-bfdd-86d5253a7687] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:34:22.246530 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-96e829fd-ebd1-4407-b12c-11101125ca97 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:34:22.247082 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-96e829fd-ebd1-4407-b12c-11101125ca97 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:34:22.247635 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-96e829fd-ebd1-4407-b12c-11101125ca97 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:34:22.248387 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-96e829fd-ebd1-4407-b12c-11101125ca97 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:34:22.248903 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-96e829fd-ebd1-4407-b12c-11101125ca97 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:34:22.249394 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-96e829fd-ebd1-4407-b12c-11101125ca97 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:34:22.380603 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-96e829fd-ebd1-4407-b12c-11101125ca97 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2e978bcb824a5e9d593b861c9e3bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7573cb9c503243ab90b1649591d550e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:34:22.388197 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-96e829fd-ebd1-4407-b12c-11101125ca97 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] 10.222.0.15 "GET /compute/v2.1/servers/d0befdd2-2ecd-4006-bfdd-86d5253a7687" status: 200 len: 1522 microversion: 2.1 time: 0.153061 Oct 31 12:34:22.388780 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 118/240] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:34:22 2022] GET /compute/v2.1/servers/d0befdd2-2ecd-4006-bfdd-86d5253a7687 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:34:22.412668 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-4caa56e5-1111-4604-8363-2680560968ff tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:34:22.413267 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-4caa56e5-1111-4604-8363-2680560968ff tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] [instance: 6f831a26-c1a4-4518-870e-6dd64516719c] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:34:22.419047 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-4caa56e5-1111-4604-8363-2680560968ff tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:34:22.419488 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-4caa56e5-1111-4604-8363-2680560968ff tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:34:22.419916 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-4caa56e5-1111-4604-8363-2680560968ff tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:34:22.420602 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-4caa56e5-1111-4604-8363-2680560968ff tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:34:22.421047 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-4caa56e5-1111-4604-8363-2680560968ff tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:34:22.421462 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-4caa56e5-1111-4604-8363-2680560968ff tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:34:22.551610 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-4caa56e5-1111-4604-8363-2680560968ff tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1918cb60ccd04e909b78dca9b0166be9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe4270c111747be8d61e4ae993bd7ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:34:22.559300 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-4caa56e5-1111-4604-8363-2680560968ff tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] 10.222.0.15 "GET /compute/v2.1/servers/6f831a26-c1a4-4518-870e-6dd64516719c" status: 200 len: 1502 microversion: 2.1 time: 0.150426 Oct 31 12:34:22.559859 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 123/241] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:34:22 2022] GET /compute/v2.1/servers/6f831a26-c1a4-4518-870e-6dd64516719c => generated 1502 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:34:23.211684 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-e38ba683-d234-4862-91ca-fa4ba09ca759 tempest-VolumesSnapshotsTestJSON-540358646 tempest-VolumesSnapshotsTestJSON-540358646-project] Calling method '.version_select at 0x7f2aa5228040>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:34:23.241768 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-e38ba683-d234-4862-91ca-fa4ba09ca759 tempest-VolumesSnapshotsTestJSON-540358646 tempest-VolumesSnapshotsTestJSON-540358646-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots/b01ad853-a2f4-4bcd-a63f-808846410820" status: 200 len: 287 microversion: 2.1 time: 0.033750 Oct 31 12:34:23.242478 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 119/242] 10.222.0.15 () {58 vars in 1251 bytes} [Mon Oct 31 12:34:23 2022] GET /compute/v2.1/os-snapshots/b01ad853-a2f4-4bcd-a63f-808846410820 => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 12:34:23.254453 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-a9b7182f-9048-4c50-ae75-065592871cc5 tempest-VolumesSnapshotsTestJSON-540358646 tempest-VolumesSnapshotsTestJSON-540358646-project] Calling method '.version_select at 0x7f2aa53e7310>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:34:23.310628 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-a9b7182f-9048-4c50-ae75-065592871cc5 tempest-VolumesSnapshotsTestJSON-540358646 tempest-VolumesSnapshotsTestJSON-540358646-project] 10.222.0.15 "DELETE /compute/v2.1/os-snapshots/b01ad853-a2f4-4bcd-a63f-808846410820" status: 202 len: 0 microversion: 2.1 time: 0.060645 Oct 31 12:34:23.311343 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 124/243] 10.222.0.15 () {58 vars in 1254 bytes} [Mon Oct 31 12:34:23 2022] DELETE /compute/v2.1/os-snapshots/b01ad853-a2f4-4bcd-a63f-808846410820 => generated 0 bytes in 62 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 12:34:23.320506 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-19ea5933-c369-458d-9ded-9503ea7456ce tempest-VolumesSnapshotsTestJSON-540358646 tempest-VolumesSnapshotsTestJSON-540358646-project] Calling method '.version_select at 0x7f2aa5225670>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:34:23.350029 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-19ea5933-c369-458d-9ded-9503ea7456ce tempest-VolumesSnapshotsTestJSON-540358646 tempest-VolumesSnapshotsTestJSON-540358646-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots/b01ad853-a2f4-4bcd-a63f-808846410820" status: 200 len: 286 microversion: 2.1 time: 0.033749 Oct 31 12:34:23.350661 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 120/244] 10.222.0.15 () {58 vars in 1251 bytes} [Mon Oct 31 12:34:23 2022] GET /compute/v2.1/os-snapshots/b01ad853-a2f4-4bcd-a63f-808846410820 => generated 286 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 12:34:23.411833 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-e13970da-cc7e-47b2-bd78-4063189cd123 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:34:23.412469 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-e13970da-cc7e-47b2-bd78-4063189cd123 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] [instance: d0befdd2-2ecd-4006-bfdd-86d5253a7687] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:34:23.418313 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-e13970da-cc7e-47b2-bd78-4063189cd123 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:34:23.418787 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-e13970da-cc7e-47b2-bd78-4063189cd123 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:34:23.419236 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-e13970da-cc7e-47b2-bd78-4063189cd123 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:34:23.419921 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-e13970da-cc7e-47b2-bd78-4063189cd123 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:34:23.420370 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-e13970da-cc7e-47b2-bd78-4063189cd123 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:34:23.420790 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-e13970da-cc7e-47b2-bd78-4063189cd123 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:34:23.582146 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-d82327b9-5c14-4116-a09a-9265889b683c tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:34:23.582774 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-d82327b9-5c14-4116-a09a-9265889b683c tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] [instance: 6f831a26-c1a4-4518-870e-6dd64516719c] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:34:23.590271 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-d82327b9-5c14-4116-a09a-9265889b683c tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:34:23.594246 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-d82327b9-5c14-4116-a09a-9265889b683c tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:34:23.595280 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-d82327b9-5c14-4116-a09a-9265889b683c tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:34:23.597251 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-d82327b9-5c14-4116-a09a-9265889b683c tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:34:23.597671 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-d82327b9-5c14-4116-a09a-9265889b683c tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:34:23.598099 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-d82327b9-5c14-4116-a09a-9265889b683c tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:34:23.658952 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-e13970da-cc7e-47b2-bd78-4063189cd123 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2e978bcb824a5e9d593b861c9e3bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7573cb9c503243ab90b1649591d550e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:34:23.672132 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-e13970da-cc7e-47b2-bd78-4063189cd123 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] 10.222.0.15 "GET /compute/v2.1/servers/d0befdd2-2ecd-4006-bfdd-86d5253a7687" status: 200 len: 1522 microversion: 2.1 time: 0.264147 Oct 31 12:34:23.673694 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 125/245] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:34:23 2022] GET /compute/v2.1/servers/d0befdd2-2ecd-4006-bfdd-86d5253a7687 => generated 1522 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:34:23.764616 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-d82327b9-5c14-4116-a09a-9265889b683c tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1918cb60ccd04e909b78dca9b0166be9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe4270c111747be8d61e4ae993bd7ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:34:23.775118 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-d82327b9-5c14-4116-a09a-9265889b683c tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] 10.222.0.15 "GET /compute/v2.1/servers/6f831a26-c1a4-4518-870e-6dd64516719c" status: 200 len: 1502 microversion: 2.1 time: 0.197004 Oct 31 12:34:23.775928 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 121/246] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:34:23 2022] GET /compute/v2.1/servers/6f831a26-c1a4-4518-870e-6dd64516719c => generated 1502 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:34:23.960447 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [req-f058a0b5-36bc-4a69-b39b-757519a799fe req-42c8e58b-f2e1-49cf-b0a2-2830f7d8ecbc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f831a26-c1a4-4518-870e-6dd64516719c", "name": "network-vif-deleted", "tag": "ce23525c-19f9-4b3b-bdc6-f5c09ca3e19c"}]} {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 12:34:23.978093 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [req-f058a0b5-36bc-4a69-b39b-757519a799fe req-42c8e58b-f2e1-49cf-b0a2-2830f7d8ecbc service nova] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:34:23.978676 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [req-f058a0b5-36bc-4a69-b39b-757519a799fe req-42c8e58b-f2e1-49cf-b0a2-2830f7d8ecbc service nova] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:34:23.979095 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [req-f058a0b5-36bc-4a69-b39b-757519a799fe req-42c8e58b-f2e1-49cf-b0a2-2830f7d8ecbc service nova] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:34:23.991183 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.compute.server_external_events [req-f058a0b5-36bc-4a69-b39b-757519a799fe req-42c8e58b-f2e1-49cf-b0a2-2830f7d8ecbc service nova] Creating event network-vif-deleted:ce23525c-19f9-4b3b-bdc6-f5c09ca3e19c for instance 6f831a26-c1a4-4518-870e-6dd64516719c on hv-cinder-79617 Oct 31 12:34:23.997340 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [req-f058a0b5-36bc-4a69-b39b-757519a799fe req-42c8e58b-f2e1-49cf-b0a2-2830f7d8ecbc service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043975 Oct 31 12:34:23.998226 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 126/247] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Oct 31 12:34:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 12:34:24.362420 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-3581dd7e-a070-495f-89c7-514b0bab0d2d tempest-VolumesSnapshotsTestJSON-540358646 tempest-VolumesSnapshotsTestJSON-540358646-project] Calling method '.version_select at 0x7f2aa5225670>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:34:24.393403 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-3581dd7e-a070-495f-89c7-514b0bab0d2d tempest-VolumesSnapshotsTestJSON-540358646 tempest-VolumesSnapshotsTestJSON-540358646-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots/b01ad853-a2f4-4bcd-a63f-808846410820" status: 200 len: 286 microversion: 2.1 time: 0.034868 Oct 31 12:34:24.393975 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 122/248] 10.222.0.15 () {58 vars in 1251 bytes} [Mon Oct 31 12:34:24 2022] GET /compute/v2.1/os-snapshots/b01ad853-a2f4-4bcd-a63f-808846410820 => generated 286 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 12:34:24.699736 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-7ce5f417-4a9d-479c-8b44-bee07247b10c tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:34:24.700522 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-7ce5f417-4a9d-479c-8b44-bee07247b10c tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] [instance: d0befdd2-2ecd-4006-bfdd-86d5253a7687] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:34:24.706721 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-7ce5f417-4a9d-479c-8b44-bee07247b10c tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:34:24.707290 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-7ce5f417-4a9d-479c-8b44-bee07247b10c tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:34:24.707828 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-7ce5f417-4a9d-479c-8b44-bee07247b10c tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:34:24.708583 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-7ce5f417-4a9d-479c-8b44-bee07247b10c tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:34:24.709018 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-7ce5f417-4a9d-479c-8b44-bee07247b10c tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:34:24.709524 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-7ce5f417-4a9d-479c-8b44-bee07247b10c tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:34:24.801549 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-e0f08c89-412f-481a-b0c4-3893cf1b097e tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:34:24.802553 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-e0f08c89-412f-481a-b0c4-3893cf1b097e tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] [instance: 6f831a26-c1a4-4518-870e-6dd64516719c] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:34:24.809419 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-e0f08c89-412f-481a-b0c4-3893cf1b097e tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:34:24.809907 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-e0f08c89-412f-481a-b0c4-3893cf1b097e tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:34:24.810347 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-e0f08c89-412f-481a-b0c4-3893cf1b097e tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:34:24.811046 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-e0f08c89-412f-481a-b0c4-3893cf1b097e tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:34:24.811551 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-e0f08c89-412f-481a-b0c4-3893cf1b097e tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:34:24.812148 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-e0f08c89-412f-481a-b0c4-3893cf1b097e tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:34:24.848960 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-e0f08c89-412f-481a-b0c4-3893cf1b097e tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:34:24.849448 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-e0f08c89-412f-481a-b0c4-3893cf1b097e tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:34:24.849883 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-e0f08c89-412f-481a-b0c4-3893cf1b097e tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:34:24.850327 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.objects.instance [None req-e0f08c89-412f-481a-b0c4-3893cf1b097e tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Lazy-loading 'fault' on Instance uuid 6f831a26-c1a4-4518-870e-6dd64516719c {{(pid=125441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 12:34:24.855428 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-7ce5f417-4a9d-479c-8b44-bee07247b10c tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2e978bcb824a5e9d593b861c9e3bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7573cb9c503243ab90b1649591d550e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:34:24.863865 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-7ce5f417-4a9d-479c-8b44-bee07247b10c tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] 10.222.0.15 "GET /compute/v2.1/servers/d0befdd2-2ecd-4006-bfdd-86d5253a7687" status: 200 len: 1522 microversion: 2.1 time: 0.170439 Oct 31 12:34:24.864495 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 127/249] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:34:24 2022] GET /compute/v2.1/servers/d0befdd2-2ecd-4006-bfdd-86d5253a7687 => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:34:24.894629 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-e0f08c89-412f-481a-b0c4-3893cf1b097e tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1918cb60ccd04e909b78dca9b0166be9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe4270c111747be8d61e4ae993bd7ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:34:24.902541 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-e0f08c89-412f-481a-b0c4-3893cf1b097e tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] 10.222.0.15 "GET /compute/v2.1/servers/6f831a26-c1a4-4518-870e-6dd64516719c" status: 200 len: 1303 microversion: 2.1 time: 0.107176 Oct 31 12:34:24.903119 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 123/250] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:34:24 2022] GET /compute/v2.1/servers/6f831a26-c1a4-4518-870e-6dd64516719c => generated 1303 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 12:34:25.406196 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-0e6d7807-ca76-4b72-b808-b6985deac505 tempest-VolumesSnapshotsTestJSON-540358646 tempest-VolumesSnapshotsTestJSON-540358646-project] Calling method '.version_select at 0x7f2aa5305940>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:34:25.432271 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.wsgi [None req-0e6d7807-ca76-4b72-b808-b6985deac505 tempest-VolumesSnapshotsTestJSON-540358646 tempest-VolumesSnapshotsTestJSON-540358646-project] HTTP exception thrown: Snapshot b01ad853-a2f4-4bcd-a63f-808846410820 could not be found. Oct 31 12:34:25.435902 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-0e6d7807-ca76-4b72-b808-b6985deac505 tempest-VolumesSnapshotsTestJSON-540358646 tempest-VolumesSnapshotsTestJSON-540358646-project] Request method failure captured: Oct 31 12:34:25.435902 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: request: GET /compute/v2.1/os-snapshots/b01ad853-a2f4-4bcd-a63f-808846410820 HTTP/1.1 Oct 31 12:34:25.435902 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: Accept: application/json Oct 31 12:34:25.435902 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: Accept-Encoding: identity Oct 31 12:34:25.435902 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: Connection: close Oct 31 12:34:25.435902 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: Content-Length: 0 Oct 31 12:34:25.435902 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: Content-Type: application/json Oct 31 12:34:25.435902 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: Host: 10.222.0.15 Oct 31 12:34:25.435902 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: Openstack-System-Scope: None Oct 31 12:34:25.435902 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: User-Agent: python-urllib3/1.26.12 Oct 31 12:34:25.435902 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Auth-Token: gAAAAABjX8DGcKJm-XbGwSg2X56qfJUc_95XYG_WDtZ83_P-17EzNW40vb8CEgbNg3Lvw5nU8P72SlRiKwsodNDQRbkLnjKxETbhrQkLtZi54b3jb5iFVBGIsR-8zJ4UtUqp-RRgW8yMm311VGnAHDWm7mzXHLRbH_jSxVq7fmm6n7IksJa3mJo Oct 31 12:34:25.435902 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Domain-Id: None Oct 31 12:34:25.435902 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Domain-Name: None Oct 31 12:34:25.435902 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Identity-Status: Confirmed Oct 31 12:34:25.435902 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Is-Admin-Project: True Oct 31 12:34:25.435902 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Project-Domain-Id: default Oct 31 12:34:25.435902 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Project-Domain-Name: Default Oct 31 12:34:25.435902 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Project-Id: 44205e3c7d864276bb80d9b5a59d266b Oct 31 12:34:25.435902 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-540358646 Oct 31 12:34:25.435902 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Role: reader,member Oct 31 12:34:25.435902 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Roles: reader,member Oct 31 12:34:25.437382 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/44205e3c7d864276bb80d9b5a59d266b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_44205e3c7d864276bb80d9b5a59d266b", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/44205e3c7d864276bb80d9b5a59d266b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/44205e3c7d864276bb80d9b5a59d266b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Oct 31 12:34:25.437382 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Tenant: tempest-VolumesSnapshotsTestJSON-540358646 Oct 31 12:34:25.437382 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Tenant-Id: 44205e3c7d864276bb80d9b5a59d266b Oct 31 12:34:25.437382 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-540358646 Oct 31 12:34:25.437382 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-User: tempest-VolumesSnapshotsTestJSON-540358646-project Oct 31 12:34:25.437382 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-User-Domain-Id: default Oct 31 12:34:25.437382 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-User-Domain-Name: Default Oct 31 12:34:25.437382 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-User-Id: 03b31c6585714f0187a06fd433be18ad Oct 31 12:34:25.437382 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-User-Name: tempest-VolumesSnapshotsTestJSON-540358646-project Oct 31 12:34:25.437382 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: method: Oct 31 12:34:25.437382 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: exception: Snapshot b01ad853-a2f4-4bcd-a63f-808846410820 could not be found. Oct 31 12:34:25.437382 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: action_args: {'id': 'b01ad853-a2f4-4bcd-a63f-808846410820'} Oct 31 12:34:25.437382 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 12:34:25.438239 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 12:34:25.438239 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 31 12:34:25.438239 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 31 12:34:25.438239 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 31 12:34:25.438239 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 31 12:34:25.438239 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 31 12:34:25.438239 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 31 12:34:25.438239 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 31 12:34:25.438239 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 31 12:34:25.438239 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 31 12:34:25.438239 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 31 12:34:25.438239 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 31 12:34:25.438239 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 31 12:34:25.438239 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 31 12:34:25.438239 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 31 12:34:25.438239 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot b01ad853-a2f4-4bcd-a63f-808846410820 could not be found. (HTTP 404) (Request-ID: req-fccb04c7-9c2d-4111-a978-18addb6b4519) Oct 31 12:34:25.438239 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Oct 31 12:34:25.438239 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 12:34:25.440259 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Oct 31 12:34:25.440259 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 12:34:25.440259 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Oct 31 12:34:25.440259 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Oct 31 12:34:25.440259 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 31 12:34:25.440259 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 31 12:34:25.440259 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Oct 31 12:34:25.440259 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Oct 31 12:34:25.440259 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 31 12:34:25.440259 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 31 12:34:25.440259 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 31 12:34:25.440259 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 31 12:34:25.440259 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 31 12:34:25.440259 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 31 12:34:25.440259 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 31 12:34:25.440259 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 31 12:34:25.440259 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 31 12:34:25.440259 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 31 12:34:25.440259 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 31 12:34:25.441634 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 31 12:34:25.441634 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 31 12:34:25.441634 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 31 12:34:25.441634 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 31 12:34:25.441634 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 31 12:34:25.441634 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot b01ad853-a2f4-4bcd-a63f-808846410820 could not be found. Oct 31 12:34:25.441634 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Oct 31 12:34:25.441634 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 12:34:25.441634 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Oct 31 12:34:25.441634 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 12:34:25.441634 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 12:34:25.441634 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 12:34:25.441634 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 12:34:25.441634 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 12:34:25.441634 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 12:34:25.441634 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 12:34:25.441634 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 12:34:25.441634 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 12:34:25.441634 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Oct 31 12:34:25.441634 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 12:34:25.442948 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot b01ad853-a2f4-4bcd-a63f-808846410820 could not be found. Oct 31 12:34:25.442948 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Oct 31 12:34:25.442948 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 12:34:25.442948 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Oct 31 12:34:25.442948 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 12:34:25.442948 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 12:34:25.442948 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 12:34:25.442948 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 12:34:25.442948 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 12:34:25.442948 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot b01ad853-a2f4-4bcd-a63f-808846410820 could not be found. Oct 31 12:34:25.442948 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Oct 31 12:34:25.442948 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-0e6d7807-ca76-4b72-b808-b6985deac505 tempest-VolumesSnapshotsTestJSON-540358646 tempest-VolumesSnapshotsTestJSON-540358646-project] Returning 404 to user: Snapshot b01ad853-a2f4-4bcd-a63f-808846410820 could not be found. {{(pid=125440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 12:34:25.442948 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-0e6d7807-ca76-4b72-b808-b6985deac505 tempest-VolumesSnapshotsTestJSON-540358646 tempest-VolumesSnapshotsTestJSON-540358646-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots/b01ad853-a2f4-4bcd-a63f-808846410820" status: 404 len: 111 microversion: 2.1 time: 0.034956 Oct 31 12:34:25.442948 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 128/251] 10.222.0.15 () {58 vars in 1251 bytes} [Mon Oct 31 12:34:25 2022] GET /compute/v2.1/os-snapshots/b01ad853-a2f4-4bcd-a63f-808846410820 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 12:34:25.446765 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-5f9464b3-143c-4cd1-b75b-758b3276e4b1 tempest-VolumesSnapshotsTestJSON-540358646 tempest-VolumesSnapshotsTestJSON-540358646-project] Calling method '.version_select at 0x7f2aa5225790>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:34:25.505763 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-5f9464b3-143c-4cd1-b75b-758b3276e4b1 tempest-VolumesSnapshotsTestJSON-540358646 tempest-VolumesSnapshotsTestJSON-540358646-project] 10.222.0.15 "DELETE /compute/v2.1/os-volumes/199962ce-9eb5-48d2-8113-55e65e8bff48" status: 202 len: 0 microversion: 2.1 time: 0.062683 Oct 31 12:34:25.506334 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 124/252] 10.222.0.15 () {58 vars in 1248 bytes} [Mon Oct 31 12:34:25 2022] DELETE /compute/v2.1/os-volumes/199962ce-9eb5-48d2-8113-55e65e8bff48 => generated 0 bytes in 64 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 12:34:25.514410 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-19e82e57-1402-4cb6-b63f-a01dfd403e43 tempest-VolumesSnapshotsTestJSON-540358646 tempest-VolumesSnapshotsTestJSON-540358646-project] Calling method '.version_select at 0x7f2aa5314f70>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:34:25.562110 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-19e82e57-1402-4cb6-b63f-a01dfd403e43 tempest-VolumesSnapshotsTestJSON-540358646 tempest-VolumesSnapshotsTestJSON-540358646-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/199962ce-9eb5-48d2-8113-55e65e8bff48" status: 200 len: 344 microversion: 2.1 time: 0.051322 Oct 31 12:34:25.562686 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 129/253] 10.222.0.15 () {58 vars in 1245 bytes} [Mon Oct 31 12:34:25 2022] GET /compute/v2.1/os-volumes/199962ce-9eb5-48d2-8113-55e65e8bff48 => generated 344 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 12:34:25.887835 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-c7127185-5b30-44f0-a30e-f47a1d5f4b8d tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:34:25.888433 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-c7127185-5b30-44f0-a30e-f47a1d5f4b8d tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] [instance: d0befdd2-2ecd-4006-bfdd-86d5253a7687] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:34:25.895852 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-c7127185-5b30-44f0-a30e-f47a1d5f4b8d tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:34:25.896328 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-c7127185-5b30-44f0-a30e-f47a1d5f4b8d tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:34:25.896752 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-c7127185-5b30-44f0-a30e-f47a1d5f4b8d tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:34:25.897426 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-c7127185-5b30-44f0-a30e-f47a1d5f4b8d tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:34:25.897871 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-c7127185-5b30-44f0-a30e-f47a1d5f4b8d tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:34:25.898514 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-c7127185-5b30-44f0-a30e-f47a1d5f4b8d tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:34:25.924847 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-e3b1fcea-791b-4275-a220-9ee351897d7b tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:34:25.925452 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-e3b1fcea-791b-4275-a220-9ee351897d7b tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] [instance: 6f831a26-c1a4-4518-870e-6dd64516719c] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:34:25.931516 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-e3b1fcea-791b-4275-a220-9ee351897d7b tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:34:25.931999 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-e3b1fcea-791b-4275-a220-9ee351897d7b tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:34:25.932420 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-e3b1fcea-791b-4275-a220-9ee351897d7b tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:34:25.933099 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-e3b1fcea-791b-4275-a220-9ee351897d7b tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:34:25.933544 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-e3b1fcea-791b-4275-a220-9ee351897d7b tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:34:25.933958 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-e3b1fcea-791b-4275-a220-9ee351897d7b tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:34:25.968149 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-e3b1fcea-791b-4275-a220-9ee351897d7b tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:34:25.968624 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-e3b1fcea-791b-4275-a220-9ee351897d7b tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:34:25.969083 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-e3b1fcea-791b-4275-a220-9ee351897d7b tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:34:25.969522 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.objects.instance [None req-e3b1fcea-791b-4275-a220-9ee351897d7b tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Lazy-loading 'fault' on Instance uuid 6f831a26-c1a4-4518-870e-6dd64516719c {{(pid=125440) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 12:34:25.972549 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG dbcounter [-] [125440] Writing DB stats nova_cell1:SELECT=100 {{(pid=125440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:34:26.011616 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-e3b1fcea-791b-4275-a220-9ee351897d7b tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1918cb60ccd04e909b78dca9b0166be9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe4270c111747be8d61e4ae993bd7ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:34:26.019505 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-e3b1fcea-791b-4275-a220-9ee351897d7b tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] 10.222.0.15 "GET /compute/v2.1/servers/6f831a26-c1a4-4518-870e-6dd64516719c" status: 200 len: 1303 microversion: 2.1 time: 0.098736 Oct 31 12:34:26.020073 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 130/254] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:34:25 2022] GET /compute/v2.1/servers/6f831a26-c1a4-4518-870e-6dd64516719c => generated 1303 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 12:34:26.027651 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-c7127185-5b30-44f0-a30e-f47a1d5f4b8d tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2e978bcb824a5e9d593b861c9e3bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7573cb9c503243ab90b1649591d550e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:34:26.036490 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-c7127185-5b30-44f0-a30e-f47a1d5f4b8d tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] 10.222.0.15 "GET /compute/v2.1/servers/d0befdd2-2ecd-4006-bfdd-86d5253a7687" status: 200 len: 1522 microversion: 2.1 time: 0.152509 Oct 31 12:34:26.037052 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 125/255] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:34:25 2022] GET /compute/v2.1/servers/d0befdd2-2ecd-4006-bfdd-86d5253a7687 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:34:26.576785 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-2d14cecc-a91f-4233-afac-0f0af2d21665 tempest-VolumesSnapshotsTestJSON-540358646 tempest-VolumesSnapshotsTestJSON-540358646-project] Calling method '.version_select at 0x7f2aa5314d30>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:34:26.629053 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-2d14cecc-a91f-4233-afac-0f0af2d21665 tempest-VolumesSnapshotsTestJSON-540358646 tempest-VolumesSnapshotsTestJSON-540358646-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/199962ce-9eb5-48d2-8113-55e65e8bff48" status: 200 len: 344 microversion: 2.1 time: 0.056010 Oct 31 12:34:26.629615 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 131/256] 10.222.0.15 () {58 vars in 1245 bytes} [Mon Oct 31 12:34:26 2022] GET /compute/v2.1/os-volumes/199962ce-9eb5-48d2-8113-55e65e8bff48 => generated 344 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 12:34:27.042061 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-dd7cb7e1-7bc2-4b23-b2a0-5067f87814bc tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:34:27.042665 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-dd7cb7e1-7bc2-4b23-b2a0-5067f87814bc tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] [instance: 6f831a26-c1a4-4518-870e-6dd64516719c] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:34:27.049839 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-dd7cb7e1-7bc2-4b23-b2a0-5067f87814bc tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:34:27.050319 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-dd7cb7e1-7bc2-4b23-b2a0-5067f87814bc tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:34:27.050749 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-dd7cb7e1-7bc2-4b23-b2a0-5067f87814bc tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:34:27.051476 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-dd7cb7e1-7bc2-4b23-b2a0-5067f87814bc tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:34:27.051929 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-dd7cb7e1-7bc2-4b23-b2a0-5067f87814bc tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:34:27.052351 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-dd7cb7e1-7bc2-4b23-b2a0-5067f87814bc tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:34:27.059792 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-4bd77f3b-43ab-4a49-ad68-0f43e6bd1ca6 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:34:27.060400 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-4bd77f3b-43ab-4a49-ad68-0f43e6bd1ca6 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] [instance: d0befdd2-2ecd-4006-bfdd-86d5253a7687] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:34:27.066807 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-4bd77f3b-43ab-4a49-ad68-0f43e6bd1ca6 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:34:27.067310 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-4bd77f3b-43ab-4a49-ad68-0f43e6bd1ca6 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:34:27.067737 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-4bd77f3b-43ab-4a49-ad68-0f43e6bd1ca6 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:34:27.068422 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-4bd77f3b-43ab-4a49-ad68-0f43e6bd1ca6 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:34:27.068869 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-4bd77f3b-43ab-4a49-ad68-0f43e6bd1ca6 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:34:27.069286 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-4bd77f3b-43ab-4a49-ad68-0f43e6bd1ca6 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:34:27.084259 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-dd7cb7e1-7bc2-4b23-b2a0-5067f87814bc tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:34:27.084738 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-dd7cb7e1-7bc2-4b23-b2a0-5067f87814bc tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:34:27.085165 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-dd7cb7e1-7bc2-4b23-b2a0-5067f87814bc tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:34:27.085603 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.objects.instance [None req-dd7cb7e1-7bc2-4b23-b2a0-5067f87814bc tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Lazy-loading 'fault' on Instance uuid 6f831a26-c1a4-4518-870e-6dd64516719c {{(pid=125441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 12:34:27.128507 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-dd7cb7e1-7bc2-4b23-b2a0-5067f87814bc tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1918cb60ccd04e909b78dca9b0166be9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe4270c111747be8d61e4ae993bd7ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:34:27.139712 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-dd7cb7e1-7bc2-4b23-b2a0-5067f87814bc tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] 10.222.0.15 "GET /compute/v2.1/servers/6f831a26-c1a4-4518-870e-6dd64516719c" status: 200 len: 1303 microversion: 2.1 time: 0.101325 Oct 31 12:34:27.140729 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 126/257] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:34:27 2022] GET /compute/v2.1/servers/6f831a26-c1a4-4518-870e-6dd64516719c => generated 1303 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:34:27.210251 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-4bd77f3b-43ab-4a49-ad68-0f43e6bd1ca6 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2e978bcb824a5e9d593b861c9e3bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7573cb9c503243ab90b1649591d550e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:34:27.218202 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-4bd77f3b-43ab-4a49-ad68-0f43e6bd1ca6 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] 10.222.0.15 "GET /compute/v2.1/servers/d0befdd2-2ecd-4006-bfdd-86d5253a7687" status: 200 len: 1522 microversion: 2.1 time: 0.162327 Oct 31 12:34:27.218849 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 132/258] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:34:27 2022] GET /compute/v2.1/servers/d0befdd2-2ecd-4006-bfdd-86d5253a7687 => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 12:34:27.643986 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-1e3bfce9-d32f-492e-bbcb-09a9d7da93df tempest-VolumesSnapshotsTestJSON-540358646 tempest-VolumesSnapshotsTestJSON-540358646-project] Calling method '.version_select at 0x7f2aa5230af0>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:34:27.690168 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-1e3bfce9-d32f-492e-bbcb-09a9d7da93df tempest-VolumesSnapshotsTestJSON-540358646 tempest-VolumesSnapshotsTestJSON-540358646-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/199962ce-9eb5-48d2-8113-55e65e8bff48" status: 200 len: 344 microversion: 2.1 time: 0.050261 Oct 31 12:34:27.690771 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 127/259] 10.222.0.15 () {58 vars in 1245 bytes} [Mon Oct 31 12:34:27 2022] GET /compute/v2.1/os-volumes/199962ce-9eb5-48d2-8113-55e65e8bff48 => generated 344 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 12:34:28.164173 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-ff7e8d4e-6b58-4882-bd82-3e1971cfbe70 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:34:28.165502 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-ff7e8d4e-6b58-4882-bd82-3e1971cfbe70 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] [instance: 6f831a26-c1a4-4518-870e-6dd64516719c] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:34:28.167767 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG dbcounter [-] [125440] Writing DB stats nova_cell0:SELECT=4 {{(pid=125440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:34:28.173956 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-ff7e8d4e-6b58-4882-bd82-3e1971cfbe70 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:34:28.174459 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-ff7e8d4e-6b58-4882-bd82-3e1971cfbe70 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:34:28.174948 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-ff7e8d4e-6b58-4882-bd82-3e1971cfbe70 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:34:28.177615 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-ff7e8d4e-6b58-4882-bd82-3e1971cfbe70 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:34:28.178182 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-ff7e8d4e-6b58-4882-bd82-3e1971cfbe70 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:34:28.178700 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-ff7e8d4e-6b58-4882-bd82-3e1971cfbe70 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:34:28.194106 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.wsgi [None req-ff7e8d4e-6b58-4882-bd82-3e1971cfbe70 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] HTTP exception thrown: Instance 6f831a26-c1a4-4518-870e-6dd64516719c could not be found. Oct 31 12:34:28.195669 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-ff7e8d4e-6b58-4882-bd82-3e1971cfbe70 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Request method failure captured: Oct 31 12:34:28.195669 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: request: GET /compute/v2.1/servers/6f831a26-c1a4-4518-870e-6dd64516719c HTTP/1.1 Oct 31 12:34:28.195669 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: Accept: application/json Oct 31 12:34:28.195669 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: Accept-Encoding: identity Oct 31 12:34:28.195669 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: Connection: close Oct 31 12:34:28.195669 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: Content-Length: 0 Oct 31 12:34:28.195669 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: Content-Type: application/json Oct 31 12:34:28.195669 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: Host: 10.222.0.15 Oct 31 12:34:28.195669 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: Openstack-System-Scope: None Oct 31 12:34:28.195669 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: User-Agent: python-urllib3/1.26.12 Oct 31 12:34:28.195669 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Auth-Token: gAAAAABjX8C230UhMzq--FHcmjg5OLyci8gDh1I11iXRyqu85i5_rMSBy0krijq463RX-XrH-StDzRf-sKRZYk2G229XyMG569gM4JZ1XDCbpqzOYKLy0CGlEDx3Md4h0BziygIWuTxBE8a5IthHCXJXNctMx07zr445RhpdPn5e1uoiw6kgFcY Oct 31 12:34:28.195669 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Domain-Id: None Oct 31 12:34:28.195669 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Domain-Name: None Oct 31 12:34:28.195669 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Identity-Status: Confirmed Oct 31 12:34:28.195669 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Is-Admin-Project: True Oct 31 12:34:28.195669 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Project-Domain-Id: default Oct 31 12:34:28.195669 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Project-Domain-Name: Default Oct 31 12:34:28.195669 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Project-Id: 4fe4270c111747be8d61e4ae993bd7ba Oct 31 12:34:28.195669 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Project-Name: tempest-VolumesActionsTest-5566181 Oct 31 12:34:28.195669 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Role: reader,member Oct 31 12:34:28.195669 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Roles: reader,member Oct 31 12:34:28.196865 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/4fe4270c111747be8d61e4ae993bd7ba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_4fe4270c111747be8d61e4ae993bd7ba", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/4fe4270c111747be8d61e4ae993bd7ba"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/4fe4270c111747be8d61e4ae993bd7ba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Oct 31 12:34:28.196865 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Tenant: tempest-VolumesActionsTest-5566181 Oct 31 12:34:28.196865 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Tenant-Id: 4fe4270c111747be8d61e4ae993bd7ba Oct 31 12:34:28.196865 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Tenant-Name: tempest-VolumesActionsTest-5566181 Oct 31 12:34:28.196865 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-User: tempest-VolumesActionsTest-5566181-project Oct 31 12:34:28.196865 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-User-Domain-Id: default Oct 31 12:34:28.196865 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-User-Domain-Name: Default Oct 31 12:34:28.196865 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-User-Id: 1918cb60ccd04e909b78dca9b0166be9 Oct 31 12:34:28.196865 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-User-Name: tempest-VolumesActionsTest-5566181-project Oct 31 12:34:28.196865 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: method: > Oct 31 12:34:28.196865 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: exception: Instance 6f831a26-c1a4-4518-870e-6dd64516719c could not be found. Oct 31 12:34:28.196865 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: action_args: {'id': '6f831a26-c1a4-4518-870e-6dd64516719c'} Oct 31 12:34:28.197536 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 12:34:28.197536 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 12:34:28.197536 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 12:34:28.197536 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 12:34:28.197536 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 12:34:28.197536 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 12:34:28.197536 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 12:34:28.197536 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 12:34:28.197536 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 12:34:28.197536 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 12:34:28.197536 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f831a26-c1a4-4518-870e-6dd64516719c could not be found. Oct 31 12:34:28.197536 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Oct 31 12:34:28.197536 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 12:34:28.197536 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Oct 31 12:34:28.197536 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 12:34:28.197536 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 12:34:28.197536 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 12:34:28.197536 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 12:34:28.197536 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 12:34:28.197536 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 12:34:28.198580 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 12:34:28.198580 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 12:34:28.198580 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 12:34:28.198580 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 12:34:28.198580 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 12:34:28.198580 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 12:34:28.198580 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 12:34:28.198580 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f831a26-c1a4-4518-870e-6dd64516719c could not be found. Oct 31 12:34:28.198580 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Oct 31 12:34:28.198580 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 12:34:28.198580 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Oct 31 12:34:28.198580 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 12:34:28.198580 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 12:34:28.198580 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 12:34:28.198580 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 12:34:28.198580 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 12:34:28.198580 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f831a26-c1a4-4518-870e-6dd64516719c could not be found. Oct 31 12:34:28.198580 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Oct 31 12:34:28.200550 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-ff7e8d4e-6b58-4882-bd82-3e1971cfbe70 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Returning 404 to user: Instance 6f831a26-c1a4-4518-870e-6dd64516719c could not be found. {{(pid=125440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 12:34:28.201429 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-ff7e8d4e-6b58-4882-bd82-3e1971cfbe70 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] 10.222.0.15 "GET /compute/v2.1/servers/6f831a26-c1a4-4518-870e-6dd64516719c" status: 404 len: 111 microversion: 2.1 time: 0.041834 Oct 31 12:34:28.202096 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 133/260] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:34:28 2022] GET /compute/v2.1/servers/6f831a26-c1a4-4518-870e-6dd64516719c => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 12:34:28.242480 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-cc5b6d99-7884-4aba-b7eb-6595da1ce987 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:34:28.243100 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-cc5b6d99-7884-4aba-b7eb-6595da1ce987 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] [instance: d0befdd2-2ecd-4006-bfdd-86d5253a7687] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:34:28.249958 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-cc5b6d99-7884-4aba-b7eb-6595da1ce987 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:34:28.250440 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-cc5b6d99-7884-4aba-b7eb-6595da1ce987 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:34:28.250869 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-cc5b6d99-7884-4aba-b7eb-6595da1ce987 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:34:28.251995 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-cc5b6d99-7884-4aba-b7eb-6595da1ce987 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:34:28.252378 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-cc5b6d99-7884-4aba-b7eb-6595da1ce987 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:34:28.252802 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-cc5b6d99-7884-4aba-b7eb-6595da1ce987 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:34:28.322185 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-30b52986-2616-4239-8332-89c31cd21ef1 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-2078850254", "imageRef": "fbbea321-8f0d-4092-b070-b67a6931d610", "flavorRef": "452", "networks": [{"uuid": "73b5b0af-fcc7-400d-b4a0-01ab3625769f"}]}} {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 12:34:28.385778 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.network.neutron [None req-30b52986-2616-4239-8332-89c31cd21ef1 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] validate_networks() for [('73b5b0af-fcc7-400d-b4a0-01ab3625769f', None, None, None, None, None)] {{(pid=125440) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 12:34:28.418792 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-cc5b6d99-7884-4aba-b7eb-6595da1ce987 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2e978bcb824a5e9d593b861c9e3bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7573cb9c503243ab90b1649591d550e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:34:28.427822 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-cc5b6d99-7884-4aba-b7eb-6595da1ce987 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] 10.222.0.15 "GET /compute/v2.1/servers/d0befdd2-2ecd-4006-bfdd-86d5253a7687" status: 200 len: 1522 microversion: 2.1 time: 0.189587 Oct 31 12:34:28.428396 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 128/261] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:34:28 2022] GET /compute/v2.1/servers/d0befdd2-2ecd-4006-bfdd-86d5253a7687 => generated 1522 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:34:28.704898 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-383de472-1a77-4949-925c-aecd4e97e279 tempest-VolumesSnapshotsTestJSON-540358646 tempest-VolumesSnapshotsTestJSON-540358646-project] Calling method '.version_select at 0x7f2aa5225820>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:34:28.732925 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.wsgi [None req-383de472-1a77-4949-925c-aecd4e97e279 tempest-VolumesSnapshotsTestJSON-540358646 tempest-VolumesSnapshotsTestJSON-540358646-project] HTTP exception thrown: Volume 199962ce-9eb5-48d2-8113-55e65e8bff48 could not be found. Oct 31 12:34:28.735004 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-383de472-1a77-4949-925c-aecd4e97e279 tempest-VolumesSnapshotsTestJSON-540358646 tempest-VolumesSnapshotsTestJSON-540358646-project] Request method failure captured: Oct 31 12:34:28.735004 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: request: GET /compute/v2.1/os-volumes/199962ce-9eb5-48d2-8113-55e65e8bff48 HTTP/1.1 Oct 31 12:34:28.735004 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: Accept: application/json Oct 31 12:34:28.735004 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: Accept-Encoding: identity Oct 31 12:34:28.735004 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: Connection: close Oct 31 12:34:28.735004 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: Content-Length: 0 Oct 31 12:34:28.735004 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: Content-Type: application/json Oct 31 12:34:28.735004 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: Host: 10.222.0.15 Oct 31 12:34:28.735004 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: Openstack-System-Scope: None Oct 31 12:34:28.735004 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: User-Agent: python-urllib3/1.26.12 Oct 31 12:34:28.735004 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Auth-Token: gAAAAABjX8DGcKJm-XbGwSg2X56qfJUc_95XYG_WDtZ83_P-17EzNW40vb8CEgbNg3Lvw5nU8P72SlRiKwsodNDQRbkLnjKxETbhrQkLtZi54b3jb5iFVBGIsR-8zJ4UtUqp-RRgW8yMm311VGnAHDWm7mzXHLRbH_jSxVq7fmm6n7IksJa3mJo Oct 31 12:34:28.735004 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Domain-Id: None Oct 31 12:34:28.735004 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Domain-Name: None Oct 31 12:34:28.735004 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Identity-Status: Confirmed Oct 31 12:34:28.735004 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Is-Admin-Project: True Oct 31 12:34:28.735004 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Project-Domain-Id: default Oct 31 12:34:28.735004 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Project-Domain-Name: Default Oct 31 12:34:28.735004 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Project-Id: 44205e3c7d864276bb80d9b5a59d266b Oct 31 12:34:28.735004 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-540358646 Oct 31 12:34:28.735004 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Role: reader,member Oct 31 12:34:28.735004 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Roles: reader,member Oct 31 12:34:28.737169 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/44205e3c7d864276bb80d9b5a59d266b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_44205e3c7d864276bb80d9b5a59d266b", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/44205e3c7d864276bb80d9b5a59d266b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/44205e3c7d864276bb80d9b5a59d266b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Oct 31 12:34:28.737169 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Tenant: tempest-VolumesSnapshotsTestJSON-540358646 Oct 31 12:34:28.737169 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Tenant-Id: 44205e3c7d864276bb80d9b5a59d266b Oct 31 12:34:28.737169 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-540358646 Oct 31 12:34:28.737169 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-User: tempest-VolumesSnapshotsTestJSON-540358646-project Oct 31 12:34:28.737169 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-User-Domain-Id: default Oct 31 12:34:28.737169 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-User-Domain-Name: Default Oct 31 12:34:28.737169 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-User-Id: 03b31c6585714f0187a06fd433be18ad Oct 31 12:34:28.737169 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-User-Name: tempest-VolumesSnapshotsTestJSON-540358646-project Oct 31 12:34:28.737169 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: method: Oct 31 12:34:28.737169 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: exception: Volume 199962ce-9eb5-48d2-8113-55e65e8bff48 could not be found. Oct 31 12:34:28.737169 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: action_args: {'id': '199962ce-9eb5-48d2-8113-55e65e8bff48'} Oct 31 12:34:28.737169 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 12:34:28.738249 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 12:34:28.738249 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 31 12:34:28.738249 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 31 12:34:28.738249 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 31 12:34:28.738249 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 31 12:34:28.738249 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 31 12:34:28.738249 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 31 12:34:28.738249 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 31 12:34:28.738249 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 31 12:34:28.738249 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 31 12:34:28.738249 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 31 12:34:28.738249 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 31 12:34:28.738249 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 31 12:34:28.738249 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 31 12:34:28.738249 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 31 12:34:28.738249 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 199962ce-9eb5-48d2-8113-55e65e8bff48 could not be found. (HTTP 404) (Request-ID: req-9bd5bf0b-0fa6-494b-90f3-2e5492160564) Oct 31 12:34:28.738249 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Oct 31 12:34:28.738249 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 12:34:28.738249 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Oct 31 12:34:28.739524 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 12:34:28.739524 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 31 12:34:28.739524 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 31 12:34:28.739524 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 31 12:34:28.739524 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 31 12:34:28.739524 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 31 12:34:28.739524 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 31 12:34:28.739524 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 31 12:34:28.739524 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 31 12:34:28.739524 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 31 12:34:28.739524 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 31 12:34:28.739524 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 31 12:34:28.739524 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 31 12:34:28.739524 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 31 12:34:28.739524 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 31 12:34:28.739524 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 31 12:34:28.739524 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 31 12:34:28.739524 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 31 12:34:28.739524 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 31 12:34:28.740753 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 31 12:34:28.740753 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 31 12:34:28.740753 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 31 12:34:28.740753 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 31 12:34:28.740753 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 199962ce-9eb5-48d2-8113-55e65e8bff48 could not be found. Oct 31 12:34:28.740753 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Oct 31 12:34:28.740753 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 12:34:28.740753 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Oct 31 12:34:28.740753 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 12:34:28.740753 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 12:34:28.740753 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 12:34:28.740753 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 12:34:28.740753 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 12:34:28.740753 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 12:34:28.740753 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 12:34:28.740753 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 12:34:28.740753 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 12:34:28.740753 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 31 12:34:28.740753 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 12:34:28.742053 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 199962ce-9eb5-48d2-8113-55e65e8bff48 could not be found. Oct 31 12:34:28.742053 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Oct 31 12:34:28.742053 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 12:34:28.742053 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Oct 31 12:34:28.742053 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 12:34:28.742053 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 12:34:28.742053 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 12:34:28.742053 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 12:34:28.742053 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 12:34:28.742053 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 199962ce-9eb5-48d2-8113-55e65e8bff48 could not be found. Oct 31 12:34:28.742053 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Oct 31 12:34:28.742053 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-383de472-1a77-4949-925c-aecd4e97e279 tempest-VolumesSnapshotsTestJSON-540358646 tempest-VolumesSnapshotsTestJSON-540358646-project] Returning 404 to user: Volume 199962ce-9eb5-48d2-8113-55e65e8bff48 could not be found. {{(pid=125441) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 12:34:28.742053 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-383de472-1a77-4949-925c-aecd4e97e279 tempest-VolumesSnapshotsTestJSON-540358646 tempest-VolumesSnapshotsTestJSON-540358646-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/199962ce-9eb5-48d2-8113-55e65e8bff48" status: 404 len: 109 microversion: 2.1 time: 0.036161 Oct 31 12:34:28.742053 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 129/262] 10.222.0.15 () {58 vars in 1245 bytes} [Mon Oct 31 12:34:28 2022] GET /compute/v2.1/os-volumes/199962ce-9eb5-48d2-8113-55e65e8bff48 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 31 12:34:28.745020 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.virt.hardware [None req-30b52986-2616-4239-8332-89c31cd21ef1 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Flavor limits 0:0:0 {{(pid=125440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 12:34:28.745438 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.virt.hardware [None req-30b52986-2616-4239-8332-89c31cd21ef1 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Image limits 0:0:0 {{(pid=125440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 12:34:28.745905 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.virt.hardware [None req-30b52986-2616-4239-8332-89c31cd21ef1 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Flavor pref 0:0:0 {{(pid=125440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 12:34:28.746376 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.virt.hardware [None req-30b52986-2616-4239-8332-89c31cd21ef1 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Image pref 0:0:0 {{(pid=125440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 12:34:28.746744 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.virt.hardware [None req-30b52986-2616-4239-8332-89c31cd21ef1 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 12:34:28.751703 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-0f63381e-6632-4321-9361-2bd41f9e7cf8 tempest-VolumesSnapshotsTestJSON-540358646 tempest-VolumesSnapshotsTestJSON-540358646-project] Calling method '.version_select at 0x7f2aa52308b0>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:34:28.756328 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-30b52986-2616-4239-8332-89c31cd21ef1 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:34:28.757089 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-30b52986-2616-4239-8332-89c31cd21ef1 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:34:28.757529 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-30b52986-2616-4239-8332-89c31cd21ef1 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:34:28.758249 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-30b52986-2616-4239-8332-89c31cd21ef1 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:34:28.759115 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-30b52986-2616-4239-8332-89c31cd21ef1 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:34:28.759619 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-30b52986-2616-4239-8332-89c31cd21ef1 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:34:28.778452 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.quota [None req-30b52986-2616-4239-8332-89c31cd21ef1 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Getting quotas for project 4fe4270c111747be8d61e4ae993bd7ba. Resources: {'instances', 'cores', 'ram'} {{(pid=125440) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 12:34:28.782894 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.quota [None req-30b52986-2616-4239-8332-89c31cd21ef1 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Getting quotas for user 1918cb60ccd04e909b78dca9b0166be9 and project 4fe4270c111747be8d61e4ae993bd7ba. Resources: {'instances', 'cores', 'ram'} {{(pid=125440) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 12:34:28.785895 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.wsgi [None req-0f63381e-6632-4321-9361-2bd41f9e7cf8 tempest-VolumesSnapshotsTestJSON-540358646 tempest-VolumesSnapshotsTestJSON-540358646-project] HTTP exception thrown: Volume 199962ce-9eb5-48d2-8113-55e65e8bff48 could not be found. Oct 31 12:34:28.787942 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-0f63381e-6632-4321-9361-2bd41f9e7cf8 tempest-VolumesSnapshotsTestJSON-540358646 tempest-VolumesSnapshotsTestJSON-540358646-project] Request method failure captured: Oct 31 12:34:28.787942 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: request: DELETE /compute/v2.1/os-volumes/199962ce-9eb5-48d2-8113-55e65e8bff48 HTTP/1.1 Oct 31 12:34:28.787942 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: Accept: application/json Oct 31 12:34:28.787942 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: Accept-Encoding: identity Oct 31 12:34:28.787942 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: Connection: close Oct 31 12:34:28.787942 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: Content-Length: 0 Oct 31 12:34:28.787942 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: Content-Type: application/json Oct 31 12:34:28.787942 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: Host: 10.222.0.15 Oct 31 12:34:28.787942 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: Openstack-System-Scope: None Oct 31 12:34:28.787942 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: User-Agent: python-urllib3/1.26.12 Oct 31 12:34:28.787942 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Auth-Token: gAAAAABjX8DGcKJm-XbGwSg2X56qfJUc_95XYG_WDtZ83_P-17EzNW40vb8CEgbNg3Lvw5nU8P72SlRiKwsodNDQRbkLnjKxETbhrQkLtZi54b3jb5iFVBGIsR-8zJ4UtUqp-RRgW8yMm311VGnAHDWm7mzXHLRbH_jSxVq7fmm6n7IksJa3mJo Oct 31 12:34:28.787942 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Domain-Id: None Oct 31 12:34:28.787942 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Domain-Name: None Oct 31 12:34:28.787942 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Identity-Status: Confirmed Oct 31 12:34:28.787942 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Is-Admin-Project: True Oct 31 12:34:28.787942 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Project-Domain-Id: default Oct 31 12:34:28.787942 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Project-Domain-Name: Default Oct 31 12:34:28.787942 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Project-Id: 44205e3c7d864276bb80d9b5a59d266b Oct 31 12:34:28.787942 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-540358646 Oct 31 12:34:28.787942 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Role: reader,member Oct 31 12:34:28.787942 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Roles: reader,member Oct 31 12:34:28.789439 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/44205e3c7d864276bb80d9b5a59d266b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_44205e3c7d864276bb80d9b5a59d266b", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/44205e3c7d864276bb80d9b5a59d266b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/44205e3c7d864276bb80d9b5a59d266b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Oct 31 12:34:28.789439 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Tenant: tempest-VolumesSnapshotsTestJSON-540358646 Oct 31 12:34:28.789439 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Tenant-Id: 44205e3c7d864276bb80d9b5a59d266b Oct 31 12:34:28.789439 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-540358646 Oct 31 12:34:28.789439 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-User: tempest-VolumesSnapshotsTestJSON-540358646-project Oct 31 12:34:28.789439 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-User-Domain-Id: default Oct 31 12:34:28.789439 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-User-Domain-Name: Default Oct 31 12:34:28.789439 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-User-Id: 03b31c6585714f0187a06fd433be18ad Oct 31 12:34:28.789439 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-User-Name: tempest-VolumesSnapshotsTestJSON-540358646-project Oct 31 12:34:28.789439 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: method: Oct 31 12:34:28.789439 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: exception: Volume 199962ce-9eb5-48d2-8113-55e65e8bff48 could not be found. Oct 31 12:34:28.789439 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: action_args: {'id': '199962ce-9eb5-48d2-8113-55e65e8bff48'} Oct 31 12:34:28.789439 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 12:34:28.790317 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 12:34:28.790317 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 31 12:34:28.790317 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 31 12:34:28.790317 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 31 12:34:28.790317 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 31 12:34:28.790317 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 31 12:34:28.790317 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 31 12:34:28.790317 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 31 12:34:28.790317 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 31 12:34:28.790317 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 31 12:34:28.790317 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 31 12:34:28.790317 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 31 12:34:28.790317 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 31 12:34:28.790317 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 31 12:34:28.790317 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 31 12:34:28.790317 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 199962ce-9eb5-48d2-8113-55e65e8bff48 could not be found. (HTTP 404) (Request-ID: req-8540d4bd-729c-4e09-9ba1-6a107a0806de) Oct 31 12:34:28.790317 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Oct 31 12:34:28.790317 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 12:34:28.790317 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Oct 31 12:34:28.791645 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 12:34:28.791645 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 31 12:34:28.791645 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 31 12:34:28.791645 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 31 12:34:28.791645 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 31 12:34:28.791645 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 31 12:34:28.791645 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 31 12:34:28.791645 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 31 12:34:28.791645 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 31 12:34:28.791645 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 31 12:34:28.791645 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 31 12:34:28.791645 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 31 12:34:28.791645 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 31 12:34:28.791645 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 31 12:34:28.791645 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 31 12:34:28.791645 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 31 12:34:28.791645 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 31 12:34:28.791645 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 31 12:34:28.791645 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 31 12:34:28.792879 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 31 12:34:28.792879 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 31 12:34:28.792879 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 31 12:34:28.792879 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 31 12:34:28.792879 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 199962ce-9eb5-48d2-8113-55e65e8bff48 could not be found. Oct 31 12:34:28.792879 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Oct 31 12:34:28.792879 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 12:34:28.792879 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Oct 31 12:34:28.792879 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 12:34:28.792879 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 12:34:28.792879 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 12:34:28.792879 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 12:34:28.792879 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 12:34:28.792879 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 12:34:28.792879 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 12:34:28.792879 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 12:34:28.792879 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 12:34:28.792879 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 31 12:34:28.792879 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 12:34:28.794079 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 199962ce-9eb5-48d2-8113-55e65e8bff48 could not be found. Oct 31 12:34:28.794079 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Oct 31 12:34:28.794079 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 12:34:28.794079 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Oct 31 12:34:28.794079 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 12:34:28.794079 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 12:34:28.794079 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 12:34:28.794079 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 12:34:28.794079 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 12:34:28.794079 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 199962ce-9eb5-48d2-8113-55e65e8bff48 could not be found. Oct 31 12:34:28.794079 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Oct 31 12:34:28.794079 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-0f63381e-6632-4321-9361-2bd41f9e7cf8 tempest-VolumesSnapshotsTestJSON-540358646 tempest-VolumesSnapshotsTestJSON-540358646-project] Returning 404 to user: Volume 199962ce-9eb5-48d2-8113-55e65e8bff48 could not be found. {{(pid=125441) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 12:34:28.794079 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-0f63381e-6632-4321-9361-2bd41f9e7cf8 tempest-VolumesSnapshotsTestJSON-540358646 tempest-VolumesSnapshotsTestJSON-540358646-project] 10.222.0.15 "DELETE /compute/v2.1/os-volumes/199962ce-9eb5-48d2-8113-55e65e8bff48" status: 404 len: 109 microversion: 2.1 time: 0.041621 Oct 31 12:34:28.794079 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 130/263] 10.222.0.15 () {58 vars in 1248 bytes} [Mon Oct 31 12:34:28 2022] DELETE /compute/v2.1/os-volumes/199962ce-9eb5-48d2-8113-55e65e8bff48 => generated 109 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 31 12:34:28.795019 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-30b52986-2616-4239-8332-89c31cd21ef1 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Going to run 1 instances... {{(pid=125440) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 12:34:28.796991 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-30b52986-2616-4239-8332-89c31cd21ef1 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] [instance: 8174a16d-3e74-4ec2-82be-deb8d294255b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fbbea321-8f0d-4092-b070-b67a6931d610',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125440) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 12:34:28.798567 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-3637a77d-7bdd-445a-ac5a-ab51d74ee534 tempest-VolumesSnapshotsTestJSON-540358646 tempest-VolumesSnapshotsTestJSON-540358646-project] Calling method '.version_select at 0x7f2aa54e9310>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:34:28.827413 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.wsgi [None req-3637a77d-7bdd-445a-ac5a-ab51d74ee534 tempest-VolumesSnapshotsTestJSON-540358646 tempest-VolumesSnapshotsTestJSON-540358646-project] HTTP exception thrown: Volume 199962ce-9eb5-48d2-8113-55e65e8bff48 could not be found. Oct 31 12:34:28.829475 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-3637a77d-7bdd-445a-ac5a-ab51d74ee534 tempest-VolumesSnapshotsTestJSON-540358646 tempest-VolumesSnapshotsTestJSON-540358646-project] Request method failure captured: Oct 31 12:34:28.829475 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: request: GET /compute/v2.1/os-volumes/199962ce-9eb5-48d2-8113-55e65e8bff48 HTTP/1.1 Oct 31 12:34:28.829475 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: Accept: application/json Oct 31 12:34:28.829475 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: Accept-Encoding: identity Oct 31 12:34:28.829475 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: Connection: close Oct 31 12:34:28.829475 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: Content-Length: 0 Oct 31 12:34:28.829475 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: Content-Type: application/json Oct 31 12:34:28.829475 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: Host: 10.222.0.15 Oct 31 12:34:28.829475 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: Openstack-System-Scope: None Oct 31 12:34:28.829475 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: User-Agent: python-urllib3/1.26.12 Oct 31 12:34:28.829475 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Auth-Token: gAAAAABjX8DGcKJm-XbGwSg2X56qfJUc_95XYG_WDtZ83_P-17EzNW40vb8CEgbNg3Lvw5nU8P72SlRiKwsodNDQRbkLnjKxETbhrQkLtZi54b3jb5iFVBGIsR-8zJ4UtUqp-RRgW8yMm311VGnAHDWm7mzXHLRbH_jSxVq7fmm6n7IksJa3mJo Oct 31 12:34:28.829475 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Domain-Id: None Oct 31 12:34:28.829475 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Domain-Name: None Oct 31 12:34:28.829475 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Identity-Status: Confirmed Oct 31 12:34:28.829475 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Is-Admin-Project: True Oct 31 12:34:28.829475 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Project-Domain-Id: default Oct 31 12:34:28.829475 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Project-Domain-Name: Default Oct 31 12:34:28.829475 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Project-Id: 44205e3c7d864276bb80d9b5a59d266b Oct 31 12:34:28.829475 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-540358646 Oct 31 12:34:28.829475 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Role: reader,member Oct 31 12:34:28.829475 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Roles: reader,member Oct 31 12:34:28.830897 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/44205e3c7d864276bb80d9b5a59d266b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_44205e3c7d864276bb80d9b5a59d266b", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/44205e3c7d864276bb80d9b5a59d266b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/44205e3c7d864276bb80d9b5a59d266b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Oct 31 12:34:28.830897 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Tenant: tempest-VolumesSnapshotsTestJSON-540358646 Oct 31 12:34:28.830897 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Tenant-Id: 44205e3c7d864276bb80d9b5a59d266b Oct 31 12:34:28.830897 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-540358646 Oct 31 12:34:28.830897 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-User: tempest-VolumesSnapshotsTestJSON-540358646-project Oct 31 12:34:28.830897 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-User-Domain-Id: default Oct 31 12:34:28.830897 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-User-Domain-Name: Default Oct 31 12:34:28.830897 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-User-Id: 03b31c6585714f0187a06fd433be18ad Oct 31 12:34:28.830897 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-User-Name: tempest-VolumesSnapshotsTestJSON-540358646-project Oct 31 12:34:28.830897 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: method: Oct 31 12:34:28.830897 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: exception: Volume 199962ce-9eb5-48d2-8113-55e65e8bff48 could not be found. Oct 31 12:34:28.830897 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: action_args: {'id': '199962ce-9eb5-48d2-8113-55e65e8bff48'} Oct 31 12:34:28.830897 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 12:34:28.831809 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 12:34:28.831809 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 31 12:34:28.831809 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 31 12:34:28.831809 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 31 12:34:28.831809 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 31 12:34:28.831809 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 31 12:34:28.831809 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 31 12:34:28.831809 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 31 12:34:28.831809 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 31 12:34:28.831809 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 31 12:34:28.831809 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 31 12:34:28.831809 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 31 12:34:28.831809 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 31 12:34:28.831809 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 31 12:34:28.831809 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 31 12:34:28.831809 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 199962ce-9eb5-48d2-8113-55e65e8bff48 could not be found. (HTTP 404) (Request-ID: req-50ea3db1-3b8f-4f07-a13e-d6a73c1c40c2) Oct 31 12:34:28.831809 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Oct 31 12:34:28.831809 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 12:34:28.831809 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Oct 31 12:34:28.832842 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 12:34:28.832842 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 31 12:34:28.832842 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 31 12:34:28.832842 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 31 12:34:28.832842 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 31 12:34:28.832842 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 31 12:34:28.832842 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 31 12:34:28.832842 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 31 12:34:28.832842 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 31 12:34:28.832842 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 31 12:34:28.832842 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 31 12:34:28.832842 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 31 12:34:28.832842 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 31 12:34:28.832842 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 31 12:34:28.832842 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 31 12:34:28.832842 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 31 12:34:28.832842 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 31 12:34:28.832842 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 31 12:34:28.832842 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 31 12:34:28.833826 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 31 12:34:28.833826 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 31 12:34:28.833826 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 31 12:34:28.833826 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 31 12:34:28.833826 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 199962ce-9eb5-48d2-8113-55e65e8bff48 could not be found. Oct 31 12:34:28.833826 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Oct 31 12:34:28.833826 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 12:34:28.833826 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Oct 31 12:34:28.833826 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 12:34:28.833826 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 12:34:28.833826 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 12:34:28.833826 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 12:34:28.833826 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 12:34:28.833826 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 12:34:28.833826 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 12:34:28.833826 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 12:34:28.833826 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 12:34:28.833826 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 31 12:34:28.833826 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 12:34:28.835723 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 199962ce-9eb5-48d2-8113-55e65e8bff48 could not be found. Oct 31 12:34:28.835723 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Oct 31 12:34:28.835723 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 12:34:28.835723 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Oct 31 12:34:28.835723 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 12:34:28.835723 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 12:34:28.835723 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 12:34:28.835723 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 12:34:28.835723 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 12:34:28.835723 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 199962ce-9eb5-48d2-8113-55e65e8bff48 could not be found. Oct 31 12:34:28.835723 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Oct 31 12:34:28.835723 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-3637a77d-7bdd-445a-ac5a-ab51d74ee534 tempest-VolumesSnapshotsTestJSON-540358646 tempest-VolumesSnapshotsTestJSON-540358646-project] Returning 404 to user: Volume 199962ce-9eb5-48d2-8113-55e65e8bff48 could not be found. {{(pid=125441) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 12:34:28.835723 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-3637a77d-7bdd-445a-ac5a-ab51d74ee534 tempest-VolumesSnapshotsTestJSON-540358646 tempest-VolumesSnapshotsTestJSON-540358646-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/199962ce-9eb5-48d2-8113-55e65e8bff48" status: 404 len: 109 microversion: 2.1 time: 0.036690 Oct 31 12:34:28.835723 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 131/264] 10.222.0.15 () {58 vars in 1245 bytes} [Mon Oct 31 12:34:28 2022] GET /compute/v2.1/os-volumes/199962ce-9eb5-48d2-8113-55e65e8bff48 => generated 109 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 12:34:28.845461 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-30b52986-2616-4239-8332-89c31cd21ef1 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.526819 Oct 31 12:34:28.852217 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 134/265] 10.222.0.15 () {60 vars in 1147 bytes} [Mon Oct 31 12:34:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 535 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 12:34:28.857801 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-936fe729-fe3f-4b2a-8789-70ed615bafa4 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:34:28.858417 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-936fe729-fe3f-4b2a-8789-70ed615bafa4 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] [instance: 8174a16d-3e74-4ec2-82be-deb8d294255b] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:34:28.935037 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-936fe729-fe3f-4b2a-8789-70ed615bafa4 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1918cb60ccd04e909b78dca9b0166be9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe4270c111747be8d61e4ae993bd7ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:34:28.953172 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-936fe729-fe3f-4b2a-8789-70ed615bafa4 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] 10.222.0.15 "GET /compute/v2.1/servers/8174a16d-3e74-4ec2-82be-deb8d294255b" status: 200 len: 1214 microversion: 2.1 time: 0.099770 Oct 31 12:34:28.955445 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 132/266] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:34:28 2022] GET /compute/v2.1/servers/8174a16d-3e74-4ec2-82be-deb8d294255b => generated 1214 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:34:29.453136 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-53114969-17b6-4fe7-adf1-48fff76cc0cd tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:34:29.453976 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-53114969-17b6-4fe7-adf1-48fff76cc0cd tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] [instance: d0befdd2-2ecd-4006-bfdd-86d5253a7687] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:34:29.462456 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-53114969-17b6-4fe7-adf1-48fff76cc0cd tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:34:29.463193 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-53114969-17b6-4fe7-adf1-48fff76cc0cd tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:34:29.463814 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-53114969-17b6-4fe7-adf1-48fff76cc0cd tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:34:29.465031 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-53114969-17b6-4fe7-adf1-48fff76cc0cd tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:34:29.465869 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-53114969-17b6-4fe7-adf1-48fff76cc0cd tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:34:29.467015 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-53114969-17b6-4fe7-adf1-48fff76cc0cd tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:34:29.646346 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-53114969-17b6-4fe7-adf1-48fff76cc0cd tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2e978bcb824a5e9d593b861c9e3bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7573cb9c503243ab90b1649591d550e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:34:29.660118 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-53114969-17b6-4fe7-adf1-48fff76cc0cd tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] 10.222.0.15 "GET /compute/v2.1/servers/d0befdd2-2ecd-4006-bfdd-86d5253a7687" status: 200 len: 1522 microversion: 2.1 time: 0.209945 Oct 31 12:34:29.660727 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 135/267] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:34:29 2022] GET /compute/v2.1/servers/d0befdd2-2ecd-4006-bfdd-86d5253a7687 => generated 1522 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:34:29.978396 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-bc1c91fd-ce0d-41f8-96f2-7af80d45bac4 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:34:29.979003 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-bc1c91fd-ce0d-41f8-96f2-7af80d45bac4 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] [instance: 8174a16d-3e74-4ec2-82be-deb8d294255b] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:34:29.986847 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-bc1c91fd-ce0d-41f8-96f2-7af80d45bac4 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:34:29.987359 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-bc1c91fd-ce0d-41f8-96f2-7af80d45bac4 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:34:29.987785 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-bc1c91fd-ce0d-41f8-96f2-7af80d45bac4 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:34:29.988484 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-bc1c91fd-ce0d-41f8-96f2-7af80d45bac4 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:34:29.988930 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-bc1c91fd-ce0d-41f8-96f2-7af80d45bac4 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:34:29.989343 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-bc1c91fd-ce0d-41f8-96f2-7af80d45bac4 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:34:30.055814 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-bc1c91fd-ce0d-41f8-96f2-7af80d45bac4 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1918cb60ccd04e909b78dca9b0166be9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe4270c111747be8d61e4ae993bd7ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:34:30.065556 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-bc1c91fd-ce0d-41f8-96f2-7af80d45bac4 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] 10.222.0.15 "GET /compute/v2.1/servers/8174a16d-3e74-4ec2-82be-deb8d294255b" status: 200 len: 1266 microversion: 2.1 time: 0.091185 Oct 31 12:34:30.066132 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 133/268] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:34:29 2022] GET /compute/v2.1/servers/8174a16d-3e74-4ec2-82be-deb8d294255b => generated 1266 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:34:30.684186 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-ebe69e20-257d-40ab-8fd2-acc36c3d3a3c tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:34:30.684805 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-ebe69e20-257d-40ab-8fd2-acc36c3d3a3c tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] [instance: d0befdd2-2ecd-4006-bfdd-86d5253a7687] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:34:30.691602 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-ebe69e20-257d-40ab-8fd2-acc36c3d3a3c tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:34:30.692089 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-ebe69e20-257d-40ab-8fd2-acc36c3d3a3c tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:34:30.692519 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-ebe69e20-257d-40ab-8fd2-acc36c3d3a3c tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:34:30.693758 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-ebe69e20-257d-40ab-8fd2-acc36c3d3a3c tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:34:30.694224 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-ebe69e20-257d-40ab-8fd2-acc36c3d3a3c tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:34:30.695151 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-ebe69e20-257d-40ab-8fd2-acc36c3d3a3c tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:34:30.918220 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-ebe69e20-257d-40ab-8fd2-acc36c3d3a3c tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2e978bcb824a5e9d593b861c9e3bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7573cb9c503243ab90b1649591d550e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:34:30.931729 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-ebe69e20-257d-40ab-8fd2-acc36c3d3a3c tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] 10.222.0.15 "GET /compute/v2.1/servers/d0befdd2-2ecd-4006-bfdd-86d5253a7687" status: 200 len: 1522 microversion: 2.1 time: 0.251868 Oct 31 12:34:30.932471 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 136/269] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:34:30 2022] GET /compute/v2.1/servers/d0befdd2-2ecd-4006-bfdd-86d5253a7687 => generated 1522 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:34:31.091373 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-a62d85eb-5fa8-41f7-84e9-1c33375a9ae8 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:34:31.092343 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-a62d85eb-5fa8-41f7-84e9-1c33375a9ae8 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] [instance: 8174a16d-3e74-4ec2-82be-deb8d294255b] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:34:31.099371 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-a62d85eb-5fa8-41f7-84e9-1c33375a9ae8 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:34:31.099927 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-a62d85eb-5fa8-41f7-84e9-1c33375a9ae8 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:34:31.100424 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-a62d85eb-5fa8-41f7-84e9-1c33375a9ae8 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:34:31.101367 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-a62d85eb-5fa8-41f7-84e9-1c33375a9ae8 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:34:31.102032 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-a62d85eb-5fa8-41f7-84e9-1c33375a9ae8 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:34:31.102648 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-a62d85eb-5fa8-41f7-84e9-1c33375a9ae8 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:34:31.264139 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-a62d85eb-5fa8-41f7-84e9-1c33375a9ae8 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1918cb60ccd04e909b78dca9b0166be9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe4270c111747be8d61e4ae993bd7ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:34:31.272840 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-a62d85eb-5fa8-41f7-84e9-1c33375a9ae8 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] 10.222.0.15 "GET /compute/v2.1/servers/8174a16d-3e74-4ec2-82be-deb8d294255b" status: 200 len: 1314 microversion: 2.1 time: 0.185460 Oct 31 12:34:31.273405 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 134/270] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:34:31 2022] GET /compute/v2.1/servers/8174a16d-3e74-4ec2-82be-deb8d294255b => generated 1314 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:34:31.955686 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-ac842bce-97c9-4e41-a6e3-7aac2b88464e tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:34:31.956323 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-ac842bce-97c9-4e41-a6e3-7aac2b88464e tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] [instance: d0befdd2-2ecd-4006-bfdd-86d5253a7687] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:34:31.965766 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [req-e047e671-640c-49eb-ba0b-1a615b72a15a req-f13bd895-bad9-41bc-8773-b9e8cc374c69 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8174a16d-3e74-4ec2-82be-deb8d294255b", "tag": "c7e97cf1-bc67-4517-9260-8c9de5713308"}]} {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 12:34:31.975850 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-ac842bce-97c9-4e41-a6e3-7aac2b88464e tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:34:31.978990 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-ac842bce-97c9-4e41-a6e3-7aac2b88464e tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:34:31.979780 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-ac842bce-97c9-4e41-a6e3-7aac2b88464e tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:34:31.980488 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-ac842bce-97c9-4e41-a6e3-7aac2b88464e tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:34:31.980935 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-ac842bce-97c9-4e41-a6e3-7aac2b88464e tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:34:31.981351 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-ac842bce-97c9-4e41-a6e3-7aac2b88464e tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:34:31.988050 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [req-e047e671-640c-49eb-ba0b-1a615b72a15a req-f13bd895-bad9-41bc-8773-b9e8cc374c69 service nova] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:34:31.988530 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [req-e047e671-640c-49eb-ba0b-1a615b72a15a req-f13bd895-bad9-41bc-8773-b9e8cc374c69 service nova] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:34:31.988951 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [req-e047e671-640c-49eb-ba0b-1a615b72a15a req-f13bd895-bad9-41bc-8773-b9e8cc374c69 service nova] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:34:32.007796 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.compute.server_external_events [req-e047e671-640c-49eb-ba0b-1a615b72a15a req-f13bd895-bad9-41bc-8773-b9e8cc374c69 service nova] Creating event network-changed:c7e97cf1-bc67-4517-9260-8c9de5713308 for instance 8174a16d-3e74-4ec2-82be-deb8d294255b on hv-cinder-79617 Oct 31 12:34:32.012753 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [req-e047e671-640c-49eb-ba0b-1a615b72a15a req-f13bd895-bad9-41bc-8773-b9e8cc374c69 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051284 Oct 31 12:34:32.013381 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 135/271] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Oct 31 12:34:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 12:34:32.195800 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-ac842bce-97c9-4e41-a6e3-7aac2b88464e tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2e978bcb824a5e9d593b861c9e3bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7573cb9c503243ab90b1649591d550e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:34:32.205339 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-ac842bce-97c9-4e41-a6e3-7aac2b88464e tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] 10.222.0.15 "GET /compute/v2.1/servers/d0befdd2-2ecd-4006-bfdd-86d5253a7687" status: 200 len: 1522 microversion: 2.1 time: 0.253767 Oct 31 12:34:32.206069 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 137/272] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:34:31 2022] GET /compute/v2.1/servers/d0befdd2-2ecd-4006-bfdd-86d5253a7687 => generated 1522 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:34:32.297430 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-68f55ad9-95bc-48af-a5f2-a7f07c06b034 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:34:32.299436 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-68f55ad9-95bc-48af-a5f2-a7f07c06b034 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] [instance: 8174a16d-3e74-4ec2-82be-deb8d294255b] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:34:32.306577 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-68f55ad9-95bc-48af-a5f2-a7f07c06b034 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:34:32.307068 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-68f55ad9-95bc-48af-a5f2-a7f07c06b034 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:34:32.307606 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-68f55ad9-95bc-48af-a5f2-a7f07c06b034 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:34:32.308357 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-68f55ad9-95bc-48af-a5f2-a7f07c06b034 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:34:32.309000 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-68f55ad9-95bc-48af-a5f2-a7f07c06b034 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:34:32.309538 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-68f55ad9-95bc-48af-a5f2-a7f07c06b034 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:34:32.314782 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG dbcounter [-] [125441] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:34:32.458556 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-68f55ad9-95bc-48af-a5f2-a7f07c06b034 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1918cb60ccd04e909b78dca9b0166be9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe4270c111747be8d61e4ae993bd7ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:34:32.467562 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-68f55ad9-95bc-48af-a5f2-a7f07c06b034 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] 10.222.0.15 "GET /compute/v2.1/servers/8174a16d-3e74-4ec2-82be-deb8d294255b" status: 200 len: 1314 microversion: 2.1 time: 0.174362 Oct 31 12:34:32.468196 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 136/273] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:34:32 2022] GET /compute/v2.1/servers/8174a16d-3e74-4ec2-82be-deb8d294255b => generated 1314 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:34:33.228957 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-3155d6e0-4e07-4288-9f33-0d9d99ed9015 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:34:33.229558 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-3155d6e0-4e07-4288-9f33-0d9d99ed9015 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] [instance: d0befdd2-2ecd-4006-bfdd-86d5253a7687] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:34:33.236073 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-3155d6e0-4e07-4288-9f33-0d9d99ed9015 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:34:33.236543 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-3155d6e0-4e07-4288-9f33-0d9d99ed9015 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:34:33.236966 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-3155d6e0-4e07-4288-9f33-0d9d99ed9015 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:34:33.237640 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-3155d6e0-4e07-4288-9f33-0d9d99ed9015 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:34:33.238085 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-3155d6e0-4e07-4288-9f33-0d9d99ed9015 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:34:33.238496 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-3155d6e0-4e07-4288-9f33-0d9d99ed9015 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:34:33.371863 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-3155d6e0-4e07-4288-9f33-0d9d99ed9015 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2e978bcb824a5e9d593b861c9e3bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7573cb9c503243ab90b1649591d550e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:34:33.380153 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-3155d6e0-4e07-4288-9f33-0d9d99ed9015 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] 10.222.0.15 "GET /compute/v2.1/servers/d0befdd2-2ecd-4006-bfdd-86d5253a7687" status: 200 len: 1522 microversion: 2.1 time: 0.155221 Oct 31 12:34:33.380715 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 138/274] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:34:33 2022] GET /compute/v2.1/servers/d0befdd2-2ecd-4006-bfdd-86d5253a7687 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:34:33.492208 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-dddc7e1e-3fdb-40f8-8234-67222c8443d4 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:34:33.492811 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-dddc7e1e-3fdb-40f8-8234-67222c8443d4 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] [instance: 8174a16d-3e74-4ec2-82be-deb8d294255b] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:34:33.499093 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-dddc7e1e-3fdb-40f8-8234-67222c8443d4 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:34:33.499605 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-dddc7e1e-3fdb-40f8-8234-67222c8443d4 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:34:33.500039 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-dddc7e1e-3fdb-40f8-8234-67222c8443d4 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:34:33.500717 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-dddc7e1e-3fdb-40f8-8234-67222c8443d4 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:34:33.501661 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-dddc7e1e-3fdb-40f8-8234-67222c8443d4 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:34:33.502079 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-dddc7e1e-3fdb-40f8-8234-67222c8443d4 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:34:33.635867 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-dddc7e1e-3fdb-40f8-8234-67222c8443d4 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1918cb60ccd04e909b78dca9b0166be9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe4270c111747be8d61e4ae993bd7ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:34:33.643493 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-dddc7e1e-3fdb-40f8-8234-67222c8443d4 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] 10.222.0.15 "GET /compute/v2.1/servers/8174a16d-3e74-4ec2-82be-deb8d294255b" status: 200 len: 1314 microversion: 2.1 time: 0.155169 Oct 31 12:34:33.644053 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 137/275] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:34:33 2022] GET /compute/v2.1/servers/8174a16d-3e74-4ec2-82be-deb8d294255b => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:34:34.406929 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-b6b21caf-80db-47f0-8775-dce9b2d6f7fa tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:34:34.408477 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-b6b21caf-80db-47f0-8775-dce9b2d6f7fa tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] [instance: d0befdd2-2ecd-4006-bfdd-86d5253a7687] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:34:34.416097 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-b6b21caf-80db-47f0-8775-dce9b2d6f7fa tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:34:34.416751 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-b6b21caf-80db-47f0-8775-dce9b2d6f7fa tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:34:34.417787 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-b6b21caf-80db-47f0-8775-dce9b2d6f7fa tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:34:34.418989 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-b6b21caf-80db-47f0-8775-dce9b2d6f7fa tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:34:34.419495 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-b6b21caf-80db-47f0-8775-dce9b2d6f7fa tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:34:34.419921 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-b6b21caf-80db-47f0-8775-dce9b2d6f7fa tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:34:34.569257 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-b6b21caf-80db-47f0-8775-dce9b2d6f7fa tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2e978bcb824a5e9d593b861c9e3bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7573cb9c503243ab90b1649591d550e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:34:34.576980 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-b6b21caf-80db-47f0-8775-dce9b2d6f7fa tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] 10.222.0.15 "GET /compute/v2.1/servers/d0befdd2-2ecd-4006-bfdd-86d5253a7687" status: 200 len: 1522 microversion: 2.1 time: 0.176012 Oct 31 12:34:34.577464 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 139/276] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:34:34 2022] GET /compute/v2.1/servers/d0befdd2-2ecd-4006-bfdd-86d5253a7687 => generated 1522 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:34:34.667472 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-7d835aaa-f966-4eed-a2b4-f4afac58c08a tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:34:34.669627 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-7d835aaa-f966-4eed-a2b4-f4afac58c08a tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] [instance: 8174a16d-3e74-4ec2-82be-deb8d294255b] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:34:34.677273 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-7d835aaa-f966-4eed-a2b4-f4afac58c08a tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:34:34.677756 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-7d835aaa-f966-4eed-a2b4-f4afac58c08a tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:34:34.678683 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-7d835aaa-f966-4eed-a2b4-f4afac58c08a tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:34:34.679426 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-7d835aaa-f966-4eed-a2b4-f4afac58c08a tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:34:34.679910 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-7d835aaa-f966-4eed-a2b4-f4afac58c08a tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:34:34.680326 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-7d835aaa-f966-4eed-a2b4-f4afac58c08a tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:34:34.856484 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-7d835aaa-f966-4eed-a2b4-f4afac58c08a tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1918cb60ccd04e909b78dca9b0166be9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe4270c111747be8d61e4ae993bd7ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:34:34.865418 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-7d835aaa-f966-4eed-a2b4-f4afac58c08a tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] 10.222.0.15 "GET /compute/v2.1/servers/8174a16d-3e74-4ec2-82be-deb8d294255b" status: 200 len: 1314 microversion: 2.1 time: 0.203190 Oct 31 12:34:34.866421 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 138/277] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:34:34 2022] GET /compute/v2.1/servers/8174a16d-3e74-4ec2-82be-deb8d294255b => generated 1314 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:34:35.601183 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-66e31b64-8500-4823-b4bf-c18eb78bbca8 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:34:35.601795 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-66e31b64-8500-4823-b4bf-c18eb78bbca8 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] [instance: d0befdd2-2ecd-4006-bfdd-86d5253a7687] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:34:35.611137 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-66e31b64-8500-4823-b4bf-c18eb78bbca8 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:34:35.611896 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-66e31b64-8500-4823-b4bf-c18eb78bbca8 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:34:35.612518 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-66e31b64-8500-4823-b4bf-c18eb78bbca8 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:34:35.613409 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-66e31b64-8500-4823-b4bf-c18eb78bbca8 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:34:35.614035 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-66e31b64-8500-4823-b4bf-c18eb78bbca8 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:34:35.614614 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-66e31b64-8500-4823-b4bf-c18eb78bbca8 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:34:35.786602 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-66e31b64-8500-4823-b4bf-c18eb78bbca8 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2e978bcb824a5e9d593b861c9e3bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7573cb9c503243ab90b1649591d550e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:34:35.794192 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-66e31b64-8500-4823-b4bf-c18eb78bbca8 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] 10.222.0.15 "GET /compute/v2.1/servers/d0befdd2-2ecd-4006-bfdd-86d5253a7687" status: 200 len: 1522 microversion: 2.1 time: 0.197192 Oct 31 12:34:35.794987 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 140/278] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:34:35 2022] GET /compute/v2.1/servers/d0befdd2-2ecd-4006-bfdd-86d5253a7687 => generated 1522 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:34:35.891073 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-db9d46e1-11f5-465a-813b-9652cb3df1ec tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:34:35.892495 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-db9d46e1-11f5-465a-813b-9652cb3df1ec tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] [instance: 8174a16d-3e74-4ec2-82be-deb8d294255b] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:34:35.899818 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-db9d46e1-11f5-465a-813b-9652cb3df1ec tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:34:35.900413 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-db9d46e1-11f5-465a-813b-9652cb3df1ec tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:34:35.900916 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-db9d46e1-11f5-465a-813b-9652cb3df1ec tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:34:35.901740 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-db9d46e1-11f5-465a-813b-9652cb3df1ec tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:34:35.902514 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-db9d46e1-11f5-465a-813b-9652cb3df1ec tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:34:35.902950 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-db9d46e1-11f5-465a-813b-9652cb3df1ec tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:34:36.071097 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-db9d46e1-11f5-465a-813b-9652cb3df1ec tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1918cb60ccd04e909b78dca9b0166be9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe4270c111747be8d61e4ae993bd7ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:34:36.079683 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-db9d46e1-11f5-465a-813b-9652cb3df1ec tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] 10.222.0.15 "GET /compute/v2.1/servers/8174a16d-3e74-4ec2-82be-deb8d294255b" status: 200 len: 1314 microversion: 2.1 time: 0.192660 Oct 31 12:34:36.080261 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 139/279] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:34:35 2022] GET /compute/v2.1/servers/8174a16d-3e74-4ec2-82be-deb8d294255b => generated 1314 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:34:36.160530 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [req-f2bb447c-0f4f-41d0-aef3-ebcb50ca9b08 req-a9a7877f-501b-4b5c-974f-f4b860fb34fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8174a16d-3e74-4ec2-82be-deb8d294255b", "name": "network-vif-plugged", "status": "completed", "tag": "c7e97cf1-bc67-4517-9260-8c9de5713308"}]} {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 12:34:36.170781 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [req-f2bb447c-0f4f-41d0-aef3-ebcb50ca9b08 req-a9a7877f-501b-4b5c-974f-f4b860fb34fd service nova] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:34:36.171363 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [req-f2bb447c-0f4f-41d0-aef3-ebcb50ca9b08 req-a9a7877f-501b-4b5c-974f-f4b860fb34fd service nova] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:34:36.171801 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [req-f2bb447c-0f4f-41d0-aef3-ebcb50ca9b08 req-a9a7877f-501b-4b5c-974f-f4b860fb34fd service nova] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:34:36.207630 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.compute.server_external_events [req-f2bb447c-0f4f-41d0-aef3-ebcb50ca9b08 req-a9a7877f-501b-4b5c-974f-f4b860fb34fd service nova] Creating event network-vif-plugged:c7e97cf1-bc67-4517-9260-8c9de5713308 for instance 8174a16d-3e74-4ec2-82be-deb8d294255b on hv-cinder-79617 Oct 31 12:34:36.218311 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [req-f2bb447c-0f4f-41d0-aef3-ebcb50ca9b08 req-a9a7877f-501b-4b5c-974f-f4b860fb34fd service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061439 Oct 31 12:34:36.219248 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 141/280] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Oct 31 12:34:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 12:34:36.817189 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-a3828fb0-976d-42a4-be68-cf27acc5d339 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:34:36.817799 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-a3828fb0-976d-42a4-be68-cf27acc5d339 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] [instance: d0befdd2-2ecd-4006-bfdd-86d5253a7687] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:34:36.824091 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-a3828fb0-976d-42a4-be68-cf27acc5d339 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:34:36.824574 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-a3828fb0-976d-42a4-be68-cf27acc5d339 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:34:36.825008 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-a3828fb0-976d-42a4-be68-cf27acc5d339 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:34:36.825722 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-a3828fb0-976d-42a4-be68-cf27acc5d339 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:34:36.826347 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-a3828fb0-976d-42a4-be68-cf27acc5d339 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:34:36.826922 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-a3828fb0-976d-42a4-be68-cf27acc5d339 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:34:36.976723 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-a3828fb0-976d-42a4-be68-cf27acc5d339 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2e978bcb824a5e9d593b861c9e3bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7573cb9c503243ab90b1649591d550e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:34:36.984745 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-a3828fb0-976d-42a4-be68-cf27acc5d339 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] 10.222.0.15 "GET /compute/v2.1/servers/d0befdd2-2ecd-4006-bfdd-86d5253a7687" status: 200 len: 1522 microversion: 2.1 time: 0.171745 Oct 31 12:34:36.986613 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 140/281] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:34:36 2022] GET /compute/v2.1/servers/d0befdd2-2ecd-4006-bfdd-86d5253a7687 => generated 1522 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:34:37.103994 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-5d0e0149-cd8a-41df-9c4e-c5282dbf045e tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:34:37.105464 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-5d0e0149-cd8a-41df-9c4e-c5282dbf045e tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] [instance: 8174a16d-3e74-4ec2-82be-deb8d294255b] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:34:37.112501 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-5d0e0149-cd8a-41df-9c4e-c5282dbf045e tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:34:37.112993 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-5d0e0149-cd8a-41df-9c4e-c5282dbf045e tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:34:37.113417 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-5d0e0149-cd8a-41df-9c4e-c5282dbf045e tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:34:37.114133 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-5d0e0149-cd8a-41df-9c4e-c5282dbf045e tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:34:37.114571 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-5d0e0149-cd8a-41df-9c4e-c5282dbf045e tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:34:37.114983 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-5d0e0149-cd8a-41df-9c4e-c5282dbf045e tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:34:37.248159 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-5d0e0149-cd8a-41df-9c4e-c5282dbf045e tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1918cb60ccd04e909b78dca9b0166be9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe4270c111747be8d61e4ae993bd7ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:34:37.256439 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-5d0e0149-cd8a-41df-9c4e-c5282dbf045e tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] 10.222.0.15 "GET /compute/v2.1/servers/8174a16d-3e74-4ec2-82be-deb8d294255b" status: 200 len: 1314 microversion: 2.1 time: 0.157934 Oct 31 12:34:37.257012 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 142/282] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:34:37 2022] GET /compute/v2.1/servers/8174a16d-3e74-4ec2-82be-deb8d294255b => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:34:38.009434 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-399f6db4-98ef-4894-9b97-6d1e50196f2b tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:34:38.010039 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-399f6db4-98ef-4894-9b97-6d1e50196f2b tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] [instance: d0befdd2-2ecd-4006-bfdd-86d5253a7687] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:34:38.016384 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-399f6db4-98ef-4894-9b97-6d1e50196f2b tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:34:38.017360 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-399f6db4-98ef-4894-9b97-6d1e50196f2b tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:34:38.018118 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-399f6db4-98ef-4894-9b97-6d1e50196f2b tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:34:38.018985 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-399f6db4-98ef-4894-9b97-6d1e50196f2b tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:34:38.019461 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-399f6db4-98ef-4894-9b97-6d1e50196f2b tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:34:38.019878 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-399f6db4-98ef-4894-9b97-6d1e50196f2b tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:34:38.150967 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-399f6db4-98ef-4894-9b97-6d1e50196f2b tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2e978bcb824a5e9d593b861c9e3bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7573cb9c503243ab90b1649591d550e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:34:38.159377 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-399f6db4-98ef-4894-9b97-6d1e50196f2b tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] 10.222.0.15 "GET /compute/v2.1/servers/d0befdd2-2ecd-4006-bfdd-86d5253a7687" status: 200 len: 1522 microversion: 2.1 time: 0.153712 Oct 31 12:34:38.159940 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 141/283] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:34:38 2022] GET /compute/v2.1/servers/d0befdd2-2ecd-4006-bfdd-86d5253a7687 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:34:38.279191 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-7d5c0efb-acee-418c-85a4-3b55d4c56825 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:34:38.279799 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-7d5c0efb-acee-418c-85a4-3b55d4c56825 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] [instance: 8174a16d-3e74-4ec2-82be-deb8d294255b] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:34:38.286604 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-7d5c0efb-acee-418c-85a4-3b55d4c56825 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:34:38.287080 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-7d5c0efb-acee-418c-85a4-3b55d4c56825 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:34:38.287547 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-7d5c0efb-acee-418c-85a4-3b55d4c56825 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:34:38.288225 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-7d5c0efb-acee-418c-85a4-3b55d4c56825 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:34:38.288794 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-7d5c0efb-acee-418c-85a4-3b55d4c56825 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:34:38.289290 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-7d5c0efb-acee-418c-85a4-3b55d4c56825 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:34:38.424722 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-7d5c0efb-acee-418c-85a4-3b55d4c56825 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1918cb60ccd04e909b78dca9b0166be9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe4270c111747be8d61e4ae993bd7ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:34:38.432325 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-7d5c0efb-acee-418c-85a4-3b55d4c56825 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] 10.222.0.15 "GET /compute/v2.1/servers/8174a16d-3e74-4ec2-82be-deb8d294255b" status: 200 len: 1314 microversion: 2.1 time: 0.157002 Oct 31 12:34:38.432889 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 143/284] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:34:38 2022] GET /compute/v2.1/servers/8174a16d-3e74-4ec2-82be-deb8d294255b => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:34:39.196313 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-4f239f19-6d64-4d6c-a3da-fea92fb64750 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:34:39.198510 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-4f239f19-6d64-4d6c-a3da-fea92fb64750 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] [instance: d0befdd2-2ecd-4006-bfdd-86d5253a7687] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:34:39.200818 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG dbcounter [-] [125441] Writing DB stats nova_cell0:SELECT=2 {{(pid=125441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:34:39.207124 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-4f239f19-6d64-4d6c-a3da-fea92fb64750 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:34:39.207635 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-4f239f19-6d64-4d6c-a3da-fea92fb64750 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:34:39.208253 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-4f239f19-6d64-4d6c-a3da-fea92fb64750 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:34:39.208953 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-4f239f19-6d64-4d6c-a3da-fea92fb64750 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:34:39.209567 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-4f239f19-6d64-4d6c-a3da-fea92fb64750 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:34:39.209992 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-4f239f19-6d64-4d6c-a3da-fea92fb64750 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:34:39.343329 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-4f239f19-6d64-4d6c-a3da-fea92fb64750 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2e978bcb824a5e9d593b861c9e3bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7573cb9c503243ab90b1649591d550e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:34:39.351180 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-4f239f19-6d64-4d6c-a3da-fea92fb64750 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] 10.222.0.15 "GET /compute/v2.1/servers/d0befdd2-2ecd-4006-bfdd-86d5253a7687" status: 200 len: 1522 microversion: 2.1 time: 0.172857 Oct 31 12:34:39.351761 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 142/285] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:34:39 2022] GET /compute/v2.1/servers/d0befdd2-2ecd-4006-bfdd-86d5253a7687 => generated 1522 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:34:39.456651 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-157c0222-a1e6-4464-8025-a5e71c6ad498 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:34:39.457840 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-157c0222-a1e6-4464-8025-a5e71c6ad498 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] [instance: 8174a16d-3e74-4ec2-82be-deb8d294255b] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:34:39.459777 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG dbcounter [-] [125440] Writing DB stats nova_cell0:SELECT=2 {{(pid=125440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:34:39.460427 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG dbcounter [-] [125440] Writing DB stats nova_cell0:SELECT=6 {{(pid=125440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:34:39.466139 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-157c0222-a1e6-4464-8025-a5e71c6ad498 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:34:39.466612 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-157c0222-a1e6-4464-8025-a5e71c6ad498 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:34:39.467039 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-157c0222-a1e6-4464-8025-a5e71c6ad498 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:34:39.467751 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-157c0222-a1e6-4464-8025-a5e71c6ad498 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:34:39.468197 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-157c0222-a1e6-4464-8025-a5e71c6ad498 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:34:39.468612 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-157c0222-a1e6-4464-8025-a5e71c6ad498 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:34:39.600432 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-157c0222-a1e6-4464-8025-a5e71c6ad498 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1918cb60ccd04e909b78dca9b0166be9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe4270c111747be8d61e4ae993bd7ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:34:39.608109 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-157c0222-a1e6-4464-8025-a5e71c6ad498 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] 10.222.0.15 "GET /compute/v2.1/servers/8174a16d-3e74-4ec2-82be-deb8d294255b" status: 200 len: 1497 microversion: 2.1 time: 0.155900 Oct 31 12:34:39.608755 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 144/286] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:34:39 2022] GET /compute/v2.1/servers/8174a16d-3e74-4ec2-82be-deb8d294255b => generated 1497 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:34:40.139830 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-5c0b9f93-511d-4110-967b-d9661e6413c5 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:34:40.140346 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-5c0b9f93-511d-4110-967b-d9661e6413c5 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] [instance: 8174a16d-3e74-4ec2-82be-deb8d294255b] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:34:40.146597 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-5c0b9f93-511d-4110-967b-d9661e6413c5 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:34:40.147063 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-5c0b9f93-511d-4110-967b-d9661e6413c5 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:34:40.147615 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-5c0b9f93-511d-4110-967b-d9661e6413c5 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:34:40.148435 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-5c0b9f93-511d-4110-967b-d9661e6413c5 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:34:40.148862 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-5c0b9f93-511d-4110-967b-d9661e6413c5 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:34:40.149272 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-5c0b9f93-511d-4110-967b-d9661e6413c5 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:34:40.176961 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-5c0b9f93-511d-4110-967b-d9661e6413c5 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] [instance: 8174a16d-3e74-4ec2-82be-deb8d294255b] Going to try to terminate instance {{(pid=125441) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 12:34:40.267099 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-5c0b9f93-511d-4110-967b-d9661e6413c5 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] 10.222.0.15 "DELETE /compute/v2.1/servers/8174a16d-3e74-4ec2-82be-deb8d294255b" status: 204 len: 0 microversion: 2.1 time: 0.130199 Oct 31 12:34:40.268092 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 143/287] 10.222.0.15 () {58 vars in 1239 bytes} [Mon Oct 31 12:34:40 2022] DELETE /compute/v2.1/servers/8174a16d-3e74-4ec2-82be-deb8d294255b => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 12:34:40.276820 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-b3862530-eb0b-4c50-8bf2-1b81be25aa78 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:34:40.277671 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-b3862530-eb0b-4c50-8bf2-1b81be25aa78 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] [instance: 8174a16d-3e74-4ec2-82be-deb8d294255b] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:34:40.287661 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-b3862530-eb0b-4c50-8bf2-1b81be25aa78 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:34:40.288409 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-b3862530-eb0b-4c50-8bf2-1b81be25aa78 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:34:40.289095 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-b3862530-eb0b-4c50-8bf2-1b81be25aa78 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:34:40.289920 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-b3862530-eb0b-4c50-8bf2-1b81be25aa78 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:34:40.290802 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-b3862530-eb0b-4c50-8bf2-1b81be25aa78 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:34:40.291462 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-b3862530-eb0b-4c50-8bf2-1b81be25aa78 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:34:40.374408 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-93186c67-a86d-437d-af72-5dd7ac1f9af5 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:34:40.375094 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-93186c67-a86d-437d-af72-5dd7ac1f9af5 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] [instance: d0befdd2-2ecd-4006-bfdd-86d5253a7687] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:34:40.382520 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-93186c67-a86d-437d-af72-5dd7ac1f9af5 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:34:40.383114 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-93186c67-a86d-437d-af72-5dd7ac1f9af5 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:34:40.383672 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-93186c67-a86d-437d-af72-5dd7ac1f9af5 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:34:40.384358 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-93186c67-a86d-437d-af72-5dd7ac1f9af5 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:34:40.384804 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-93186c67-a86d-437d-af72-5dd7ac1f9af5 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:34:40.385217 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-93186c67-a86d-437d-af72-5dd7ac1f9af5 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:34:40.432333 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-b3862530-eb0b-4c50-8bf2-1b81be25aa78 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1918cb60ccd04e909b78dca9b0166be9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe4270c111747be8d61e4ae993bd7ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:34:40.440818 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-b3862530-eb0b-4c50-8bf2-1b81be25aa78 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] 10.222.0.15 "GET /compute/v2.1/servers/8174a16d-3e74-4ec2-82be-deb8d294255b" status: 200 len: 1503 microversion: 2.1 time: 0.168000 Oct 31 12:34:40.441464 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 145/288] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:34:40 2022] GET /compute/v2.1/servers/8174a16d-3e74-4ec2-82be-deb8d294255b => generated 1503 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:34:40.519354 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-93186c67-a86d-437d-af72-5dd7ac1f9af5 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2e978bcb824a5e9d593b861c9e3bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7573cb9c503243ab90b1649591d550e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:34:40.527204 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-93186c67-a86d-437d-af72-5dd7ac1f9af5 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] 10.222.0.15 "GET /compute/v2.1/servers/d0befdd2-2ecd-4006-bfdd-86d5253a7687" status: 200 len: 1522 microversion: 2.1 time: 0.157096 Oct 31 12:34:40.527853 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 144/289] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:34:40 2022] GET /compute/v2.1/servers/d0befdd2-2ecd-4006-bfdd-86d5253a7687 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 12:34:41.463922 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-f5296191-fd3c-4427-883a-e41d61ba0712 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:34:41.464518 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-f5296191-fd3c-4427-883a-e41d61ba0712 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] [instance: 8174a16d-3e74-4ec2-82be-deb8d294255b] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:34:41.470380 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-f5296191-fd3c-4427-883a-e41d61ba0712 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:34:41.470851 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-f5296191-fd3c-4427-883a-e41d61ba0712 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:34:41.471297 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-f5296191-fd3c-4427-883a-e41d61ba0712 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:34:41.471973 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-f5296191-fd3c-4427-883a-e41d61ba0712 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:34:41.472416 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-f5296191-fd3c-4427-883a-e41d61ba0712 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:34:41.472830 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-f5296191-fd3c-4427-883a-e41d61ba0712 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:34:41.549876 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-4cbb122f-ceda-4ef5-be42-cb4d74a494dc tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:34:41.550773 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-4cbb122f-ceda-4ef5-be42-cb4d74a494dc tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] [instance: d0befdd2-2ecd-4006-bfdd-86d5253a7687] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:34:41.557240 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-4cbb122f-ceda-4ef5-be42-cb4d74a494dc tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:34:41.557912 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-4cbb122f-ceda-4ef5-be42-cb4d74a494dc tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:34:41.558425 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-4cbb122f-ceda-4ef5-be42-cb4d74a494dc tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:34:41.559150 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-4cbb122f-ceda-4ef5-be42-cb4d74a494dc tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:34:41.559616 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-4cbb122f-ceda-4ef5-be42-cb4d74a494dc tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:34:41.560164 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-4cbb122f-ceda-4ef5-be42-cb4d74a494dc tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:34:41.611986 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-f5296191-fd3c-4427-883a-e41d61ba0712 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1918cb60ccd04e909b78dca9b0166be9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe4270c111747be8d61e4ae993bd7ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:34:41.623708 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-f5296191-fd3c-4427-883a-e41d61ba0712 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] 10.222.0.15 "GET /compute/v2.1/servers/8174a16d-3e74-4ec2-82be-deb8d294255b" status: 200 len: 1503 microversion: 2.1 time: 0.161893 Oct 31 12:34:41.625013 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 146/290] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:34:41 2022] GET /compute/v2.1/servers/8174a16d-3e74-4ec2-82be-deb8d294255b => generated 1503 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:34:41.730843 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-4cbb122f-ceda-4ef5-be42-cb4d74a494dc tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2e978bcb824a5e9d593b861c9e3bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7573cb9c503243ab90b1649591d550e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:34:41.739693 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-4cbb122f-ceda-4ef5-be42-cb4d74a494dc tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] 10.222.0.15 "GET /compute/v2.1/servers/d0befdd2-2ecd-4006-bfdd-86d5253a7687" status: 200 len: 1522 microversion: 2.1 time: 0.193458 Oct 31 12:34:41.740266 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 145/291] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:34:41 2022] GET /compute/v2.1/servers/d0befdd2-2ecd-4006-bfdd-86d5253a7687 => generated 1522 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 12:34:42.652312 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-de96dc90-dddb-41af-9793-ec2660944466 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:34:42.652918 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-de96dc90-dddb-41af-9793-ec2660944466 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] [instance: 8174a16d-3e74-4ec2-82be-deb8d294255b] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:34:42.660450 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-de96dc90-dddb-41af-9793-ec2660944466 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:34:42.662855 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-de96dc90-dddb-41af-9793-ec2660944466 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:34:42.663649 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-de96dc90-dddb-41af-9793-ec2660944466 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:34:42.664559 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-de96dc90-dddb-41af-9793-ec2660944466 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:34:42.665020 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-de96dc90-dddb-41af-9793-ec2660944466 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:34:42.665439 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-de96dc90-dddb-41af-9793-ec2660944466 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:34:42.764942 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-8ab20ec2-fd31-430d-835f-9616dc5e2f00 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:34:42.765672 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-8ab20ec2-fd31-430d-835f-9616dc5e2f00 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] [instance: d0befdd2-2ecd-4006-bfdd-86d5253a7687] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:34:42.773426 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-8ab20ec2-fd31-430d-835f-9616dc5e2f00 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:34:42.773896 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-8ab20ec2-fd31-430d-835f-9616dc5e2f00 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:34:42.774492 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-8ab20ec2-fd31-430d-835f-9616dc5e2f00 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:34:42.775370 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-8ab20ec2-fd31-430d-835f-9616dc5e2f00 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:34:42.775819 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-8ab20ec2-fd31-430d-835f-9616dc5e2f00 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:34:42.776225 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-8ab20ec2-fd31-430d-835f-9616dc5e2f00 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:34:42.918493 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-de96dc90-dddb-41af-9793-ec2660944466 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1918cb60ccd04e909b78dca9b0166be9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe4270c111747be8d61e4ae993bd7ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:34:42.928208 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-8ab20ec2-fd31-430d-835f-9616dc5e2f00 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2e978bcb824a5e9d593b861c9e3bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7573cb9c503243ab90b1649591d550e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:34:42.943011 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-de96dc90-dddb-41af-9793-ec2660944466 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] 10.222.0.15 "GET /compute/v2.1/servers/8174a16d-3e74-4ec2-82be-deb8d294255b" status: 200 len: 1503 microversion: 2.1 time: 0.294610 Oct 31 12:34:42.943651 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 147/292] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:34:42 2022] GET /compute/v2.1/servers/8174a16d-3e74-4ec2-82be-deb8d294255b => generated 1503 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:34:42.946006 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-8ab20ec2-fd31-430d-835f-9616dc5e2f00 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] 10.222.0.15 "GET /compute/v2.1/servers/d0befdd2-2ecd-4006-bfdd-86d5253a7687" status: 200 len: 1522 microversion: 2.1 time: 0.185598 Oct 31 12:34:42.946579 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 146/293] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:34:42 2022] GET /compute/v2.1/servers/d0befdd2-2ecd-4006-bfdd-86d5253a7687 => generated 1522 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 12:34:43.212735 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-67dd3233-9292-4522-bb53-496fe96bc5b6 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-118527477", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1538609029", "security_groups": [{"name": "tempest-secgroup-smoke-233018250"}], "networks": [{"uuid": "4c791682-8f05-4443-be69-80decd7c40ce"}], "block_device_mapping_v2": [{"uuid": "5b07942f-60b7-4875-bec4-67602be116a2", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 12:34:43.278761 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [req-04eb1e09-5d04-49c5-a9d7-23d5ba8d4e10 req-11bf838b-e1fa-44c8-9dab-0f995ee50659 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8174a16d-3e74-4ec2-82be-deb8d294255b", "name": "network-vif-deleted", "tag": "c7e97cf1-bc67-4517-9260-8c9de5713308"}]} {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 12:34:43.288549 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [req-04eb1e09-5d04-49c5-a9d7-23d5ba8d4e10 req-11bf838b-e1fa-44c8-9dab-0f995ee50659 service nova] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:34:43.289106 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [req-04eb1e09-5d04-49c5-a9d7-23d5ba8d4e10 req-11bf838b-e1fa-44c8-9dab-0f995ee50659 service nova] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:34:43.289596 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [req-04eb1e09-5d04-49c5-a9d7-23d5ba8d4e10 req-11bf838b-e1fa-44c8-9dab-0f995ee50659 service nova] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:34:43.303589 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.compute.server_external_events [req-04eb1e09-5d04-49c5-a9d7-23d5ba8d4e10 req-11bf838b-e1fa-44c8-9dab-0f995ee50659 service nova] Creating event network-vif-deleted:c7e97cf1-bc67-4517-9260-8c9de5713308 for instance 8174a16d-3e74-4ec2-82be-deb8d294255b on hv-cinder-79617 Oct 31 12:34:43.308459 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [req-04eb1e09-5d04-49c5-a9d7-23d5ba8d4e10 req-11bf838b-e1fa-44c8-9dab-0f995ee50659 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033592 Oct 31 12:34:43.309072 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 147/294] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Oct 31 12:34:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 12:34:43.349271 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.network.neutron [None req-67dd3233-9292-4522-bb53-496fe96bc5b6 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] validate_networks() for [('4c791682-8f05-4443-be69-80decd7c40ce', None, None, None, None, None)] {{(pid=125440) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 12:34:43.720948 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.virt.hardware [None req-67dd3233-9292-4522-bb53-496fe96bc5b6 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Flavor limits 0:0:0 {{(pid=125440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 12:34:43.721514 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.virt.hardware [None req-67dd3233-9292-4522-bb53-496fe96bc5b6 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Image limits 0:0:0 {{(pid=125440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 12:34:43.721822 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.virt.hardware [None req-67dd3233-9292-4522-bb53-496fe96bc5b6 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Flavor pref 0:0:0 {{(pid=125440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 12:34:43.722220 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.virt.hardware [None req-67dd3233-9292-4522-bb53-496fe96bc5b6 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Image pref 0:0:0 {{(pid=125440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 12:34:43.722624 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.virt.hardware [None req-67dd3233-9292-4522-bb53-496fe96bc5b6 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 12:34:43.734421 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-67dd3233-9292-4522-bb53-496fe96bc5b6 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:34:43.734927 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-67dd3233-9292-4522-bb53-496fe96bc5b6 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:34:43.735385 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-67dd3233-9292-4522-bb53-496fe96bc5b6 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:34:43.736119 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-67dd3233-9292-4522-bb53-496fe96bc5b6 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:34:43.736558 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-67dd3233-9292-4522-bb53-496fe96bc5b6 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:34:43.737183 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-67dd3233-9292-4522-bb53-496fe96bc5b6 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:34:43.755513 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.quota [None req-67dd3233-9292-4522-bb53-496fe96bc5b6 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Getting quotas for project b14b98f006574deabc030c2e93c680c4. Resources: {'instances', 'cores', 'ram'} {{(pid=125440) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 12:34:43.759923 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.quota [None req-67dd3233-9292-4522-bb53-496fe96bc5b6 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Getting quotas for user 825059319a204b6da5bc7004b3a09361 and project b14b98f006574deabc030c2e93c680c4. Resources: {'instances', 'cores', 'ram'} {{(pid=125440) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 12:34:43.821641 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-67dd3233-9292-4522-bb53-496fe96bc5b6 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Going to run 1 instances... {{(pid=125440) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 12:34:43.823856 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-67dd3233-9292-4522-bb53-496fe96bc5b6 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] [instance: b8c93a18-ee0e-438e-823c-cf51f9d4985f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='5b07942f-60b7-4875-bec4-67602be116a2',volume_size=None,volume_type=None)] {{(pid=125440) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 12:34:43.958258 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-67dd3233-9292-4522-bb53-496fe96bc5b6 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.750063 Oct 31 12:34:43.958903 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 148/295] 10.222.0.15 () {60 vars in 1147 bytes} [Mon Oct 31 12:34:43 2022] POST /compute/v2.1/servers => generated 405 bytes in 751 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 31 12:34:43.966111 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-4a8f048d-5a22-4790-a1c6-035c74a306ac tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:34:43.966805 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-4a8f048d-5a22-4790-a1c6-035c74a306ac tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] [instance: 8174a16d-3e74-4ec2-82be-deb8d294255b] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:34:43.973493 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-df00276a-eb42-49db-8957-0c227209fc96 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:34:43.974366 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-df00276a-eb42-49db-8957-0c227209fc96 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] [instance: d0befdd2-2ecd-4006-bfdd-86d5253a7687] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:34:43.974491 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-4a8f048d-5a22-4790-a1c6-035c74a306ac tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:34:43.974820 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-4a8f048d-5a22-4790-a1c6-035c74a306ac tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:34:43.975570 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-4a8f048d-5a22-4790-a1c6-035c74a306ac tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:34:43.976471 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-4a8f048d-5a22-4790-a1c6-035c74a306ac tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:34:43.977127 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-4a8f048d-5a22-4790-a1c6-035c74a306ac tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:34:43.977752 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-4a8f048d-5a22-4790-a1c6-035c74a306ac tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:34:43.983495 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-df00276a-eb42-49db-8957-0c227209fc96 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:34:43.986706 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-df00276a-eb42-49db-8957-0c227209fc96 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:34:43.987351 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-df00276a-eb42-49db-8957-0c227209fc96 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:34:43.988123 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-df00276a-eb42-49db-8957-0c227209fc96 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:34:43.988582 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-df00276a-eb42-49db-8957-0c227209fc96 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:34:43.989010 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-df00276a-eb42-49db-8957-0c227209fc96 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:34:44.074563 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-4a8f048d-5a22-4790-a1c6-035c74a306ac tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1918cb60ccd04e909b78dca9b0166be9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe4270c111747be8d61e4ae993bd7ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:34:44.089499 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-4a8f048d-5a22-4790-a1c6-035c74a306ac tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] 10.222.0.15 "GET /compute/v2.1/servers/8174a16d-3e74-4ec2-82be-deb8d294255b" status: 200 len: 1461 microversion: 2.1 time: 0.127364 Oct 31 12:34:44.095600 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 148/296] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:34:43 2022] GET /compute/v2.1/servers/8174a16d-3e74-4ec2-82be-deb8d294255b => generated 1461 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:34:44.101694 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-fc0d502e-9247-41ac-b158-2153c3352c01 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:34:44.102505 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-fc0d502e-9247-41ac-b158-2153c3352c01 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] [instance: b8c93a18-ee0e-438e-823c-cf51f9d4985f] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:34:44.156400 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-df00276a-eb42-49db-8957-0c227209fc96 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2e978bcb824a5e9d593b861c9e3bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7573cb9c503243ab90b1649591d550e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:34:44.165048 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-df00276a-eb42-49db-8957-0c227209fc96 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] 10.222.0.15 "GET /compute/v2.1/servers/d0befdd2-2ecd-4006-bfdd-86d5253a7687" status: 200 len: 1502 microversion: 2.1 time: 0.196543 Oct 31 12:34:44.165906 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 149/297] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:34:43 2022] GET /compute/v2.1/servers/d0befdd2-2ecd-4006-bfdd-86d5253a7687 => generated 1502 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:34:44.185530 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-fc0d502e-9247-41ac-b158-2153c3352c01 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825059319a204b6da5bc7004b3a09361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14b98f006574deabc030c2e93c680c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:34:44.188138 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-69f91ec9-f7c9-462c-82c0-ad0c20b21d65 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:34:44.189190 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-69f91ec9-f7c9-462c-82c0-ad0c20b21d65 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] [instance: d33a2d6b-f17c-4ce3-ad33-9086d790495d] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:34:44.194303 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-fc0d502e-9247-41ac-b158-2153c3352c01 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] 10.222.0.15 "GET /compute/v2.1/servers/b8c93a18-ee0e-438e-823c-cf51f9d4985f" status: 200 len: 1088 microversion: 2.1 time: 0.097208 Oct 31 12:34:44.207558 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-69f91ec9-f7c9-462c-82c0-ad0c20b21d65 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:34:44.207558 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-69f91ec9-f7c9-462c-82c0-ad0c20b21d65 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:34:44.207558 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-69f91ec9-f7c9-462c-82c0-ad0c20b21d65 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:34:44.207558 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-69f91ec9-f7c9-462c-82c0-ad0c20b21d65 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:34:44.207883 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-69f91ec9-f7c9-462c-82c0-ad0c20b21d65 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:34:44.207883 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-69f91ec9-f7c9-462c-82c0-ad0c20b21d65 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:34:44.208580 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 149/298] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:34:44 2022] GET /compute/v2.1/servers/b8c93a18-ee0e-438e-823c-cf51f9d4985f => generated 1088 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:34:44.369291 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-69f91ec9-f7c9-462c-82c0-ad0c20b21d65 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2e978bcb824a5e9d593b861c9e3bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7573cb9c503243ab90b1649591d550e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:34:44.375521 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG dbcounter [-] [125440] Writing DB stats nova_cell1:SELECT=100 {{(pid=125440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:34:44.398534 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-69f91ec9-f7c9-462c-82c0-ad0c20b21d65 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] 10.222.0.15 "GET /compute/v2.1/servers/d33a2d6b-f17c-4ce3-ad33-9086d790495d" status: 200 len: 1516 microversion: 2.1 time: 0.200451 Oct 31 12:34:44.399309 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 150/299] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:34:44 2022] GET /compute/v2.1/servers/d33a2d6b-f17c-4ce3-ad33-9086d790495d => generated 1516 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 12:34:45.121865 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-5f2dab5f-f3de-4166-8745-b4b882b1a1e5 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:34:45.122472 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-5f2dab5f-f3de-4166-8745-b4b882b1a1e5 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] [instance: 8174a16d-3e74-4ec2-82be-deb8d294255b] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:34:45.130304 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-5f2dab5f-f3de-4166-8745-b4b882b1a1e5 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:34:45.130780 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-5f2dab5f-f3de-4166-8745-b4b882b1a1e5 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:34:45.131228 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-5f2dab5f-f3de-4166-8745-b4b882b1a1e5 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:34:45.131915 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-5f2dab5f-f3de-4166-8745-b4b882b1a1e5 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:34:45.132362 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-5f2dab5f-f3de-4166-8745-b4b882b1a1e5 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:34:45.132781 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-5f2dab5f-f3de-4166-8745-b4b882b1a1e5 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:34:45.206398 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-5f2dab5f-f3de-4166-8745-b4b882b1a1e5 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1918cb60ccd04e909b78dca9b0166be9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe4270c111747be8d61e4ae993bd7ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:34:45.219235 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-bf76f73a-f339-4d7b-b1e7-edaf9b501177 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:34:45.220467 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-bf76f73a-f339-4d7b-b1e7-edaf9b501177 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] [instance: b8c93a18-ee0e-438e-823c-cf51f9d4985f] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:34:45.225140 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-5f2dab5f-f3de-4166-8745-b4b882b1a1e5 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] 10.222.0.15 "GET /compute/v2.1/servers/8174a16d-3e74-4ec2-82be-deb8d294255b" status: 200 len: 1461 microversion: 2.1 time: 0.107098 Oct 31 12:34:45.227531 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-bf76f73a-f339-4d7b-b1e7-edaf9b501177 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:34:45.228010 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-bf76f73a-f339-4d7b-b1e7-edaf9b501177 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:34:45.228429 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-bf76f73a-f339-4d7b-b1e7-edaf9b501177 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:34:45.229168 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-bf76f73a-f339-4d7b-b1e7-edaf9b501177 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:34:45.229722 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-bf76f73a-f339-4d7b-b1e7-edaf9b501177 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:34:45.230037 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-bf76f73a-f339-4d7b-b1e7-edaf9b501177 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:34:45.239454 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 150/300] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:34:45 2022] GET /compute/v2.1/servers/8174a16d-3e74-4ec2-82be-deb8d294255b => generated 1461 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:34:45.294924 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-bf76f73a-f339-4d7b-b1e7-edaf9b501177 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825059319a204b6da5bc7004b3a09361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14b98f006574deabc030c2e93c680c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:34:45.302904 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-bf76f73a-f339-4d7b-b1e7-edaf9b501177 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] 10.222.0.15 "GET /compute/v2.1/servers/b8c93a18-ee0e-438e-823c-cf51f9d4985f" status: 200 len: 1138 microversion: 2.1 time: 0.087461 Oct 31 12:34:45.303510 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 151/301] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:34:45 2022] GET /compute/v2.1/servers/b8c93a18-ee0e-438e-823c-cf51f9d4985f => generated 1138 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:34:46.249182 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-fb1cf5c0-c752-47ad-81c1-54e9f6d7b984 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:34:46.249794 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-fb1cf5c0-c752-47ad-81c1-54e9f6d7b984 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] [instance: 8174a16d-3e74-4ec2-82be-deb8d294255b] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:34:46.257557 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-fb1cf5c0-c752-47ad-81c1-54e9f6d7b984 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:34:46.258245 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-fb1cf5c0-c752-47ad-81c1-54e9f6d7b984 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:34:46.258824 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-fb1cf5c0-c752-47ad-81c1-54e9f6d7b984 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:34:46.260234 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-fb1cf5c0-c752-47ad-81c1-54e9f6d7b984 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:34:46.260706 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-fb1cf5c0-c752-47ad-81c1-54e9f6d7b984 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:34:46.261279 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-fb1cf5c0-c752-47ad-81c1-54e9f6d7b984 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:34:46.326515 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-a4c9eb8a-1076-40be-9d66-bb965a4965ed tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:34:46.327118 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-a4c9eb8a-1076-40be-9d66-bb965a4965ed tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] [instance: b8c93a18-ee0e-438e-823c-cf51f9d4985f] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:34:46.329721 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG dbcounter [-] [125440] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=125440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:34:46.342054 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-fb1cf5c0-c752-47ad-81c1-54e9f6d7b984 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1918cb60ccd04e909b78dca9b0166be9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe4270c111747be8d61e4ae993bd7ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:34:46.348784 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-a4c9eb8a-1076-40be-9d66-bb965a4965ed tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:34:46.349265 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-a4c9eb8a-1076-40be-9d66-bb965a4965ed tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:34:46.349693 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-a4c9eb8a-1076-40be-9d66-bb965a4965ed tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:34:46.350378 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-a4c9eb8a-1076-40be-9d66-bb965a4965ed tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:34:46.350528 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-fb1cf5c0-c752-47ad-81c1-54e9f6d7b984 tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] 10.222.0.15 "GET /compute/v2.1/servers/8174a16d-3e74-4ec2-82be-deb8d294255b" status: 200 len: 1461 microversion: 2.1 time: 0.105700 Oct 31 12:34:46.350852 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-a4c9eb8a-1076-40be-9d66-bb965a4965ed tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:34:46.351410 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-a4c9eb8a-1076-40be-9d66-bb965a4965ed tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:34:46.363000 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 151/302] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:34:46 2022] GET /compute/v2.1/servers/8174a16d-3e74-4ec2-82be-deb8d294255b => generated 1461 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:34:46.442085 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-a4c9eb8a-1076-40be-9d66-bb965a4965ed tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825059319a204b6da5bc7004b3a09361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14b98f006574deabc030c2e93c680c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:34:46.450194 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-a4c9eb8a-1076-40be-9d66-bb965a4965ed tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] 10.222.0.15 "GET /compute/v2.1/servers/b8c93a18-ee0e-438e-823c-cf51f9d4985f" status: 200 len: 1138 microversion: 2.1 time: 0.127764 Oct 31 12:34:46.450766 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 152/303] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:34:46 2022] GET /compute/v2.1/servers/b8c93a18-ee0e-438e-823c-cf51f9d4985f => generated 1138 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:34:46.862959 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-9403fcac-07be-481a-8bd7-cfce18467944 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 12:34:46.865239 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-9403fcac-07be-481a-8bd7-cfce18467944 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] [instance: d33a2d6b-f17c-4ce3-ad33-9086d790495d] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:34:46.870971 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-9403fcac-07be-481a-8bd7-cfce18467944 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:34:46.871735 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-9403fcac-07be-481a-8bd7-cfce18467944 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:34:46.872161 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-9403fcac-07be-481a-8bd7-cfce18467944 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:34:46.872872 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-9403fcac-07be-481a-8bd7-cfce18467944 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:34:46.873317 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-9403fcac-07be-481a-8bd7-cfce18467944 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:34:46.873909 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-9403fcac-07be-481a-8bd7-cfce18467944 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:34:46.897863 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.objects.instance [None req-9403fcac-07be-481a-8bd7-cfce18467944 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lazy-loading 'flavor' on Instance uuid d33a2d6b-f17c-4ce3-ad33-9086d790495d {{(pid=125441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 12:34:46.901550 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG dbcounter [-] [125441] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:34:46.973743 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-9403fcac-07be-481a-8bd7-cfce18467944 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] 10.222.0.15 "POST /compute/v2.1/servers/d33a2d6b-f17c-4ce3-ad33-9086d790495d/action" status: 200 len: 32 microversion: 2.1 time: 0.115482 Oct 31 12:34:46.974367 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 152/304] 10.222.0.15 () {60 vars in 1278 bytes} [Mon Oct 31 12:34:46 2022] POST /compute/v2.1/servers/d33a2d6b-f17c-4ce3-ad33-9086d790495d/action => generated 32 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 31 12:34:46.983820 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-bec21e43-2439-4a0f-ae02-7942bcce7409 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:34:46.984420 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-bec21e43-2439-4a0f-ae02-7942bcce7409 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] [instance: d33a2d6b-f17c-4ce3-ad33-9086d790495d] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:34:46.990238 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-bec21e43-2439-4a0f-ae02-7942bcce7409 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:34:46.990923 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-bec21e43-2439-4a0f-ae02-7942bcce7409 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:34:46.991374 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-bec21e43-2439-4a0f-ae02-7942bcce7409 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:34:46.992051 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-bec21e43-2439-4a0f-ae02-7942bcce7409 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:34:46.992485 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-bec21e43-2439-4a0f-ae02-7942bcce7409 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:34:46.993060 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-bec21e43-2439-4a0f-ae02-7942bcce7409 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:34:47.186270 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-bec21e43-2439-4a0f-ae02-7942bcce7409 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2e978bcb824a5e9d593b861c9e3bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7573cb9c503243ab90b1649591d550e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:34:47.195697 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-bec21e43-2439-4a0f-ae02-7942bcce7409 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] 10.222.0.15 "GET /compute/v2.1/servers/d33a2d6b-f17c-4ce3-ad33-9086d790495d" status: 200 len: 1522 microversion: 2.1 time: 0.215495 Oct 31 12:34:47.196462 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 153/305] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:34:46 2022] GET /compute/v2.1/servers/d33a2d6b-f17c-4ce3-ad33-9086d790495d => generated 1522 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:34:47.377611 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-e2464ac9-56b2-4771-9047-4c72c719856f tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:34:47.378657 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-e2464ac9-56b2-4771-9047-4c72c719856f tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] [instance: 8174a16d-3e74-4ec2-82be-deb8d294255b] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:34:47.389738 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-e2464ac9-56b2-4771-9047-4c72c719856f tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:34:47.390235 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-e2464ac9-56b2-4771-9047-4c72c719856f tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:34:47.401949 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-e2464ac9-56b2-4771-9047-4c72c719856f tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:34:47.404290 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-e2464ac9-56b2-4771-9047-4c72c719856f tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:34:47.405736 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-e2464ac9-56b2-4771-9047-4c72c719856f tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:34:47.406192 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-e2464ac9-56b2-4771-9047-4c72c719856f tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:34:47.442800 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.wsgi [None req-e2464ac9-56b2-4771-9047-4c72c719856f tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] HTTP exception thrown: Instance 8174a16d-3e74-4ec2-82be-deb8d294255b could not be found. Oct 31 12:34:47.445954 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-e2464ac9-56b2-4771-9047-4c72c719856f tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Request method failure captured: Oct 31 12:34:47.445954 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: request: GET /compute/v2.1/servers/8174a16d-3e74-4ec2-82be-deb8d294255b HTTP/1.1 Oct 31 12:34:47.445954 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: Accept: application/json Oct 31 12:34:47.445954 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: Accept-Encoding: identity Oct 31 12:34:47.445954 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: Connection: close Oct 31 12:34:47.445954 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: Content-Length: 0 Oct 31 12:34:47.445954 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: Content-Type: application/json Oct 31 12:34:47.445954 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: Host: 10.222.0.15 Oct 31 12:34:47.445954 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: Openstack-System-Scope: None Oct 31 12:34:47.445954 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: User-Agent: python-urllib3/1.26.12 Oct 31 12:34:47.445954 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Auth-Token: gAAAAABjX8C230UhMzq--FHcmjg5OLyci8gDh1I11iXRyqu85i5_rMSBy0krijq463RX-XrH-StDzRf-sKRZYk2G229XyMG569gM4JZ1XDCbpqzOYKLy0CGlEDx3Md4h0BziygIWuTxBE8a5IthHCXJXNctMx07zr445RhpdPn5e1uoiw6kgFcY Oct 31 12:34:47.445954 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Domain-Id: None Oct 31 12:34:47.445954 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Domain-Name: None Oct 31 12:34:47.445954 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Identity-Status: Confirmed Oct 31 12:34:47.445954 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Is-Admin-Project: True Oct 31 12:34:47.445954 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Project-Domain-Id: default Oct 31 12:34:47.445954 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Project-Domain-Name: Default Oct 31 12:34:47.445954 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Project-Id: 4fe4270c111747be8d61e4ae993bd7ba Oct 31 12:34:47.445954 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Project-Name: tempest-VolumesActionsTest-5566181 Oct 31 12:34:47.445954 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Role: reader,member Oct 31 12:34:47.445954 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Roles: reader,member Oct 31 12:34:47.447279 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/4fe4270c111747be8d61e4ae993bd7ba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_4fe4270c111747be8d61e4ae993bd7ba", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/4fe4270c111747be8d61e4ae993bd7ba"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/4fe4270c111747be8d61e4ae993bd7ba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Oct 31 12:34:47.447279 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Tenant: tempest-VolumesActionsTest-5566181 Oct 31 12:34:47.447279 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Tenant-Id: 4fe4270c111747be8d61e4ae993bd7ba Oct 31 12:34:47.447279 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Tenant-Name: tempest-VolumesActionsTest-5566181 Oct 31 12:34:47.447279 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-User: tempest-VolumesActionsTest-5566181-project Oct 31 12:34:47.447279 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-User-Domain-Id: default Oct 31 12:34:47.447279 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-User-Domain-Name: Default Oct 31 12:34:47.447279 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-User-Id: 1918cb60ccd04e909b78dca9b0166be9 Oct 31 12:34:47.447279 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-User-Name: tempest-VolumesActionsTest-5566181-project Oct 31 12:34:47.447279 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: method: > Oct 31 12:34:47.447279 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: exception: Instance 8174a16d-3e74-4ec2-82be-deb8d294255b could not be found. Oct 31 12:34:47.447279 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: action_args: {'id': '8174a16d-3e74-4ec2-82be-deb8d294255b'} Oct 31 12:34:47.447968 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 12:34:47.447968 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 12:34:47.447968 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 12:34:47.447968 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 12:34:47.447968 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 12:34:47.447968 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 12:34:47.447968 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 12:34:47.447968 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 12:34:47.447968 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 12:34:47.447968 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 12:34:47.447968 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8174a16d-3e74-4ec2-82be-deb8d294255b could not be found. Oct 31 12:34:47.447968 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Oct 31 12:34:47.447968 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 12:34:47.447968 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Oct 31 12:34:47.447968 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 12:34:47.447968 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 12:34:47.447968 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 12:34:47.447968 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 12:34:47.447968 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 12:34:47.447968 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 12:34:47.449550 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 12:34:47.449550 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 12:34:47.449550 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 12:34:47.449550 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 12:34:47.449550 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 12:34:47.449550 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 12:34:47.449550 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 12:34:47.449550 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8174a16d-3e74-4ec2-82be-deb8d294255b could not be found. Oct 31 12:34:47.449550 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Oct 31 12:34:47.449550 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 12:34:47.449550 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Oct 31 12:34:47.449550 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 12:34:47.449550 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 12:34:47.449550 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 12:34:47.449550 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 12:34:47.449550 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 12:34:47.449550 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8174a16d-3e74-4ec2-82be-deb8d294255b could not be found. Oct 31 12:34:47.449550 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Oct 31 12:34:47.450883 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-e2464ac9-56b2-4771-9047-4c72c719856f tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] Returning 404 to user: Instance 8174a16d-3e74-4ec2-82be-deb8d294255b could not be found. {{(pid=125441) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 12:34:47.450883 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-e2464ac9-56b2-4771-9047-4c72c719856f tempest-VolumesActionsTest-5566181 tempest-VolumesActionsTest-5566181-project] 10.222.0.15 "GET /compute/v2.1/servers/8174a16d-3e74-4ec2-82be-deb8d294255b" status: 404 len: 111 microversion: 2.1 time: 0.075845 Oct 31 12:34:47.453016 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 153/306] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:34:47 2022] GET /compute/v2.1/servers/8174a16d-3e74-4ec2-82be-deb8d294255b => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 12:34:47.479697 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-0b70e974-961d-4642-8d39-a2bb5e641d65 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:34:47.480301 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-0b70e974-961d-4642-8d39-a2bb5e641d65 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] [instance: b8c93a18-ee0e-438e-823c-cf51f9d4985f] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:34:47.487872 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-0b70e974-961d-4642-8d39-a2bb5e641d65 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:34:47.488528 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-0b70e974-961d-4642-8d39-a2bb5e641d65 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:34:47.489457 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-0b70e974-961d-4642-8d39-a2bb5e641d65 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:34:47.490590 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-0b70e974-961d-4642-8d39-a2bb5e641d65 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:34:47.491038 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-0b70e974-961d-4642-8d39-a2bb5e641d65 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:34:47.491708 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-0b70e974-961d-4642-8d39-a2bb5e641d65 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:34:47.595055 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-0b70e974-961d-4642-8d39-a2bb5e641d65 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825059319a204b6da5bc7004b3a09361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14b98f006574deabc030c2e93c680c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:34:47.604564 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-0b70e974-961d-4642-8d39-a2bb5e641d65 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] 10.222.0.15 "GET /compute/v2.1/servers/b8c93a18-ee0e-438e-823c-cf51f9d4985f" status: 200 len: 1186 microversion: 2.1 time: 0.132889 Oct 31 12:34:47.605944 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 154/307] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:34:47 2022] GET /compute/v2.1/servers/b8c93a18-ee0e-438e-823c-cf51f9d4985f => generated 1186 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:34:48.226422 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-68d053a0-c1dc-4490-ba33-1254f5b6cf7d tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:34:48.228741 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-68d053a0-c1dc-4490-ba33-1254f5b6cf7d tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] [instance: d33a2d6b-f17c-4ce3-ad33-9086d790495d] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:34:48.240257 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG dbcounter [-] [125441] Writing DB stats nova_api:SELECT=84,nova_api:UPDATE=2 {{(pid=125441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:34:48.242702 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-68d053a0-c1dc-4490-ba33-1254f5b6cf7d tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:34:48.243486 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-68d053a0-c1dc-4490-ba33-1254f5b6cf7d tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:34:48.244041 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-68d053a0-c1dc-4490-ba33-1254f5b6cf7d tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:34:48.245327 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-68d053a0-c1dc-4490-ba33-1254f5b6cf7d tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:34:48.246237 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-68d053a0-c1dc-4490-ba33-1254f5b6cf7d tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:34:48.246885 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-68d053a0-c1dc-4490-ba33-1254f5b6cf7d tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:34:48.437134 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-68d053a0-c1dc-4490-ba33-1254f5b6cf7d tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2e978bcb824a5e9d593b861c9e3bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7573cb9c503243ab90b1649591d550e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:34:48.455463 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-68d053a0-c1dc-4490-ba33-1254f5b6cf7d tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] 10.222.0.15 "GET /compute/v2.1/servers/d33a2d6b-f17c-4ce3-ad33-9086d790495d" status: 200 len: 1522 microversion: 2.1 time: 0.237038 Oct 31 12:34:48.457568 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 154/308] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:34:48 2022] GET /compute/v2.1/servers/d33a2d6b-f17c-4ce3-ad33-9086d790495d => generated 1522 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:34:48.630672 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-7529c315-d3ad-44cd-aea9-6e2e4311d472 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:34:48.631459 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-7529c315-d3ad-44cd-aea9-6e2e4311d472 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] [instance: b8c93a18-ee0e-438e-823c-cf51f9d4985f] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:34:48.637794 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-7529c315-d3ad-44cd-aea9-6e2e4311d472 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:34:48.638369 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-7529c315-d3ad-44cd-aea9-6e2e4311d472 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:34:48.638885 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-7529c315-d3ad-44cd-aea9-6e2e4311d472 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:34:48.639818 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-7529c315-d3ad-44cd-aea9-6e2e4311d472 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:34:48.640365 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-7529c315-d3ad-44cd-aea9-6e2e4311d472 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:34:48.640873 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-7529c315-d3ad-44cd-aea9-6e2e4311d472 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:34:48.733285 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-7529c315-d3ad-44cd-aea9-6e2e4311d472 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825059319a204b6da5bc7004b3a09361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14b98f006574deabc030c2e93c680c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:34:48.745336 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-7529c315-d3ad-44cd-aea9-6e2e4311d472 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] 10.222.0.15 "GET /compute/v2.1/servers/b8c93a18-ee0e-438e-823c-cf51f9d4985f" status: 200 len: 1204 microversion: 2.1 time: 0.118772 Oct 31 12:34:48.745916 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 155/309] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:34:48 2022] GET /compute/v2.1/servers/b8c93a18-ee0e-438e-823c-cf51f9d4985f => generated 1204 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:34:49.479657 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-2c970489-a742-49d5-9270-0e4be67fcbbf tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:34:49.480447 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-2c970489-a742-49d5-9270-0e4be67fcbbf tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] [instance: d33a2d6b-f17c-4ce3-ad33-9086d790495d] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:34:49.487301 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-2c970489-a742-49d5-9270-0e4be67fcbbf tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:34:49.487790 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-2c970489-a742-49d5-9270-0e4be67fcbbf tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:34:49.488225 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-2c970489-a742-49d5-9270-0e4be67fcbbf tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:34:49.488956 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-2c970489-a742-49d5-9270-0e4be67fcbbf tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:34:49.489404 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-2c970489-a742-49d5-9270-0e4be67fcbbf tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:34:49.489831 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-2c970489-a742-49d5-9270-0e4be67fcbbf tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:34:49.641797 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-2c970489-a742-49d5-9270-0e4be67fcbbf tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2e978bcb824a5e9d593b861c9e3bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7573cb9c503243ab90b1649591d550e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:34:49.650435 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-2c970489-a742-49d5-9270-0e4be67fcbbf tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] 10.222.0.15 "GET /compute/v2.1/servers/d33a2d6b-f17c-4ce3-ad33-9086d790495d" status: 200 len: 1522 microversion: 2.1 time: 0.174584 Oct 31 12:34:49.651821 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 155/310] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:34:49 2022] GET /compute/v2.1/servers/d33a2d6b-f17c-4ce3-ad33-9086d790495d => generated 1522 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:34:49.773766 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-4ea7520f-228c-4165-af44-8f727da51cab tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:34:49.774594 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-4ea7520f-228c-4165-af44-8f727da51cab tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] [instance: b8c93a18-ee0e-438e-823c-cf51f9d4985f] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:34:49.785387 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-4ea7520f-228c-4165-af44-8f727da51cab tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:34:49.785387 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-4ea7520f-228c-4165-af44-8f727da51cab tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:34:49.785387 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-4ea7520f-228c-4165-af44-8f727da51cab tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:34:49.785798 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [req-e0e155d0-8534-4035-9653-8963dd3e41f6 req-a4403e0a-ae36-4252-9d40-ccf0b5703b90 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b8c93a18-ee0e-438e-823c-cf51f9d4985f", "tag": "c444a742-6430-4bab-91f7-bff045443454"}]} {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 12:34:49.785909 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-4ea7520f-228c-4165-af44-8f727da51cab tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:34:49.785909 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-4ea7520f-228c-4165-af44-8f727da51cab tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:34:49.785909 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-4ea7520f-228c-4165-af44-8f727da51cab tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:34:49.793992 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [req-e0e155d0-8534-4035-9653-8963dd3e41f6 req-a4403e0a-ae36-4252-9d40-ccf0b5703b90 service nova] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:34:49.794659 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [req-e0e155d0-8534-4035-9653-8963dd3e41f6 req-a4403e0a-ae36-4252-9d40-ccf0b5703b90 service nova] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:34:49.795321 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [req-e0e155d0-8534-4035-9653-8963dd3e41f6 req-a4403e0a-ae36-4252-9d40-ccf0b5703b90 service nova] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:34:49.808277 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.compute.server_external_events [req-e0e155d0-8534-4035-9653-8963dd3e41f6 req-a4403e0a-ae36-4252-9d40-ccf0b5703b90 service nova] Creating event network-changed:c444a742-6430-4bab-91f7-bff045443454 for instance b8c93a18-ee0e-438e-823c-cf51f9d4985f on hv-cinder-79617 Oct 31 12:34:49.813809 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [req-e0e155d0-8534-4035-9653-8963dd3e41f6 req-a4403e0a-ae36-4252-9d40-ccf0b5703b90 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034290 Oct 31 12:34:49.814651 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 156/311] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Oct 31 12:34:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 12:34:49.948746 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-4ea7520f-228c-4165-af44-8f727da51cab tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825059319a204b6da5bc7004b3a09361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14b98f006574deabc030c2e93c680c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:34:49.957405 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-4ea7520f-228c-4165-af44-8f727da51cab tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] 10.222.0.15 "GET /compute/v2.1/servers/b8c93a18-ee0e-438e-823c-cf51f9d4985f" status: 200 len: 1259 microversion: 2.1 time: 0.189476 Oct 31 12:34:49.957984 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 156/312] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:34:49 2022] GET /compute/v2.1/servers/b8c93a18-ee0e-438e-823c-cf51f9d4985f => generated 1259 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:34:50.146811 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-01fcfdba-5ab6-4a41-bf3c-9d2bf71e04b3 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:34:50.147328 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-01fcfdba-5ab6-4a41-bf3c-9d2bf71e04b3 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] [instance: ff125cf8-e8a5-4f00-ade9-045b18ee33f4] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:34:50.153320 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-01fcfdba-5ab6-4a41-bf3c-9d2bf71e04b3 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:34:50.153799 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-01fcfdba-5ab6-4a41-bf3c-9d2bf71e04b3 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:34:50.154222 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-01fcfdba-5ab6-4a41-bf3c-9d2bf71e04b3 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:34:50.154902 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-01fcfdba-5ab6-4a41-bf3c-9d2bf71e04b3 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:34:50.155379 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-01fcfdba-5ab6-4a41-bf3c-9d2bf71e04b3 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:34:50.155794 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-01fcfdba-5ab6-4a41-bf3c-9d2bf71e04b3 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:34:50.178902 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-01fcfdba-5ab6-4a41-bf3c-9d2bf71e04b3 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] 10.222.0.15 "GET /compute/v2.1/servers/ff125cf8-e8a5-4f00-ade9-045b18ee33f4/ips" status: 200 len: 145 microversion: 2.1 time: 0.036870 Oct 31 12:34:50.179477 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 157/313] 10.222.0.15 () {58 vars in 1248 bytes} [Mon Oct 31 12:34:50 2022] GET /compute/v2.1/servers/ff125cf8-e8a5-4f00-ade9-045b18ee33f4/ips => generated 145 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 12:34:50.674825 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-80e80afc-19c4-44b1-bfed-4e6f455949eb tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:34:50.675380 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-80e80afc-19c4-44b1-bfed-4e6f455949eb tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] [instance: d33a2d6b-f17c-4ce3-ad33-9086d790495d] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:34:50.681292 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-80e80afc-19c4-44b1-bfed-4e6f455949eb tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:34:50.681757 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-80e80afc-19c4-44b1-bfed-4e6f455949eb tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:34:50.682177 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-80e80afc-19c4-44b1-bfed-4e6f455949eb tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:34:50.682882 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-80e80afc-19c4-44b1-bfed-4e6f455949eb tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:34:50.683354 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-80e80afc-19c4-44b1-bfed-4e6f455949eb tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:34:50.683766 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-80e80afc-19c4-44b1-bfed-4e6f455949eb tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:34:50.813049 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-80e80afc-19c4-44b1-bfed-4e6f455949eb tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2e978bcb824a5e9d593b861c9e3bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7573cb9c503243ab90b1649591d550e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:34:50.820643 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-80e80afc-19c4-44b1-bfed-4e6f455949eb tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] 10.222.0.15 "GET /compute/v2.1/servers/d33a2d6b-f17c-4ce3-ad33-9086d790495d" status: 200 len: 1522 microversion: 2.1 time: 0.150301 Oct 31 12:34:50.821489 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 157/314] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:34:50 2022] GET /compute/v2.1/servers/d33a2d6b-f17c-4ce3-ad33-9086d790495d => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:34:50.980873 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-935bc4e9-c041-4df4-a860-219bec27ffbb tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:34:50.981482 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-935bc4e9-c041-4df4-a860-219bec27ffbb tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] [instance: b8c93a18-ee0e-438e-823c-cf51f9d4985f] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:34:50.987385 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-935bc4e9-c041-4df4-a860-219bec27ffbb tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:34:50.987868 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-935bc4e9-c041-4df4-a860-219bec27ffbb tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:34:50.988293 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-935bc4e9-c041-4df4-a860-219bec27ffbb tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:34:50.988976 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-935bc4e9-c041-4df4-a860-219bec27ffbb tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:34:50.989423 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-935bc4e9-c041-4df4-a860-219bec27ffbb tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:34:50.989839 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-935bc4e9-c041-4df4-a860-219bec27ffbb tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:34:51.121276 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-935bc4e9-c041-4df4-a860-219bec27ffbb tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825059319a204b6da5bc7004b3a09361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14b98f006574deabc030c2e93c680c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:34:51.129177 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-935bc4e9-c041-4df4-a860-219bec27ffbb tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] 10.222.0.15 "GET /compute/v2.1/servers/b8c93a18-ee0e-438e-823c-cf51f9d4985f" status: 200 len: 1259 microversion: 2.1 time: 0.152192 Oct 31 12:34:51.129740 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 158/315] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:34:50 2022] GET /compute/v2.1/servers/b8c93a18-ee0e-438e-823c-cf51f9d4985f => generated 1259 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:34:51.847279 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-ed63227c-264b-4aa4-98fb-1c58c3440e11 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:34:51.848252 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-ed63227c-264b-4aa4-98fb-1c58c3440e11 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] [instance: d33a2d6b-f17c-4ce3-ad33-9086d790495d] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:34:51.855790 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-ed63227c-264b-4aa4-98fb-1c58c3440e11 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:34:51.856446 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-ed63227c-264b-4aa4-98fb-1c58c3440e11 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:34:51.856932 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-ed63227c-264b-4aa4-98fb-1c58c3440e11 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:34:51.857866 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-ed63227c-264b-4aa4-98fb-1c58c3440e11 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:34:51.858559 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-ed63227c-264b-4aa4-98fb-1c58c3440e11 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:34:51.859018 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-ed63227c-264b-4aa4-98fb-1c58c3440e11 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:34:52.152389 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-9d7ff05d-04ac-4d73-b20a-aec40dc2c634 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:34:52.153919 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-9d7ff05d-04ac-4d73-b20a-aec40dc2c634 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] [instance: b8c93a18-ee0e-438e-823c-cf51f9d4985f] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:34:52.162232 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-9d7ff05d-04ac-4d73-b20a-aec40dc2c634 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:34:52.162928 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-9d7ff05d-04ac-4d73-b20a-aec40dc2c634 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:34:52.163715 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-9d7ff05d-04ac-4d73-b20a-aec40dc2c634 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:34:52.164714 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-9d7ff05d-04ac-4d73-b20a-aec40dc2c634 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:34:52.165817 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-9d7ff05d-04ac-4d73-b20a-aec40dc2c634 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:34:52.166576 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-9d7ff05d-04ac-4d73-b20a-aec40dc2c634 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:34:52.200415 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-ed63227c-264b-4aa4-98fb-1c58c3440e11 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2e978bcb824a5e9d593b861c9e3bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7573cb9c503243ab90b1649591d550e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:34:52.211754 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-ed63227c-264b-4aa4-98fb-1c58c3440e11 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] 10.222.0.15 "GET /compute/v2.1/servers/d33a2d6b-f17c-4ce3-ad33-9086d790495d" status: 200 len: 1522 microversion: 2.1 time: 0.370353 Oct 31 12:34:52.212328 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 158/316] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:34:51 2022] GET /compute/v2.1/servers/d33a2d6b-f17c-4ce3-ad33-9086d790495d => generated 1522 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:34:52.348454 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-9d7ff05d-04ac-4d73-b20a-aec40dc2c634 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825059319a204b6da5bc7004b3a09361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14b98f006574deabc030c2e93c680c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:34:52.356043 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-9d7ff05d-04ac-4d73-b20a-aec40dc2c634 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] 10.222.0.15 "GET /compute/v2.1/servers/b8c93a18-ee0e-438e-823c-cf51f9d4985f" status: 200 len: 1259 microversion: 2.1 time: 0.208012 Oct 31 12:34:52.356605 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 159/317] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:34:52 2022] GET /compute/v2.1/servers/b8c93a18-ee0e-438e-823c-cf51f9d4985f => generated 1259 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 12:34:53.236504 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-85824c7a-802b-4737-bd1c-2100035059c9 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:34:53.237093 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-85824c7a-802b-4737-bd1c-2100035059c9 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] [instance: d33a2d6b-f17c-4ce3-ad33-9086d790495d] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:34:53.243620 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-85824c7a-802b-4737-bd1c-2100035059c9 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:34:53.244124 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-85824c7a-802b-4737-bd1c-2100035059c9 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:34:53.244559 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-85824c7a-802b-4737-bd1c-2100035059c9 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:34:53.245244 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-85824c7a-802b-4737-bd1c-2100035059c9 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:34:53.245874 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-85824c7a-802b-4737-bd1c-2100035059c9 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:34:53.246294 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-85824c7a-802b-4737-bd1c-2100035059c9 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:34:53.382097 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-624cf330-00bb-44b5-bf38-7ab678740cde tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:34:53.384263 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-624cf330-00bb-44b5-bf38-7ab678740cde tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] [instance: b8c93a18-ee0e-438e-823c-cf51f9d4985f] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:34:53.392354 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-624cf330-00bb-44b5-bf38-7ab678740cde tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:34:53.393223 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-624cf330-00bb-44b5-bf38-7ab678740cde tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:34:53.394049 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-624cf330-00bb-44b5-bf38-7ab678740cde tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:34:53.395027 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-624cf330-00bb-44b5-bf38-7ab678740cde tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:34:53.395959 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-624cf330-00bb-44b5-bf38-7ab678740cde tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:34:53.396541 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-624cf330-00bb-44b5-bf38-7ab678740cde tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:34:53.424697 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-85824c7a-802b-4737-bd1c-2100035059c9 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2e978bcb824a5e9d593b861c9e3bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7573cb9c503243ab90b1649591d550e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:34:53.435207 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-85824c7a-802b-4737-bd1c-2100035059c9 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] 10.222.0.15 "GET /compute/v2.1/servers/d33a2d6b-f17c-4ce3-ad33-9086d790495d" status: 200 len: 1522 microversion: 2.1 time: 0.202940 Oct 31 12:34:53.436329 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 159/318] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:34:53 2022] GET /compute/v2.1/servers/d33a2d6b-f17c-4ce3-ad33-9086d790495d => generated 1522 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:34:53.635062 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-624cf330-00bb-44b5-bf38-7ab678740cde tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825059319a204b6da5bc7004b3a09361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14b98f006574deabc030c2e93c680c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:34:53.650700 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-624cf330-00bb-44b5-bf38-7ab678740cde tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] 10.222.0.15 "GET /compute/v2.1/servers/b8c93a18-ee0e-438e-823c-cf51f9d4985f" status: 200 len: 1259 microversion: 2.1 time: 0.266988 Oct 31 12:34:53.651714 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 160/319] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:34:53 2022] GET /compute/v2.1/servers/b8c93a18-ee0e-438e-823c-cf51f9d4985f => generated 1259 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 12:34:54.034786 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG dbcounter [-] [125440] Writing DB stats nova_cell0:SELECT=2 {{(pid=125440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:34:54.039108 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG dbcounter [-] [125440] Writing DB stats nova_cell0:SELECT=6 {{(pid=125440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:34:54.051534 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-96759aa0-5c33-40a7-9564-a483da0baf5a tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b801eb89-6de1-49ea-91a0-f33ec1b7401f"}} {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 12:34:54.054335 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-96759aa0-5c33-40a7-9564-a483da0baf5a tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] [instance: ff125cf8-e8a5-4f00-ade9-045b18ee33f4] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:34:54.065321 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-96759aa0-5c33-40a7-9564-a483da0baf5a tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:34:54.066627 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-96759aa0-5c33-40a7-9564-a483da0baf5a tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:34:54.067357 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-96759aa0-5c33-40a7-9564-a483da0baf5a tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:34:54.068351 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-96759aa0-5c33-40a7-9564-a483da0baf5a tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:34:54.069039 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-96759aa0-5c33-40a7-9564-a483da0baf5a tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:34:54.070042 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-96759aa0-5c33-40a7-9564-a483da0baf5a tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:34:54.461254 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-a034397e-8ea8-4ec2-a4e4-1c2e573bff0d tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:34:54.461914 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-a034397e-8ea8-4ec2-a4e4-1c2e573bff0d tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] [instance: d33a2d6b-f17c-4ce3-ad33-9086d790495d] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:34:54.465612 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG dbcounter [-] [125441] Writing DB stats nova_cell0:SELECT=2 {{(pid=125441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:34:54.472866 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-a034397e-8ea8-4ec2-a4e4-1c2e573bff0d tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:34:54.473721 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-a034397e-8ea8-4ec2-a4e4-1c2e573bff0d tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:34:54.474537 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-a034397e-8ea8-4ec2-a4e4-1c2e573bff0d tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:34:54.475619 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-a034397e-8ea8-4ec2-a4e4-1c2e573bff0d tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:34:54.476298 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-a034397e-8ea8-4ec2-a4e4-1c2e573bff0d tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:34:54.476921 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-a034397e-8ea8-4ec2-a4e4-1c2e573bff0d tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:34:54.654296 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-a034397e-8ea8-4ec2-a4e4-1c2e573bff0d tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2e978bcb824a5e9d593b861c9e3bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7573cb9c503243ab90b1649591d550e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:34:54.662887 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-a034397e-8ea8-4ec2-a4e4-1c2e573bff0d tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] 10.222.0.15 "GET /compute/v2.1/servers/d33a2d6b-f17c-4ce3-ad33-9086d790495d" status: 200 len: 1522 microversion: 2.1 time: 0.206307 Oct 31 12:34:54.664073 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 161/320] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:34:54 2022] GET /compute/v2.1/servers/d33a2d6b-f17c-4ce3-ad33-9086d790495d => generated 1522 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:34:54.685526 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-7ae505ac-f5c2-4659-984a-e04b511b0b78 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:34:54.686443 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-7ae505ac-f5c2-4659-984a-e04b511b0b78 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] [instance: b8c93a18-ee0e-438e-823c-cf51f9d4985f] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:34:54.693788 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-7ae505ac-f5c2-4659-984a-e04b511b0b78 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:34:54.694494 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-7ae505ac-f5c2-4659-984a-e04b511b0b78 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:34:54.694923 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-7ae505ac-f5c2-4659-984a-e04b511b0b78 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:34:54.695651 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-7ae505ac-f5c2-4659-984a-e04b511b0b78 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:34:54.696237 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-7ae505ac-f5c2-4659-984a-e04b511b0b78 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:34:54.696801 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-7ae505ac-f5c2-4659-984a-e04b511b0b78 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:34:54.744771 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-96759aa0-5c33-40a7-9564-a483da0baf5a tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] 10.222.0.15 "POST /compute/v2.1/servers/ff125cf8-e8a5-4f00-ade9-045b18ee33f4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.710412 Oct 31 12:34:54.746693 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 160/321] 10.222.0.15 () {60 vars in 1323 bytes} [Mon Oct 31 12:34:54 2022] POST /compute/v2.1/servers/ff125cf8-e8a5-4f00-ade9-045b18ee33f4/os-volume_attachments => generated 194 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 12:34:54.907930 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-7ae505ac-f5c2-4659-984a-e04b511b0b78 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825059319a204b6da5bc7004b3a09361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14b98f006574deabc030c2e93c680c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:34:54.921902 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-7ae505ac-f5c2-4659-984a-e04b511b0b78 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] 10.222.0.15 "GET /compute/v2.1/servers/b8c93a18-ee0e-438e-823c-cf51f9d4985f" status: 200 len: 1259 microversion: 2.1 time: 0.240965 Oct 31 12:34:54.925971 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 162/322] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:34:54 2022] GET /compute/v2.1/servers/b8c93a18-ee0e-438e-823c-cf51f9d4985f => generated 1259 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 12:34:55.697048 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-731f28db-208a-4674-8c1e-3deab0b88442 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:34:55.698763 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-731f28db-208a-4674-8c1e-3deab0b88442 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] [instance: d33a2d6b-f17c-4ce3-ad33-9086d790495d] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:34:55.709409 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-731f28db-208a-4674-8c1e-3deab0b88442 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:34:55.709975 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-731f28db-208a-4674-8c1e-3deab0b88442 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:34:55.710484 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-731f28db-208a-4674-8c1e-3deab0b88442 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:34:55.711304 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-731f28db-208a-4674-8c1e-3deab0b88442 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:34:55.712231 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-731f28db-208a-4674-8c1e-3deab0b88442 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:34:55.712883 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-731f28db-208a-4674-8c1e-3deab0b88442 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:34:55.869927 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-731f28db-208a-4674-8c1e-3deab0b88442 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2e978bcb824a5e9d593b861c9e3bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7573cb9c503243ab90b1649591d550e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:34:55.879414 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-731f28db-208a-4674-8c1e-3deab0b88442 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] 10.222.0.15 "GET /compute/v2.1/servers/d33a2d6b-f17c-4ce3-ad33-9086d790495d" status: 200 len: 1522 microversion: 2.1 time: 0.193371 Oct 31 12:34:55.880032 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 161/323] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:34:55 2022] GET /compute/v2.1/servers/d33a2d6b-f17c-4ce3-ad33-9086d790495d => generated 1522 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:34:55.948696 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-a50f0ff3-01fb-4558-860f-8753196b4f25 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:34:55.949604 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-a50f0ff3-01fb-4558-860f-8753196b4f25 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] [instance: b8c93a18-ee0e-438e-823c-cf51f9d4985f] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:34:55.956791 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-a50f0ff3-01fb-4558-860f-8753196b4f25 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:34:55.957269 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-a50f0ff3-01fb-4558-860f-8753196b4f25 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:34:55.957727 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-a50f0ff3-01fb-4558-860f-8753196b4f25 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:34:55.958415 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-a50f0ff3-01fb-4558-860f-8753196b4f25 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:34:55.958864 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-a50f0ff3-01fb-4558-860f-8753196b4f25 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:34:55.959331 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-a50f0ff3-01fb-4558-860f-8753196b4f25 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:34:56.112284 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-a50f0ff3-01fb-4558-860f-8753196b4f25 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825059319a204b6da5bc7004b3a09361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14b98f006574deabc030c2e93c680c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:34:56.120602 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-a50f0ff3-01fb-4558-860f-8753196b4f25 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] 10.222.0.15 "GET /compute/v2.1/servers/b8c93a18-ee0e-438e-823c-cf51f9d4985f" status: 200 len: 1259 microversion: 2.1 time: 0.176092 Oct 31 12:34:56.121326 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 163/324] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:34:55 2022] GET /compute/v2.1/servers/b8c93a18-ee0e-438e-823c-cf51f9d4985f => generated 1259 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:34:56.903807 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-366559ca-4d38-4176-82ef-6e639fb9e533 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:34:56.904430 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-366559ca-4d38-4176-82ef-6e639fb9e533 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] [instance: d33a2d6b-f17c-4ce3-ad33-9086d790495d] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:34:56.911850 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-366559ca-4d38-4176-82ef-6e639fb9e533 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:34:56.912351 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-366559ca-4d38-4176-82ef-6e639fb9e533 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:34:56.912883 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-366559ca-4d38-4176-82ef-6e639fb9e533 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:34:56.913592 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-366559ca-4d38-4176-82ef-6e639fb9e533 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:34:56.914016 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-366559ca-4d38-4176-82ef-6e639fb9e533 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:34:56.914430 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-366559ca-4d38-4176-82ef-6e639fb9e533 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:34:57.110787 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-366559ca-4d38-4176-82ef-6e639fb9e533 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2e978bcb824a5e9d593b861c9e3bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7573cb9c503243ab90b1649591d550e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:34:57.120548 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-366559ca-4d38-4176-82ef-6e639fb9e533 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] 10.222.0.15 "GET /compute/v2.1/servers/d33a2d6b-f17c-4ce3-ad33-9086d790495d" status: 200 len: 1522 microversion: 2.1 time: 0.220536 Oct 31 12:34:57.122110 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 162/325] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:34:56 2022] GET /compute/v2.1/servers/d33a2d6b-f17c-4ce3-ad33-9086d790495d => generated 1522 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:34:57.144617 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-6899cd4a-f0f5-4897-91bc-583fd1f0d48e tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:34:57.145872 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-6899cd4a-f0f5-4897-91bc-583fd1f0d48e tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] [instance: b8c93a18-ee0e-438e-823c-cf51f9d4985f] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:34:57.157603 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-6899cd4a-f0f5-4897-91bc-583fd1f0d48e tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:34:57.158410 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-6899cd4a-f0f5-4897-91bc-583fd1f0d48e tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:34:57.159036 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-6899cd4a-f0f5-4897-91bc-583fd1f0d48e tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:34:57.159826 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-6899cd4a-f0f5-4897-91bc-583fd1f0d48e tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:34:57.160344 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-6899cd4a-f0f5-4897-91bc-583fd1f0d48e tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:34:57.160844 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-6899cd4a-f0f5-4897-91bc-583fd1f0d48e tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:34:57.320510 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-6899cd4a-f0f5-4897-91bc-583fd1f0d48e tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825059319a204b6da5bc7004b3a09361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14b98f006574deabc030c2e93c680c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:34:57.329063 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-6899cd4a-f0f5-4897-91bc-583fd1f0d48e tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] 10.222.0.15 "GET /compute/v2.1/servers/b8c93a18-ee0e-438e-823c-cf51f9d4985f" status: 200 len: 1259 microversion: 2.1 time: 0.188941 Oct 31 12:34:57.331348 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 164/326] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:34:57 2022] GET /compute/v2.1/servers/b8c93a18-ee0e-438e-823c-cf51f9d4985f => generated 1259 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:34:58.145969 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-49cebd49-fb8d-4f3e-8b56-b7330648e8b1 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:34:58.146648 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-49cebd49-fb8d-4f3e-8b56-b7330648e8b1 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] [instance: d33a2d6b-f17c-4ce3-ad33-9086d790495d] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:34:58.158102 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-49cebd49-fb8d-4f3e-8b56-b7330648e8b1 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:34:58.159033 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-49cebd49-fb8d-4f3e-8b56-b7330648e8b1 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:34:58.159702 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-49cebd49-fb8d-4f3e-8b56-b7330648e8b1 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:34:58.160866 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-49cebd49-fb8d-4f3e-8b56-b7330648e8b1 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:34:58.161679 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-49cebd49-fb8d-4f3e-8b56-b7330648e8b1 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:34:58.162271 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-49cebd49-fb8d-4f3e-8b56-b7330648e8b1 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:34:58.332954 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-49cebd49-fb8d-4f3e-8b56-b7330648e8b1 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2e978bcb824a5e9d593b861c9e3bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7573cb9c503243ab90b1649591d550e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:34:58.342877 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-49cebd49-fb8d-4f3e-8b56-b7330648e8b1 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] 10.222.0.15 "GET /compute/v2.1/servers/d33a2d6b-f17c-4ce3-ad33-9086d790495d" status: 200 len: 1522 microversion: 2.1 time: 0.201584 Oct 31 12:34:58.344721 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 163/327] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:34:58 2022] GET /compute/v2.1/servers/d33a2d6b-f17c-4ce3-ad33-9086d790495d => generated 1522 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:34:58.351839 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-5e718ce9-4469-4580-bc32-2aa5cbc392cc tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:34:58.352455 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-5e718ce9-4469-4580-bc32-2aa5cbc392cc tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] [instance: b8c93a18-ee0e-438e-823c-cf51f9d4985f] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:34:58.361685 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-5e718ce9-4469-4580-bc32-2aa5cbc392cc tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:34:58.364587 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-5e718ce9-4469-4580-bc32-2aa5cbc392cc tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:34:58.365298 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-5e718ce9-4469-4580-bc32-2aa5cbc392cc tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:34:58.366331 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-5e718ce9-4469-4580-bc32-2aa5cbc392cc tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:34:58.367260 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-5e718ce9-4469-4580-bc32-2aa5cbc392cc tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:34:58.368256 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-5e718ce9-4469-4580-bc32-2aa5cbc392cc tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:34:58.574691 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-5e718ce9-4469-4580-bc32-2aa5cbc392cc tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825059319a204b6da5bc7004b3a09361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14b98f006574deabc030c2e93c680c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:34:58.585390 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-5e718ce9-4469-4580-bc32-2aa5cbc392cc tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] 10.222.0.15 "GET /compute/v2.1/servers/b8c93a18-ee0e-438e-823c-cf51f9d4985f" status: 200 len: 1259 microversion: 2.1 time: 0.237317 Oct 31 12:34:58.598112 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 165/328] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:34:58 2022] GET /compute/v2.1/servers/b8c93a18-ee0e-438e-823c-cf51f9d4985f => generated 1259 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:34:59.368519 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-103171f4-16ba-4f35-8c7a-8ae0e28ae4a4 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:34:59.369328 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-103171f4-16ba-4f35-8c7a-8ae0e28ae4a4 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] [instance: d33a2d6b-f17c-4ce3-ad33-9086d790495d] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:34:59.386141 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-103171f4-16ba-4f35-8c7a-8ae0e28ae4a4 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:34:59.386717 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-103171f4-16ba-4f35-8c7a-8ae0e28ae4a4 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:34:59.387957 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-103171f4-16ba-4f35-8c7a-8ae0e28ae4a4 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:34:59.388920 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-103171f4-16ba-4f35-8c7a-8ae0e28ae4a4 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:34:59.389567 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-103171f4-16ba-4f35-8c7a-8ae0e28ae4a4 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:34:59.390179 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-103171f4-16ba-4f35-8c7a-8ae0e28ae4a4 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:34:59.549349 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-103171f4-16ba-4f35-8c7a-8ae0e28ae4a4 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2e978bcb824a5e9d593b861c9e3bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7573cb9c503243ab90b1649591d550e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:34:59.560065 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-103171f4-16ba-4f35-8c7a-8ae0e28ae4a4 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] 10.222.0.15 "GET /compute/v2.1/servers/d33a2d6b-f17c-4ce3-ad33-9086d790495d" status: 200 len: 1522 microversion: 2.1 time: 0.194922 Oct 31 12:34:59.560811 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 164/329] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:34:59 2022] GET /compute/v2.1/servers/d33a2d6b-f17c-4ce3-ad33-9086d790495d => generated 1522 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:34:59.621941 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-d2d8e300-22ef-4e4c-8c69-4be7f9830cc8 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:34:59.622467 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-d2d8e300-22ef-4e4c-8c69-4be7f9830cc8 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] [instance: b8c93a18-ee0e-438e-823c-cf51f9d4985f] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:34:59.629839 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-d2d8e300-22ef-4e4c-8c69-4be7f9830cc8 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:34:59.630537 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-d2d8e300-22ef-4e4c-8c69-4be7f9830cc8 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:34:59.630961 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-d2d8e300-22ef-4e4c-8c69-4be7f9830cc8 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:34:59.631857 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-d2d8e300-22ef-4e4c-8c69-4be7f9830cc8 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:34:59.632309 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-d2d8e300-22ef-4e4c-8c69-4be7f9830cc8 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:34:59.632735 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-d2d8e300-22ef-4e4c-8c69-4be7f9830cc8 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:34:59.792278 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-d2d8e300-22ef-4e4c-8c69-4be7f9830cc8 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825059319a204b6da5bc7004b3a09361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14b98f006574deabc030c2e93c680c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:34:59.801231 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-d2d8e300-22ef-4e4c-8c69-4be7f9830cc8 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] 10.222.0.15 "GET /compute/v2.1/servers/b8c93a18-ee0e-438e-823c-cf51f9d4985f" status: 200 len: 1259 microversion: 2.1 time: 0.183179 Oct 31 12:34:59.803200 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 166/330] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:34:59 2022] GET /compute/v2.1/servers/b8c93a18-ee0e-438e-823c-cf51f9d4985f => generated 1259 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:35:00.588441 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-33a70cc1-7ec0-4a4d-bf06-03191607ddf8 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:35:00.589195 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-33a70cc1-7ec0-4a4d-bf06-03191607ddf8 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] [instance: d33a2d6b-f17c-4ce3-ad33-9086d790495d] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:35:00.598123 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-33a70cc1-7ec0-4a4d-bf06-03191607ddf8 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:00.599076 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-33a70cc1-7ec0-4a4d-bf06-03191607ddf8 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:00.599913 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-33a70cc1-7ec0-4a4d-bf06-03191607ddf8 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:00.600761 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-33a70cc1-7ec0-4a4d-bf06-03191607ddf8 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:00.601523 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-33a70cc1-7ec0-4a4d-bf06-03191607ddf8 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:00.602106 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-33a70cc1-7ec0-4a4d-bf06-03191607ddf8 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:00.804744 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-33a70cc1-7ec0-4a4d-bf06-03191607ddf8 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2e978bcb824a5e9d593b861c9e3bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7573cb9c503243ab90b1649591d550e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:35:00.816142 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-33a70cc1-7ec0-4a4d-bf06-03191607ddf8 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] 10.222.0.15 "GET /compute/v2.1/servers/d33a2d6b-f17c-4ce3-ad33-9086d790495d" status: 200 len: 1522 microversion: 2.1 time: 0.231703 Oct 31 12:35:00.832637 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 165/331] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:35:00 2022] GET /compute/v2.1/servers/d33a2d6b-f17c-4ce3-ad33-9086d790495d => generated 1522 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:35:00.835404 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-a94b4380-24e9-4d78-83dc-2887290f1c2d tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:35:00.836524 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-a94b4380-24e9-4d78-83dc-2887290f1c2d tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] [instance: b8c93a18-ee0e-438e-823c-cf51f9d4985f] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:35:00.845312 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-a94b4380-24e9-4d78-83dc-2887290f1c2d tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:00.846077 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-a94b4380-24e9-4d78-83dc-2887290f1c2d tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:00.846882 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-a94b4380-24e9-4d78-83dc-2887290f1c2d tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:00.847821 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-a94b4380-24e9-4d78-83dc-2887290f1c2d tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:00.848688 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-a94b4380-24e9-4d78-83dc-2887290f1c2d tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:00.849340 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-a94b4380-24e9-4d78-83dc-2887290f1c2d tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:01.020170 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-a94b4380-24e9-4d78-83dc-2887290f1c2d tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825059319a204b6da5bc7004b3a09361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14b98f006574deabc030c2e93c680c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:35:01.041327 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-a94b4380-24e9-4d78-83dc-2887290f1c2d tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] 10.222.0.15 "GET /compute/v2.1/servers/b8c93a18-ee0e-438e-823c-cf51f9d4985f" status: 200 len: 1259 microversion: 2.1 time: 0.220460 Oct 31 12:35:01.042281 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 167/332] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:35:00 2022] GET /compute/v2.1/servers/b8c93a18-ee0e-438e-823c-cf51f9d4985f => generated 1259 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 12:35:01.853320 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-29b7554d-0acd-4a12-bc03-e5d4718a962a tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:35:01.858821 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-29b7554d-0acd-4a12-bc03-e5d4718a962a tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] [instance: d33a2d6b-f17c-4ce3-ad33-9086d790495d] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:35:01.870786 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-29b7554d-0acd-4a12-bc03-e5d4718a962a tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:01.873845 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-29b7554d-0acd-4a12-bc03-e5d4718a962a tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:01.875709 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-29b7554d-0acd-4a12-bc03-e5d4718a962a tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:01.877326 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-29b7554d-0acd-4a12-bc03-e5d4718a962a tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:01.878070 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-29b7554d-0acd-4a12-bc03-e5d4718a962a tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:01.883386 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-29b7554d-0acd-4a12-bc03-e5d4718a962a tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:01.890067 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG dbcounter [-] [125440] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:35:02.077033 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-29b7554d-0acd-4a12-bc03-e5d4718a962a tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2e978bcb824a5e9d593b861c9e3bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7573cb9c503243ab90b1649591d550e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:35:02.081418 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-081c0587-9c47-47d6-abba-81d05b3dd7f8 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:35:02.082035 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-081c0587-9c47-47d6-abba-81d05b3dd7f8 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] [instance: b8c93a18-ee0e-438e-823c-cf51f9d4985f] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:35:02.096796 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-29b7554d-0acd-4a12-bc03-e5d4718a962a tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] 10.222.0.15 "GET /compute/v2.1/servers/d33a2d6b-f17c-4ce3-ad33-9086d790495d" status: 200 len: 1522 microversion: 2.1 time: 0.252975 Oct 31 12:35:02.098470 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-081c0587-9c47-47d6-abba-81d05b3dd7f8 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:02.099790 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 166/333] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:35:01 2022] GET /compute/v2.1/servers/d33a2d6b-f17c-4ce3-ad33-9086d790495d => generated 1522 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:35:02.100481 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-081c0587-9c47-47d6-abba-81d05b3dd7f8 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:02.101097 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-081c0587-9c47-47d6-abba-81d05b3dd7f8 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:02.102088 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-081c0587-9c47-47d6-abba-81d05b3dd7f8 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:02.103767 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-081c0587-9c47-47d6-abba-81d05b3dd7f8 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:02.104376 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-081c0587-9c47-47d6-abba-81d05b3dd7f8 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:02.536681 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-081c0587-9c47-47d6-abba-81d05b3dd7f8 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825059319a204b6da5bc7004b3a09361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14b98f006574deabc030c2e93c680c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:35:02.546988 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-081c0587-9c47-47d6-abba-81d05b3dd7f8 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] 10.222.0.15 "GET /compute/v2.1/servers/b8c93a18-ee0e-438e-823c-cf51f9d4985f" status: 200 len: 1259 microversion: 2.1 time: 0.473742 Oct 31 12:35:02.563286 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 168/334] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:35:02 2022] GET /compute/v2.1/servers/b8c93a18-ee0e-438e-823c-cf51f9d4985f => generated 1259 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:35:02.610729 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-42e3df85-6547-478c-a486-50c4bc20ab71 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 12:35:02.616985 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-42e3df85-6547-478c-a486-50c4bc20ab71 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:02.619203 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-42e3df85-6547-478c-a486-50c4bc20ab71 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:02.619915 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-42e3df85-6547-478c-a486-50c4bc20ab71 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:02.686812 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-42e3df85-6547-478c-a486-50c4bc20ab71 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] [instance: ff125cf8-e8a5-4f00-ade9-045b18ee33f4] Going to try to stop instance {{(pid=125440) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 31 12:35:02.773140 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-42e3df85-6547-478c-a486-50c4bc20ab71 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] 10.222.0.15 "POST /compute/v2.1/servers/ff125cf8-e8a5-4f00-ade9-045b18ee33f4/action" status: 202 len: 0 microversion: 2.1 time: 0.165833 Oct 31 12:35:02.774242 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 167/335] 10.222.0.15 () {60 vars in 1278 bytes} [Mon Oct 31 12:35:02 2022] POST /compute/v2.1/servers/ff125cf8-e8a5-4f00-ade9-045b18ee33f4/action => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 12:35:02.783329 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-81d3dc46-7bcc-4e19-a908-6ba6ceedcde2 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:35:02.783978 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-81d3dc46-7bcc-4e19-a908-6ba6ceedcde2 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] [instance: ff125cf8-e8a5-4f00-ade9-045b18ee33f4] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:35:02.790707 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-81d3dc46-7bcc-4e19-a908-6ba6ceedcde2 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:02.791234 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-81d3dc46-7bcc-4e19-a908-6ba6ceedcde2 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:02.791674 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-81d3dc46-7bcc-4e19-a908-6ba6ceedcde2 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:02.792463 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-81d3dc46-7bcc-4e19-a908-6ba6ceedcde2 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:02.792930 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-81d3dc46-7bcc-4e19-a908-6ba6ceedcde2 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:02.793598 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-81d3dc46-7bcc-4e19-a908-6ba6ceedcde2 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:02.797284 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG dbcounter [-] [125441] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:35:02.978515 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-81d3dc46-7bcc-4e19-a908-6ba6ceedcde2 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c1beb321e44908ab987b17f7b74484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a2bf9a5a484523a700e4e6c568d4de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:35:02.989898 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-81d3dc46-7bcc-4e19-a908-6ba6ceedcde2 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] 10.222.0.15 "GET /compute/v2.1/servers/ff125cf8-e8a5-4f00-ade9-045b18ee33f4" status: 200 len: 1724 microversion: 2.1 time: 0.210687 Oct 31 12:35:03.001756 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 169/336] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:35:02 2022] GET /compute/v2.1/servers/ff125cf8-e8a5-4f00-ade9-045b18ee33f4 => generated 1724 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:35:03.110578 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [req-d0cac26b-21eb-4f71-95f3-7209607d3b0d req-2426b123-de05-4c7a-9ba6-3cbc0d797933 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8c93a18-ee0e-438e-823c-cf51f9d4985f", "name": "network-vif-plugged", "status": "completed", "tag": "c444a742-6430-4bab-91f7-bff045443454"}]} {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 12:35:03.134025 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-076ab817-7846-44ce-9f8e-3125ab876e77 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:35:03.135787 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-076ab817-7846-44ce-9f8e-3125ab876e77 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] [instance: d33a2d6b-f17c-4ce3-ad33-9086d790495d] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:35:03.162222 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-076ab817-7846-44ce-9f8e-3125ab876e77 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:03.162949 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-076ab817-7846-44ce-9f8e-3125ab876e77 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:03.163580 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-076ab817-7846-44ce-9f8e-3125ab876e77 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:03.165025 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-076ab817-7846-44ce-9f8e-3125ab876e77 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:03.165651 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-076ab817-7846-44ce-9f8e-3125ab876e77 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:03.166355 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-076ab817-7846-44ce-9f8e-3125ab876e77 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:03.169977 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [req-d0cac26b-21eb-4f71-95f3-7209607d3b0d req-2426b123-de05-4c7a-9ba6-3cbc0d797933 service nova] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:03.170463 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [req-d0cac26b-21eb-4f71-95f3-7209607d3b0d req-2426b123-de05-4c7a-9ba6-3cbc0d797933 service nova] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:03.170889 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [req-d0cac26b-21eb-4f71-95f3-7209607d3b0d req-2426b123-de05-4c7a-9ba6-3cbc0d797933 service nova] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:03.195294 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.compute.server_external_events [req-d0cac26b-21eb-4f71-95f3-7209607d3b0d req-2426b123-de05-4c7a-9ba6-3cbc0d797933 service nova] Creating event network-vif-plugged:c444a742-6430-4bab-91f7-bff045443454 for instance b8c93a18-ee0e-438e-823c-cf51f9d4985f on hv-cinder-79617 Oct 31 12:35:03.208951 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [req-d0cac26b-21eb-4f71-95f3-7209607d3b0d req-2426b123-de05-4c7a-9ba6-3cbc0d797933 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105488 Oct 31 12:35:03.226248 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 168/337] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Oct 31 12:35:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 12:35:03.329632 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-076ab817-7846-44ce-9f8e-3125ab876e77 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2e978bcb824a5e9d593b861c9e3bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7573cb9c503243ab90b1649591d550e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:35:03.338000 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-076ab817-7846-44ce-9f8e-3125ab876e77 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] 10.222.0.15 "GET /compute/v2.1/servers/d33a2d6b-f17c-4ce3-ad33-9086d790495d" status: 200 len: 1522 microversion: 2.1 time: 0.214280 Oct 31 12:35:03.338583 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 170/338] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:35:03 2022] GET /compute/v2.1/servers/d33a2d6b-f17c-4ce3-ad33-9086d790495d => generated 1522 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:35:03.574104 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-7af852e1-e825-4c78-8b6d-62f587921fc5 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:35:03.575118 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-7af852e1-e825-4c78-8b6d-62f587921fc5 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] [instance: b8c93a18-ee0e-438e-823c-cf51f9d4985f] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:35:03.583052 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-7af852e1-e825-4c78-8b6d-62f587921fc5 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:03.583629 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-7af852e1-e825-4c78-8b6d-62f587921fc5 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:03.584206 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-7af852e1-e825-4c78-8b6d-62f587921fc5 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:03.585316 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-7af852e1-e825-4c78-8b6d-62f587921fc5 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:03.585987 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-7af852e1-e825-4c78-8b6d-62f587921fc5 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:03.593325 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-7af852e1-e825-4c78-8b6d-62f587921fc5 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:03.771858 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-7af852e1-e825-4c78-8b6d-62f587921fc5 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825059319a204b6da5bc7004b3a09361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14b98f006574deabc030c2e93c680c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:35:03.784734 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-7af852e1-e825-4c78-8b6d-62f587921fc5 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] 10.222.0.15 "GET /compute/v2.1/servers/b8c93a18-ee0e-438e-823c-cf51f9d4985f" status: 200 len: 1259 microversion: 2.1 time: 0.214786 Oct 31 12:35:03.792840 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 169/339] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:35:03 2022] GET /compute/v2.1/servers/b8c93a18-ee0e-438e-823c-cf51f9d4985f => generated 1259 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:35:03.865655 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-c224e269-c9e7-48de-86cd-ce2d92d5f367 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:35:03.866906 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-c224e269-c9e7-48de-86cd-ce2d92d5f367 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] [instance: 852e8870-b3ec-4a21-a9b5-e31a423ddd3d] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:35:03.873793 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-c224e269-c9e7-48de-86cd-ce2d92d5f367 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:03.874663 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-c224e269-c9e7-48de-86cd-ce2d92d5f367 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:03.875401 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-c224e269-c9e7-48de-86cd-ce2d92d5f367 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:03.876160 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-c224e269-c9e7-48de-86cd-ce2d92d5f367 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:03.876745 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-c224e269-c9e7-48de-86cd-ce2d92d5f367 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:03.877451 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-c224e269-c9e7-48de-86cd-ce2d92d5f367 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:03.911717 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-c224e269-c9e7-48de-86cd-ce2d92d5f367 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] 10.222.0.15 "GET /compute/v2.1/servers/852e8870-b3ec-4a21-a9b5-e31a423ddd3d/ips" status: 200 len: 151 microversion: 2.20 time: 0.049910 Oct 31 12:35:03.912305 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 171/340] 10.222.0.15 () {60 vars in 1289 bytes} [Mon Oct 31 12:35:03 2022] GET /compute/v2.1/servers/852e8870-b3ec-4a21-a9b5-e31a423ddd3d/ips => generated 151 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 31 12:35:04.048473 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-a1c8ce34-4140-4590-a233-8a42d999d19d tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:35:04.049071 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-a1c8ce34-4140-4590-a233-8a42d999d19d tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] [instance: ff125cf8-e8a5-4f00-ade9-045b18ee33f4] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:35:04.063284 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-a1c8ce34-4140-4590-a233-8a42d999d19d tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:04.063728 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-a1c8ce34-4140-4590-a233-8a42d999d19d tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:04.066646 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-a1c8ce34-4140-4590-a233-8a42d999d19d tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:04.074674 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-a1c8ce34-4140-4590-a233-8a42d999d19d tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:04.074674 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-a1c8ce34-4140-4590-a233-8a42d999d19d tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:04.074674 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-a1c8ce34-4140-4590-a233-8a42d999d19d tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:04.336139 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-a1c8ce34-4140-4590-a233-8a42d999d19d tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c1beb321e44908ab987b17f7b74484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a2bf9a5a484523a700e4e6c568d4de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:35:04.346958 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-a1c8ce34-4140-4590-a233-8a42d999d19d tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] 10.222.0.15 "GET /compute/v2.1/servers/ff125cf8-e8a5-4f00-ade9-045b18ee33f4" status: 200 len: 1724 microversion: 2.1 time: 0.302081 Oct 31 12:35:04.348841 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 170/341] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:35:04 2022] GET /compute/v2.1/servers/ff125cf8-e8a5-4f00-ade9-045b18ee33f4 => generated 1724 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:35:04.363069 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-636d44f4-3ebb-407b-950d-9f8428f3fa8c tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:35:04.363958 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-636d44f4-3ebb-407b-950d-9f8428f3fa8c tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] [instance: d33a2d6b-f17c-4ce3-ad33-9086d790495d] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:35:04.372267 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-636d44f4-3ebb-407b-950d-9f8428f3fa8c tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:04.372852 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-636d44f4-3ebb-407b-950d-9f8428f3fa8c tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:04.373398 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-636d44f4-3ebb-407b-950d-9f8428f3fa8c tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:04.374294 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-636d44f4-3ebb-407b-950d-9f8428f3fa8c tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:04.374681 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-636d44f4-3ebb-407b-950d-9f8428f3fa8c tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:04.375113 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-636d44f4-3ebb-407b-950d-9f8428f3fa8c tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:04.517420 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-636d44f4-3ebb-407b-950d-9f8428f3fa8c tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2e978bcb824a5e9d593b861c9e3bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7573cb9c503243ab90b1649591d550e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:35:04.525328 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-636d44f4-3ebb-407b-950d-9f8428f3fa8c tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] 10.222.0.15 "GET /compute/v2.1/servers/d33a2d6b-f17c-4ce3-ad33-9086d790495d" status: 200 len: 1522 microversion: 2.1 time: 0.167672 Oct 31 12:35:04.525889 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 172/342] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:35:04 2022] GET /compute/v2.1/servers/d33a2d6b-f17c-4ce3-ad33-9086d790495d => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:35:04.808756 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-5d8e1784-77d2-4cc2-accc-b7497b978058 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:35:04.809394 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-5d8e1784-77d2-4cc2-accc-b7497b978058 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] [instance: b8c93a18-ee0e-438e-823c-cf51f9d4985f] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:35:04.815643 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-5d8e1784-77d2-4cc2-accc-b7497b978058 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:04.816124 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-5d8e1784-77d2-4cc2-accc-b7497b978058 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:04.816560 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-5d8e1784-77d2-4cc2-accc-b7497b978058 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:04.817302 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-5d8e1784-77d2-4cc2-accc-b7497b978058 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:04.817752 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-5d8e1784-77d2-4cc2-accc-b7497b978058 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:04.818172 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-5d8e1784-77d2-4cc2-accc-b7497b978058 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:04.966508 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-5d8e1784-77d2-4cc2-accc-b7497b978058 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825059319a204b6da5bc7004b3a09361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14b98f006574deabc030c2e93c680c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:35:04.975099 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-5d8e1784-77d2-4cc2-accc-b7497b978058 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] 10.222.0.15 "GET /compute/v2.1/servers/b8c93a18-ee0e-438e-823c-cf51f9d4985f" status: 200 len: 1259 microversion: 2.1 time: 0.170195 Oct 31 12:35:04.976136 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 171/343] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:35:04 2022] GET /compute/v2.1/servers/b8c93a18-ee0e-438e-823c-cf51f9d4985f => generated 1259 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:35:05.370097 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-0e998922-06d9-4ea8-9bfb-fc735672cb4f tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:35:05.370623 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-0e998922-06d9-4ea8-9bfb-fc735672cb4f tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] [instance: ff125cf8-e8a5-4f00-ade9-045b18ee33f4] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:35:05.377444 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-0e998922-06d9-4ea8-9bfb-fc735672cb4f tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:05.378013 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-0e998922-06d9-4ea8-9bfb-fc735672cb4f tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:05.378508 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-0e998922-06d9-4ea8-9bfb-fc735672cb4f tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:05.379310 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-0e998922-06d9-4ea8-9bfb-fc735672cb4f tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:05.380024 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-0e998922-06d9-4ea8-9bfb-fc735672cb4f tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:05.380663 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-0e998922-06d9-4ea8-9bfb-fc735672cb4f tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:05.549901 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-142178b7-0f4c-4411-afa9-adbd68a14365 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:35:05.550577 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-142178b7-0f4c-4411-afa9-adbd68a14365 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] [instance: d33a2d6b-f17c-4ce3-ad33-9086d790495d] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:35:05.563959 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-142178b7-0f4c-4411-afa9-adbd68a14365 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:05.565285 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-142178b7-0f4c-4411-afa9-adbd68a14365 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:05.567372 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-142178b7-0f4c-4411-afa9-adbd68a14365 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:05.569703 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-142178b7-0f4c-4411-afa9-adbd68a14365 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:05.570384 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-142178b7-0f4c-4411-afa9-adbd68a14365 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:05.571499 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-142178b7-0f4c-4411-afa9-adbd68a14365 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:05.575922 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-0e998922-06d9-4ea8-9bfb-fc735672cb4f tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c1beb321e44908ab987b17f7b74484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a2bf9a5a484523a700e4e6c568d4de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:35:05.584764 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-0e998922-06d9-4ea8-9bfb-fc735672cb4f tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] 10.222.0.15 "GET /compute/v2.1/servers/ff125cf8-e8a5-4f00-ade9-045b18ee33f4" status: 200 len: 1724 microversion: 2.1 time: 0.218742 Oct 31 12:35:05.590045 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 173/344] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:35:05 2022] GET /compute/v2.1/servers/ff125cf8-e8a5-4f00-ade9-045b18ee33f4 => generated 1724 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:35:05.766440 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-142178b7-0f4c-4411-afa9-adbd68a14365 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2e978bcb824a5e9d593b861c9e3bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7573cb9c503243ab90b1649591d550e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:35:05.780597 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-142178b7-0f4c-4411-afa9-adbd68a14365 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] 10.222.0.15 "GET /compute/v2.1/servers/d33a2d6b-f17c-4ce3-ad33-9086d790495d" status: 200 len: 1522 microversion: 2.1 time: 0.235801 Oct 31 12:35:05.782544 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 172/345] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:35:05 2022] GET /compute/v2.1/servers/d33a2d6b-f17c-4ce3-ad33-9086d790495d => generated 1522 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:35:05.998139 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-817e9840-7dc1-48a0-b9e8-eb9ed74235bc tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:35:05.999042 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-817e9840-7dc1-48a0-b9e8-eb9ed74235bc tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] [instance: b8c93a18-ee0e-438e-823c-cf51f9d4985f] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:35:06.005677 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-817e9840-7dc1-48a0-b9e8-eb9ed74235bc tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:06.006287 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-817e9840-7dc1-48a0-b9e8-eb9ed74235bc tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:06.007059 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-817e9840-7dc1-48a0-b9e8-eb9ed74235bc tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:06.007986 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-817e9840-7dc1-48a0-b9e8-eb9ed74235bc tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:06.008689 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-817e9840-7dc1-48a0-b9e8-eb9ed74235bc tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:06.009325 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-817e9840-7dc1-48a0-b9e8-eb9ed74235bc tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:06.179646 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-817e9840-7dc1-48a0-b9e8-eb9ed74235bc tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825059319a204b6da5bc7004b3a09361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14b98f006574deabc030c2e93c680c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:35:06.189753 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-817e9840-7dc1-48a0-b9e8-eb9ed74235bc tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] 10.222.0.15 "GET /compute/v2.1/servers/b8c93a18-ee0e-438e-823c-cf51f9d4985f" status: 200 len: 1442 microversion: 2.1 time: 0.195541 Oct 31 12:35:06.211336 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 174/346] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:35:05 2022] GET /compute/v2.1/servers/b8c93a18-ee0e-438e-823c-cf51f9d4985f => generated 1442 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:35:06.216526 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-a6984c69-d7aa-4475-b40a-27de6e808622 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:35:06.217143 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-a6984c69-d7aa-4475-b40a-27de6e808622 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] [instance: b8c93a18-ee0e-438e-823c-cf51f9d4985f] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:35:06.227361 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-a6984c69-d7aa-4475-b40a-27de6e808622 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:06.227908 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-a6984c69-d7aa-4475-b40a-27de6e808622 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:06.228377 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-a6984c69-d7aa-4475-b40a-27de6e808622 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:06.229087 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-a6984c69-d7aa-4475-b40a-27de6e808622 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:06.229878 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-a6984c69-d7aa-4475-b40a-27de6e808622 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:06.230400 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-a6984c69-d7aa-4475-b40a-27de6e808622 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:06.420252 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-a6984c69-d7aa-4475-b40a-27de6e808622 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825059319a204b6da5bc7004b3a09361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14b98f006574deabc030c2e93c680c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:35:06.432423 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-a6984c69-d7aa-4475-b40a-27de6e808622 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] 10.222.0.15 "GET /compute/v2.1/servers/b8c93a18-ee0e-438e-823c-cf51f9d4985f" status: 200 len: 1442 microversion: 2.1 time: 0.216847 Oct 31 12:35:06.432423 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 173/347] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:35:06 2022] GET /compute/v2.1/servers/b8c93a18-ee0e-438e-823c-cf51f9d4985f => generated 1442 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:35:06.522878 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-ebb69608-9f65-4016-845f-92beb8a6fef3 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 12:35:06.523449 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-ebb69608-9f65-4016-845f-92beb8a6fef3 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] [instance: 852e8870-b3ec-4a21-a9b5-e31a423ddd3d] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:35:06.530087 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-ebb69608-9f65-4016-845f-92beb8a6fef3 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:06.530570 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-ebb69608-9f65-4016-845f-92beb8a6fef3 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:06.533473 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-ebb69608-9f65-4016-845f-92beb8a6fef3 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:06.535951 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-ebb69608-9f65-4016-845f-92beb8a6fef3 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:06.537410 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-ebb69608-9f65-4016-845f-92beb8a6fef3 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:06.538022 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-ebb69608-9f65-4016-845f-92beb8a6fef3 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:06.582450 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.objects.instance [None req-ebb69608-9f65-4016-845f-92beb8a6fef3 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lazy-loading 'flavor' on Instance uuid 852e8870-b3ec-4a21-a9b5-e31a423ddd3d {{(pid=125441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 12:35:06.619061 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-9f664122-8596-44a9-9ca9-52a7cadc038b tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:35:06.619823 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-9f664122-8596-44a9-9ca9-52a7cadc038b tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] [instance: ff125cf8-e8a5-4f00-ade9-045b18ee33f4] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:35:06.639812 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-9f664122-8596-44a9-9ca9-52a7cadc038b tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:06.641069 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-9f664122-8596-44a9-9ca9-52a7cadc038b tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:06.641658 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-9f664122-8596-44a9-9ca9-52a7cadc038b tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:06.642556 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-9f664122-8596-44a9-9ca9-52a7cadc038b tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:06.643718 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-9f664122-8596-44a9-9ca9-52a7cadc038b tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:06.646081 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-9f664122-8596-44a9-9ca9-52a7cadc038b tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:06.972488 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-9f664122-8596-44a9-9ca9-52a7cadc038b tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c1beb321e44908ab987b17f7b74484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a2bf9a5a484523a700e4e6c568d4de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:35:06.981872 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-9f664122-8596-44a9-9ca9-52a7cadc038b tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] 10.222.0.15 "GET /compute/v2.1/servers/ff125cf8-e8a5-4f00-ade9-045b18ee33f4" status: 200 len: 1724 microversion: 2.1 time: 0.367894 Oct 31 12:35:07.001317 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 174/348] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:35:06 2022] GET /compute/v2.1/servers/ff125cf8-e8a5-4f00-ade9-045b18ee33f4 => generated 1724 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 12:35:07.009704 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-01d21591-3a7c-43c3-8716-baff14c67908 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:35:07.009704 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-01d21591-3a7c-43c3-8716-baff14c67908 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] [instance: d33a2d6b-f17c-4ce3-ad33-9086d790495d] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:35:07.015601 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-01d21591-3a7c-43c3-8716-baff14c67908 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:07.016081 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-01d21591-3a7c-43c3-8716-baff14c67908 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:07.016496 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-01d21591-3a7c-43c3-8716-baff14c67908 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:07.017525 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-01d21591-3a7c-43c3-8716-baff14c67908 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:07.018122 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-01d21591-3a7c-43c3-8716-baff14c67908 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:07.018688 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-01d21591-3a7c-43c3-8716-baff14c67908 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:07.513850 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-01d21591-3a7c-43c3-8716-baff14c67908 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2e978bcb824a5e9d593b861c9e3bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7573cb9c503243ab90b1649591d550e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:35:07.524817 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-01d21591-3a7c-43c3-8716-baff14c67908 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] 10.222.0.15 "GET /compute/v2.1/servers/d33a2d6b-f17c-4ce3-ad33-9086d790495d" status: 200 len: 1522 microversion: 2.1 time: 0.522446 Oct 31 12:35:07.527955 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 175/349] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:35:07 2022] GET /compute/v2.1/servers/d33a2d6b-f17c-4ce3-ad33-9086d790495d => generated 1522 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:35:08.020153 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-f5024f85-8511-441f-bb92-b87e55a53f04 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:35:08.024323 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-f5024f85-8511-441f-bb92-b87e55a53f04 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] [instance: ff125cf8-e8a5-4f00-ade9-045b18ee33f4] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:35:08.082945 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-f5024f85-8511-441f-bb92-b87e55a53f04 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:08.087556 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-f5024f85-8511-441f-bb92-b87e55a53f04 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:08.088289 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-f5024f85-8511-441f-bb92-b87e55a53f04 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:08.090935 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-f5024f85-8511-441f-bb92-b87e55a53f04 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:08.097689 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-f5024f85-8511-441f-bb92-b87e55a53f04 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:08.099055 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-f5024f85-8511-441f-bb92-b87e55a53f04 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:08.493891 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-f5024f85-8511-441f-bb92-b87e55a53f04 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c1beb321e44908ab987b17f7b74484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a2bf9a5a484523a700e4e6c568d4de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:35:08.507469 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-f5024f85-8511-441f-bb92-b87e55a53f04 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] 10.222.0.15 "GET /compute/v2.1/servers/ff125cf8-e8a5-4f00-ade9-045b18ee33f4" status: 200 len: 1724 microversion: 2.1 time: 0.495860 Oct 31 12:35:08.523186 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 176/350] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:35:08 2022] GET /compute/v2.1/servers/ff125cf8-e8a5-4f00-ade9-045b18ee33f4 => generated 1724 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:35:08.549794 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-7bd64364-dad3-4d6d-aa6b-39ff9ce68bf6 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:35:08.550424 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-7bd64364-dad3-4d6d-aa6b-39ff9ce68bf6 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] [instance: d33a2d6b-f17c-4ce3-ad33-9086d790495d] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:35:08.556506 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-7bd64364-dad3-4d6d-aa6b-39ff9ce68bf6 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:08.557205 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-7bd64364-dad3-4d6d-aa6b-39ff9ce68bf6 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:08.557808 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-7bd64364-dad3-4d6d-aa6b-39ff9ce68bf6 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:08.558659 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-7bd64364-dad3-4d6d-aa6b-39ff9ce68bf6 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:08.559808 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-7bd64364-dad3-4d6d-aa6b-39ff9ce68bf6 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:08.560524 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-7bd64364-dad3-4d6d-aa6b-39ff9ce68bf6 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:08.795782 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-7bd64364-dad3-4d6d-aa6b-39ff9ce68bf6 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2e978bcb824a5e9d593b861c9e3bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7573cb9c503243ab90b1649591d550e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:35:08.805781 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-7bd64364-dad3-4d6d-aa6b-39ff9ce68bf6 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] 10.222.0.15 "GET /compute/v2.1/servers/d33a2d6b-f17c-4ce3-ad33-9086d790495d" status: 200 len: 1522 microversion: 2.1 time: 0.259680 Oct 31 12:35:08.822583 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 177/351] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:35:08 2022] GET /compute/v2.1/servers/d33a2d6b-f17c-4ce3-ad33-9086d790495d => generated 1522 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:35:09.496935 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [req-a0a26e09-c84a-45c3-9a32-f719162aa948 req-82678b89-c9c8-4054-ac87-3b7e054f55c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b8c93a18-ee0e-438e-823c-cf51f9d4985f", "tag": "c444a742-6430-4bab-91f7-bff045443454"}]} {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 12:35:09.510366 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [req-a0a26e09-c84a-45c3-9a32-f719162aa948 req-82678b89-c9c8-4054-ac87-3b7e054f55c8 service nova] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:09.510932 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [req-a0a26e09-c84a-45c3-9a32-f719162aa948 req-82678b89-c9c8-4054-ac87-3b7e054f55c8 service nova] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:09.511485 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [req-a0a26e09-c84a-45c3-9a32-f719162aa948 req-82678b89-c9c8-4054-ac87-3b7e054f55c8 service nova] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:09.526160 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.compute.server_external_events [req-a0a26e09-c84a-45c3-9a32-f719162aa948 req-82678b89-c9c8-4054-ac87-3b7e054f55c8 service nova] Creating event network-changed:c444a742-6430-4bab-91f7-bff045443454 for instance b8c93a18-ee0e-438e-823c-cf51f9d4985f on hv-cinder-79617 Oct 31 12:35:09.533224 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [req-a0a26e09-c84a-45c3-9a32-f719162aa948 req-82678b89-c9c8-4054-ac87-3b7e054f55c8 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039830 Oct 31 12:35:09.534679 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 178/352] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Oct 31 12:35:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 12:35:09.543146 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-806913c1-bdf6-400a-8002-5f2bb630f70f tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:35:09.544488 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-806913c1-bdf6-400a-8002-5f2bb630f70f tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] [instance: ff125cf8-e8a5-4f00-ade9-045b18ee33f4] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:35:09.552000 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-806913c1-bdf6-400a-8002-5f2bb630f70f tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:09.552639 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-806913c1-bdf6-400a-8002-5f2bb630f70f tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:09.553346 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-806913c1-bdf6-400a-8002-5f2bb630f70f tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:09.554105 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-806913c1-bdf6-400a-8002-5f2bb630f70f tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:09.554618 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-806913c1-bdf6-400a-8002-5f2bb630f70f tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:09.555971 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-806913c1-bdf6-400a-8002-5f2bb630f70f tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:09.833428 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-806913c1-bdf6-400a-8002-5f2bb630f70f tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c1beb321e44908ab987b17f7b74484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a2bf9a5a484523a700e4e6c568d4de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:35:09.849045 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-806913c1-bdf6-400a-8002-5f2bb630f70f tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] 10.222.0.15 "GET /compute/v2.1/servers/ff125cf8-e8a5-4f00-ade9-045b18ee33f4" status: 200 len: 1724 microversion: 2.1 time: 0.312046 Oct 31 12:35:09.866087 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 179/353] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:35:09 2022] GET /compute/v2.1/servers/ff125cf8-e8a5-4f00-ade9-045b18ee33f4 => generated 1724 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:35:09.876694 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-57f1bf75-30eb-4d65-9bde-c8f96b06e4d9 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:35:09.877565 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-57f1bf75-30eb-4d65-9bde-c8f96b06e4d9 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] [instance: d33a2d6b-f17c-4ce3-ad33-9086d790495d] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:35:09.885052 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-57f1bf75-30eb-4d65-9bde-c8f96b06e4d9 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:09.886513 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-57f1bf75-30eb-4d65-9bde-c8f96b06e4d9 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:09.887404 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-57f1bf75-30eb-4d65-9bde-c8f96b06e4d9 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:09.888279 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-57f1bf75-30eb-4d65-9bde-c8f96b06e4d9 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:09.889009 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-57f1bf75-30eb-4d65-9bde-c8f96b06e4d9 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:09.889431 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-57f1bf75-30eb-4d65-9bde-c8f96b06e4d9 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:10.354376 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-57f1bf75-30eb-4d65-9bde-c8f96b06e4d9 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2e978bcb824a5e9d593b861c9e3bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7573cb9c503243ab90b1649591d550e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:35:10.369093 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-57f1bf75-30eb-4d65-9bde-c8f96b06e4d9 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] 10.222.0.15 "GET /compute/v2.1/servers/d33a2d6b-f17c-4ce3-ad33-9086d790495d" status: 200 len: 1522 microversion: 2.1 time: 0.501440 Oct 31 12:35:10.369669 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 180/354] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:35:09 2022] GET /compute/v2.1/servers/d33a2d6b-f17c-4ce3-ad33-9086d790495d => generated 1522 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:35:10.877928 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-a60d5929-572e-4c6d-9d09-b4c8f110f167 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:35:10.879377 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-a60d5929-572e-4c6d-9d09-b4c8f110f167 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] [instance: ff125cf8-e8a5-4f00-ade9-045b18ee33f4] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:35:10.885740 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-a60d5929-572e-4c6d-9d09-b4c8f110f167 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:10.886226 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-a60d5929-572e-4c6d-9d09-b4c8f110f167 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:10.886652 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-a60d5929-572e-4c6d-9d09-b4c8f110f167 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:10.887368 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-a60d5929-572e-4c6d-9d09-b4c8f110f167 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:10.887817 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-a60d5929-572e-4c6d-9d09-b4c8f110f167 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:10.888234 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-a60d5929-572e-4c6d-9d09-b4c8f110f167 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:11.041848 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-a60d5929-572e-4c6d-9d09-b4c8f110f167 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c1beb321e44908ab987b17f7b74484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a2bf9a5a484523a700e4e6c568d4de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:35:11.051449 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-a60d5929-572e-4c6d-9d09-b4c8f110f167 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] 10.222.0.15 "GET /compute/v2.1/servers/ff125cf8-e8a5-4f00-ade9-045b18ee33f4" status: 200 len: 1724 microversion: 2.1 time: 0.177624 Oct 31 12:35:11.059773 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 181/355] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:35:10 2022] GET /compute/v2.1/servers/ff125cf8-e8a5-4f00-ade9-045b18ee33f4 => generated 1724 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:35:11.396965 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-4a9af0c9-34c6-4484-a5c2-f3d79f6d7ec6 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:35:11.397594 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-4a9af0c9-34c6-4484-a5c2-f3d79f6d7ec6 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] [instance: d33a2d6b-f17c-4ce3-ad33-9086d790495d] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:35:11.403596 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-4a9af0c9-34c6-4484-a5c2-f3d79f6d7ec6 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:11.404077 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-4a9af0c9-34c6-4484-a5c2-f3d79f6d7ec6 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:11.404503 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-4a9af0c9-34c6-4484-a5c2-f3d79f6d7ec6 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:11.405191 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-4a9af0c9-34c6-4484-a5c2-f3d79f6d7ec6 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:11.405639 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-4a9af0c9-34c6-4484-a5c2-f3d79f6d7ec6 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:11.406651 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-4a9af0c9-34c6-4484-a5c2-f3d79f6d7ec6 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:11.563882 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-4a9af0c9-34c6-4484-a5c2-f3d79f6d7ec6 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2e978bcb824a5e9d593b861c9e3bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7573cb9c503243ab90b1649591d550e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:35:11.576279 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-4a9af0c9-34c6-4484-a5c2-f3d79f6d7ec6 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] 10.222.0.15 "GET /compute/v2.1/servers/d33a2d6b-f17c-4ce3-ad33-9086d790495d" status: 200 len: 1522 microversion: 2.1 time: 0.183403 Oct 31 12:35:11.577036 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 182/356] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:35:11 2022] GET /compute/v2.1/servers/d33a2d6b-f17c-4ce3-ad33-9086d790495d => generated 1522 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 12:35:12.076285 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-e8ce7eb1-7bda-45db-98c9-8cab2e6c8a9c tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:35:12.078499 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-e8ce7eb1-7bda-45db-98c9-8cab2e6c8a9c tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] [instance: ff125cf8-e8a5-4f00-ade9-045b18ee33f4] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:35:12.085024 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-e8ce7eb1-7bda-45db-98c9-8cab2e6c8a9c tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:12.085706 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-e8ce7eb1-7bda-45db-98c9-8cab2e6c8a9c tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:12.086356 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-e8ce7eb1-7bda-45db-98c9-8cab2e6c8a9c tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:12.087431 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-e8ce7eb1-7bda-45db-98c9-8cab2e6c8a9c tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:12.087972 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-e8ce7eb1-7bda-45db-98c9-8cab2e6c8a9c tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:12.088565 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-e8ce7eb1-7bda-45db-98c9-8cab2e6c8a9c tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:12.093072 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG dbcounter [-] [125440] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:35:12.304294 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-e8ce7eb1-7bda-45db-98c9-8cab2e6c8a9c tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c1beb321e44908ab987b17f7b74484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a2bf9a5a484523a700e4e6c568d4de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:35:12.317911 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-e8ce7eb1-7bda-45db-98c9-8cab2e6c8a9c tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] 10.222.0.15 "GET /compute/v2.1/servers/ff125cf8-e8a5-4f00-ade9-045b18ee33f4" status: 200 len: 1724 microversion: 2.1 time: 0.246733 Oct 31 12:35:12.332118 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 183/357] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:35:12 2022] GET /compute/v2.1/servers/ff125cf8-e8a5-4f00-ade9-045b18ee33f4 => generated 1724 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:35:12.601319 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-9dbd7009-d866-4b89-aa0c-9719b6c8cf21 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:35:12.602244 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-9dbd7009-d866-4b89-aa0c-9719b6c8cf21 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] [instance: d33a2d6b-f17c-4ce3-ad33-9086d790495d] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:35:12.609937 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-9dbd7009-d866-4b89-aa0c-9719b6c8cf21 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:12.610660 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-9dbd7009-d866-4b89-aa0c-9719b6c8cf21 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:12.611293 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-9dbd7009-d866-4b89-aa0c-9719b6c8cf21 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:12.612151 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-9dbd7009-d866-4b89-aa0c-9719b6c8cf21 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:12.612881 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-9dbd7009-d866-4b89-aa0c-9719b6c8cf21 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:12.613476 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-9dbd7009-d866-4b89-aa0c-9719b6c8cf21 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:12.791310 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-9dbd7009-d866-4b89-aa0c-9719b6c8cf21 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2e978bcb824a5e9d593b861c9e3bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7573cb9c503243ab90b1649591d550e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:35:12.801751 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-9dbd7009-d866-4b89-aa0c-9719b6c8cf21 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] 10.222.0.15 "GET /compute/v2.1/servers/d33a2d6b-f17c-4ce3-ad33-9086d790495d" status: 200 len: 1522 microversion: 2.1 time: 0.205548 Oct 31 12:35:12.803750 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 184/358] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:35:12 2022] GET /compute/v2.1/servers/d33a2d6b-f17c-4ce3-ad33-9086d790495d => generated 1522 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:35:13.087125 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-ebb69608-9f65-4016-845f-92beb8a6fef3 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] 10.222.0.15 "POST /compute/v2.1/servers/852e8870-b3ec-4a21-a9b5-e31a423ddd3d/action" status: 202 len: 0 microversion: 2.20 time: 6.568861 Oct 31 12:35:13.091670 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 175/359] 10.222.0.15 () {62 vars in 1319 bytes} [Mon Oct 31 12:35:06 2022] POST /compute/v2.1/servers/852e8870-b3ec-4a21-a9b5-e31a423ddd3d/action => generated 0 bytes in 6570 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 31 12:35:13.107626 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-2f5eb3aa-4066-41a6-9e2f-883cc77adb2d tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:35:13.108197 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-2f5eb3aa-4066-41a6-9e2f-883cc77adb2d tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] [instance: 852e8870-b3ec-4a21-a9b5-e31a423ddd3d] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:35:13.115951 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-2f5eb3aa-4066-41a6-9e2f-883cc77adb2d tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:13.116447 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-2f5eb3aa-4066-41a6-9e2f-883cc77adb2d tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:13.121142 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-2f5eb3aa-4066-41a6-9e2f-883cc77adb2d tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:13.122388 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-2f5eb3aa-4066-41a6-9e2f-883cc77adb2d tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:13.123027 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-2f5eb3aa-4066-41a6-9e2f-883cc77adb2d tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:13.123647 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-2f5eb3aa-4066-41a6-9e2f-883cc77adb2d tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:13.142598 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-ca2ddeac-fa6b-4e09-b65b-fb093e10099d tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:35:13.143420 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-ca2ddeac-fa6b-4e09-b65b-fb093e10099d tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] [instance: 9906becc-a42b-4b4c-855a-450915f7a3f8] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:35:13.153345 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-ca2ddeac-fa6b-4e09-b65b-fb093e10099d tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:13.154630 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-ca2ddeac-fa6b-4e09-b65b-fb093e10099d tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:13.155464 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-ca2ddeac-fa6b-4e09-b65b-fb093e10099d tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:13.157533 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-ca2ddeac-fa6b-4e09-b65b-fb093e10099d tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:13.158576 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-ca2ddeac-fa6b-4e09-b65b-fb093e10099d tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:13.159828 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-ca2ddeac-fa6b-4e09-b65b-fb093e10099d tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:13.206709 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-ca2ddeac-fa6b-4e09-b65b-fb093e10099d tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] 10.222.0.15 "GET /compute/v2.1/servers/9906becc-a42b-4b4c-855a-450915f7a3f8/ips" status: 200 len: 151 microversion: 2.1 time: 0.069403 Oct 31 12:35:13.207588 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 176/360] 10.222.0.15 () {58 vars in 1248 bytes} [Mon Oct 31 12:35:13 2022] GET /compute/v2.1/servers/9906becc-a42b-4b4c-855a-450915f7a3f8/ips => generated 151 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 12:35:13.345038 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-1f9201a4-7fcd-4428-9089-4b9d7b3521ff tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:35:13.345727 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-1f9201a4-7fcd-4428-9089-4b9d7b3521ff tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] [instance: ff125cf8-e8a5-4f00-ade9-045b18ee33f4] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:35:13.354328 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-1f9201a4-7fcd-4428-9089-4b9d7b3521ff tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:13.356146 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-1f9201a4-7fcd-4428-9089-4b9d7b3521ff tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:13.358255 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-1f9201a4-7fcd-4428-9089-4b9d7b3521ff tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:13.363741 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-1f9201a4-7fcd-4428-9089-4b9d7b3521ff tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:13.366077 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-1f9201a4-7fcd-4428-9089-4b9d7b3521ff tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:13.367703 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-1f9201a4-7fcd-4428-9089-4b9d7b3521ff tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:13.371713 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-2f5eb3aa-4066-41a6-9e2f-883cc77adb2d tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:35:13.383631 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-2f5eb3aa-4066-41a6-9e2f-883cc77adb2d tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:35:13.385153 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-2f5eb3aa-4066-41a6-9e2f-883cc77adb2d tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:35:13.386502 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-2f5eb3aa-4066-41a6-9e2f-883cc77adb2d tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] 10.222.0.15 "GET /compute/v2.1/servers/852e8870-b3ec-4a21-a9b5-e31a423ddd3d" status: 200 len: 1724 microversion: 2.20 time: 0.284018 Oct 31 12:35:13.387116 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 185/361] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Oct 31 12:35:13 2022] GET /compute/v2.1/servers/852e8870-b3ec-4a21-a9b5-e31a423ddd3d => generated 1724 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 12:35:13.601111 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-1f9201a4-7fcd-4428-9089-4b9d7b3521ff tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c1beb321e44908ab987b17f7b74484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a2bf9a5a484523a700e4e6c568d4de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:35:13.610332 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-1f9201a4-7fcd-4428-9089-4b9d7b3521ff tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] 10.222.0.15 "GET /compute/v2.1/servers/ff125cf8-e8a5-4f00-ade9-045b18ee33f4" status: 200 len: 1724 microversion: 2.1 time: 0.269776 Oct 31 12:35:13.611967 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 177/362] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:35:13 2022] GET /compute/v2.1/servers/ff125cf8-e8a5-4f00-ade9-045b18ee33f4 => generated 1724 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 12:35:13.832448 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-3ccef517-6837-470c-8651-d53d2aa2ebd7 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:35:13.834154 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-3ccef517-6837-470c-8651-d53d2aa2ebd7 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] [instance: d33a2d6b-f17c-4ce3-ad33-9086d790495d] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:35:13.842316 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-3ccef517-6837-470c-8651-d53d2aa2ebd7 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:13.842929 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-3ccef517-6837-470c-8651-d53d2aa2ebd7 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:13.843764 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-3ccef517-6837-470c-8651-d53d2aa2ebd7 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:13.844723 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-3ccef517-6837-470c-8651-d53d2aa2ebd7 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:13.845269 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-3ccef517-6837-470c-8651-d53d2aa2ebd7 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:13.845787 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-3ccef517-6837-470c-8651-d53d2aa2ebd7 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:14.045989 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-3ccef517-6837-470c-8651-d53d2aa2ebd7 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2e978bcb824a5e9d593b861c9e3bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7573cb9c503243ab90b1649591d550e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:35:14.057505 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-3ccef517-6837-470c-8651-d53d2aa2ebd7 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] 10.222.0.15 "GET /compute/v2.1/servers/d33a2d6b-f17c-4ce3-ad33-9086d790495d" status: 200 len: 1522 microversion: 2.1 time: 0.231944 Oct 31 12:35:14.059981 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 186/363] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:35:13 2022] GET /compute/v2.1/servers/d33a2d6b-f17c-4ce3-ad33-9086d790495d => generated 1522 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:35:14.416174 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-96cc750b-514f-4e6d-ac52-e9d6997f4427 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:35:14.416724 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-96cc750b-514f-4e6d-ac52-e9d6997f4427 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] [instance: 852e8870-b3ec-4a21-a9b5-e31a423ddd3d] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:35:14.423342 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-96cc750b-514f-4e6d-ac52-e9d6997f4427 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:14.423847 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-96cc750b-514f-4e6d-ac52-e9d6997f4427 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:14.424301 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-96cc750b-514f-4e6d-ac52-e9d6997f4427 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:14.424995 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-96cc750b-514f-4e6d-ac52-e9d6997f4427 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:14.425446 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-96cc750b-514f-4e6d-ac52-e9d6997f4427 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:14.425866 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-96cc750b-514f-4e6d-ac52-e9d6997f4427 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:14.559145 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-96cc750b-514f-4e6d-ac52-e9d6997f4427 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:35:14.567349 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-96cc750b-514f-4e6d-ac52-e9d6997f4427 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:35:14.568780 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-96cc750b-514f-4e6d-ac52-e9d6997f4427 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:35:14.569916 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-96cc750b-514f-4e6d-ac52-e9d6997f4427 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] 10.222.0.15 "GET /compute/v2.1/servers/852e8870-b3ec-4a21-a9b5-e31a423ddd3d" status: 200 len: 1724 microversion: 2.20 time: 0.158839 Oct 31 12:35:14.570467 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 178/364] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Oct 31 12:35:14 2022] GET /compute/v2.1/servers/852e8870-b3ec-4a21-a9b5-e31a423ddd3d => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 12:35:14.634235 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-763e9b5b-5e61-427f-848e-a3b536c84ab7 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:35:14.635642 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-763e9b5b-5e61-427f-848e-a3b536c84ab7 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] [instance: ff125cf8-e8a5-4f00-ade9-045b18ee33f4] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:35:14.642441 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-763e9b5b-5e61-427f-848e-a3b536c84ab7 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:14.642946 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-763e9b5b-5e61-427f-848e-a3b536c84ab7 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:14.643412 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-763e9b5b-5e61-427f-848e-a3b536c84ab7 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:14.644136 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-763e9b5b-5e61-427f-848e-a3b536c84ab7 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:14.644588 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-763e9b5b-5e61-427f-848e-a3b536c84ab7 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:14.645040 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-763e9b5b-5e61-427f-848e-a3b536c84ab7 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:14.800355 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-763e9b5b-5e61-427f-848e-a3b536c84ab7 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c1beb321e44908ab987b17f7b74484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a2bf9a5a484523a700e4e6c568d4de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:35:14.809870 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-763e9b5b-5e61-427f-848e-a3b536c84ab7 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] 10.222.0.15 "GET /compute/v2.1/servers/ff125cf8-e8a5-4f00-ade9-045b18ee33f4" status: 200 len: 1724 microversion: 2.1 time: 0.179753 Oct 31 12:35:14.810613 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 187/365] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:35:14 2022] GET /compute/v2.1/servers/ff125cf8-e8a5-4f00-ade9-045b18ee33f4 => generated 1724 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:35:14.839454 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-59d61863-9f1a-4757-bbe9-ced4bf576f81 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "22121858-e3c7-41eb-ac09-1abddd01c0df"}} {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 12:35:14.842181 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-59d61863-9f1a-4757-bbe9-ced4bf576f81 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] [instance: 9906becc-a42b-4b4c-855a-450915f7a3f8] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:35:14.848803 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-59d61863-9f1a-4757-bbe9-ced4bf576f81 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:14.849316 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-59d61863-9f1a-4757-bbe9-ced4bf576f81 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:14.849760 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-59d61863-9f1a-4757-bbe9-ced4bf576f81 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:14.850494 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-59d61863-9f1a-4757-bbe9-ced4bf576f81 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:14.850960 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-59d61863-9f1a-4757-bbe9-ced4bf576f81 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:14.851424 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-59d61863-9f1a-4757-bbe9-ced4bf576f81 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:15.083862 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-cdb23fd5-59d9-469c-8508-a3847200f1a1 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:35:15.084789 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-cdb23fd5-59d9-469c-8508-a3847200f1a1 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] [instance: d33a2d6b-f17c-4ce3-ad33-9086d790495d] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:35:15.091772 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-cdb23fd5-59d9-469c-8508-a3847200f1a1 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:15.092482 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-cdb23fd5-59d9-469c-8508-a3847200f1a1 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:15.093073 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-cdb23fd5-59d9-469c-8508-a3847200f1a1 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:15.094840 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-cdb23fd5-59d9-469c-8508-a3847200f1a1 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:15.095476 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-cdb23fd5-59d9-469c-8508-a3847200f1a1 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:15.095896 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-cdb23fd5-59d9-469c-8508-a3847200f1a1 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:15.167836 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-59d61863-9f1a-4757-bbe9-ced4bf576f81 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] 10.222.0.15 "POST /compute/v2.1/servers/9906becc-a42b-4b4c-855a-450915f7a3f8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.332310 Oct 31 12:35:15.175361 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 179/366] 10.222.0.15 () {60 vars in 1323 bytes} [Mon Oct 31 12:35:14 2022] POST /compute/v2.1/servers/9906becc-a42b-4b4c-855a-450915f7a3f8/os-volume_attachments => generated 194 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 12:35:15.275589 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-cdb23fd5-59d9-469c-8508-a3847200f1a1 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2e978bcb824a5e9d593b861c9e3bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7573cb9c503243ab90b1649591d550e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:35:15.286612 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-cdb23fd5-59d9-469c-8508-a3847200f1a1 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] 10.222.0.15 "GET /compute/v2.1/servers/d33a2d6b-f17c-4ce3-ad33-9086d790495d" status: 200 len: 1522 microversion: 2.1 time: 0.207371 Oct 31 12:35:15.295858 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 188/367] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:35:15 2022] GET /compute/v2.1/servers/d33a2d6b-f17c-4ce3-ad33-9086d790495d => generated 1522 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 12:35:15.596798 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-a77b031f-44f4-4f32-9c21-b5fc8adc9c1d tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:35:15.598132 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-a77b031f-44f4-4f32-9c21-b5fc8adc9c1d tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] [instance: 852e8870-b3ec-4a21-a9b5-e31a423ddd3d] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:35:15.604446 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-a77b031f-44f4-4f32-9c21-b5fc8adc9c1d tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:15.604955 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-a77b031f-44f4-4f32-9c21-b5fc8adc9c1d tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:15.605392 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-a77b031f-44f4-4f32-9c21-b5fc8adc9c1d tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:15.606076 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-a77b031f-44f4-4f32-9c21-b5fc8adc9c1d tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:15.606649 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-a77b031f-44f4-4f32-9c21-b5fc8adc9c1d tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:15.607073 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-a77b031f-44f4-4f32-9c21-b5fc8adc9c1d tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:15.755087 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-a77b031f-44f4-4f32-9c21-b5fc8adc9c1d tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:35:15.764844 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-a77b031f-44f4-4f32-9c21-b5fc8adc9c1d tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:35:15.767547 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-a77b031f-44f4-4f32-9c21-b5fc8adc9c1d tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:35:15.768915 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-a77b031f-44f4-4f32-9c21-b5fc8adc9c1d tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] 10.222.0.15 "GET /compute/v2.1/servers/852e8870-b3ec-4a21-a9b5-e31a423ddd3d" status: 200 len: 1724 microversion: 2.20 time: 0.177673 Oct 31 12:35:15.775138 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 180/368] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Oct 31 12:35:15 2022] GET /compute/v2.1/servers/852e8870-b3ec-4a21-a9b5-e31a423ddd3d => generated 1724 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 12:35:15.835421 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-87a31217-339f-4f5d-9f39-627d63de5e12 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:35:15.838300 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-87a31217-339f-4f5d-9f39-627d63de5e12 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] [instance: ff125cf8-e8a5-4f00-ade9-045b18ee33f4] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:35:15.849313 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-87a31217-339f-4f5d-9f39-627d63de5e12 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:15.849821 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-87a31217-339f-4f5d-9f39-627d63de5e12 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:15.850273 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-87a31217-339f-4f5d-9f39-627d63de5e12 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:15.850995 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-87a31217-339f-4f5d-9f39-627d63de5e12 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:15.851496 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-87a31217-339f-4f5d-9f39-627d63de5e12 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:15.851934 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-87a31217-339f-4f5d-9f39-627d63de5e12 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:15.995391 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-87a31217-339f-4f5d-9f39-627d63de5e12 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c1beb321e44908ab987b17f7b74484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a2bf9a5a484523a700e4e6c568d4de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:35:16.006162 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-87a31217-339f-4f5d-9f39-627d63de5e12 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] 10.222.0.15 "GET /compute/v2.1/servers/ff125cf8-e8a5-4f00-ade9-045b18ee33f4" status: 200 len: 1724 microversion: 2.1 time: 0.174855 Oct 31 12:35:16.006738 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 189/369] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:35:15 2022] GET /compute/v2.1/servers/ff125cf8-e8a5-4f00-ade9-045b18ee33f4 => generated 1724 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:35:16.310023 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-d1096f16-223d-4a3f-9e56-6c20d0c5ca33 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:35:16.310840 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-d1096f16-223d-4a3f-9e56-6c20d0c5ca33 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] [instance: d33a2d6b-f17c-4ce3-ad33-9086d790495d] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:35:16.318102 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-d1096f16-223d-4a3f-9e56-6c20d0c5ca33 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:16.318591 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-d1096f16-223d-4a3f-9e56-6c20d0c5ca33 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:16.319021 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-d1096f16-223d-4a3f-9e56-6c20d0c5ca33 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:16.319798 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-d1096f16-223d-4a3f-9e56-6c20d0c5ca33 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:16.320431 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-d1096f16-223d-4a3f-9e56-6c20d0c5ca33 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:16.321215 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-d1096f16-223d-4a3f-9e56-6c20d0c5ca33 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:16.475108 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-d1096f16-223d-4a3f-9e56-6c20d0c5ca33 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2e978bcb824a5e9d593b861c9e3bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7573cb9c503243ab90b1649591d550e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:35:16.487713 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-d1096f16-223d-4a3f-9e56-6c20d0c5ca33 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] 10.222.0.15 "GET /compute/v2.1/servers/d33a2d6b-f17c-4ce3-ad33-9086d790495d" status: 200 len: 1522 microversion: 2.1 time: 0.177269 Oct 31 12:35:16.488869 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 181/370] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:35:16 2022] GET /compute/v2.1/servers/d33a2d6b-f17c-4ce3-ad33-9086d790495d => generated 1522 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:35:16.795691 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-0e7f49d9-8952-4010-9ef9-2716e33ea39e tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:35:16.797073 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-0e7f49d9-8952-4010-9ef9-2716e33ea39e tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] [instance: 852e8870-b3ec-4a21-a9b5-e31a423ddd3d] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:35:16.799531 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG dbcounter [-] [125440] Writing DB stats nova_api:SELECT=76 {{(pid=125440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:35:16.805756 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-0e7f49d9-8952-4010-9ef9-2716e33ea39e tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:16.806253 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-0e7f49d9-8952-4010-9ef9-2716e33ea39e tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:16.806693 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-0e7f49d9-8952-4010-9ef9-2716e33ea39e tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:16.807435 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-0e7f49d9-8952-4010-9ef9-2716e33ea39e tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:16.808111 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-0e7f49d9-8952-4010-9ef9-2716e33ea39e tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:16.808553 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-0e7f49d9-8952-4010-9ef9-2716e33ea39e tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:16.993106 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-0e7f49d9-8952-4010-9ef9-2716e33ea39e tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:35:17.005301 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-0e7f49d9-8952-4010-9ef9-2716e33ea39e tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:35:17.007115 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-0e7f49d9-8952-4010-9ef9-2716e33ea39e tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:35:17.008758 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-0e7f49d9-8952-4010-9ef9-2716e33ea39e tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] 10.222.0.15 "GET /compute/v2.1/servers/852e8870-b3ec-4a21-a9b5-e31a423ddd3d" status: 200 len: 1724 microversion: 2.20 time: 0.216792 Oct 31 12:35:17.009568 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 190/371] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Oct 31 12:35:16 2022] GET /compute/v2.1/servers/852e8870-b3ec-4a21-a9b5-e31a423ddd3d => generated 1724 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 12:35:17.030235 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-6383c4eb-22cd-4c6e-9123-4338e9df6491 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:35:17.031619 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-6383c4eb-22cd-4c6e-9123-4338e9df6491 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] [instance: ff125cf8-e8a5-4f00-ade9-045b18ee33f4] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:35:17.039224 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-6383c4eb-22cd-4c6e-9123-4338e9df6491 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:17.039946 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-6383c4eb-22cd-4c6e-9123-4338e9df6491 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:17.040446 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-6383c4eb-22cd-4c6e-9123-4338e9df6491 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:17.041144 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-6383c4eb-22cd-4c6e-9123-4338e9df6491 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:17.041594 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-6383c4eb-22cd-4c6e-9123-4338e9df6491 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:17.042035 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-6383c4eb-22cd-4c6e-9123-4338e9df6491 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:17.180290 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-6383c4eb-22cd-4c6e-9123-4338e9df6491 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c1beb321e44908ab987b17f7b74484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a2bf9a5a484523a700e4e6c568d4de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:35:17.189651 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-6383c4eb-22cd-4c6e-9123-4338e9df6491 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] 10.222.0.15 "GET /compute/v2.1/servers/ff125cf8-e8a5-4f00-ade9-045b18ee33f4" status: 200 len: 1724 microversion: 2.1 time: 0.163601 Oct 31 12:35:17.190238 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 182/372] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:35:17 2022] GET /compute/v2.1/servers/ff125cf8-e8a5-4f00-ade9-045b18ee33f4 => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:35:17.509752 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-658eee2b-f4f7-4be7-b06a-4d61de75e13f tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:35:17.510351 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-658eee2b-f4f7-4be7-b06a-4d61de75e13f tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] [instance: d33a2d6b-f17c-4ce3-ad33-9086d790495d] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:35:17.516536 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-658eee2b-f4f7-4be7-b06a-4d61de75e13f tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:17.517017 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-658eee2b-f4f7-4be7-b06a-4d61de75e13f tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:17.517452 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-658eee2b-f4f7-4be7-b06a-4d61de75e13f tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:17.518127 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-658eee2b-f4f7-4be7-b06a-4d61de75e13f tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:17.518564 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-658eee2b-f4f7-4be7-b06a-4d61de75e13f tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:17.518978 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-658eee2b-f4f7-4be7-b06a-4d61de75e13f tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:17.658816 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-658eee2b-f4f7-4be7-b06a-4d61de75e13f tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2e978bcb824a5e9d593b861c9e3bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7573cb9c503243ab90b1649591d550e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:35:17.669932 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-658eee2b-f4f7-4be7-b06a-4d61de75e13f tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] 10.222.0.15 "GET /compute/v2.1/servers/d33a2d6b-f17c-4ce3-ad33-9086d790495d" status: 200 len: 1522 microversion: 2.1 time: 0.163860 Oct 31 12:35:17.670688 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 191/373] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:35:17 2022] GET /compute/v2.1/servers/d33a2d6b-f17c-4ce3-ad33-9086d790495d => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:35:18.041106 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-49fa7f94-bbb7-46e8-939c-07e09afdb8c9 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:35:18.041866 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-49fa7f94-bbb7-46e8-939c-07e09afdb8c9 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] [instance: 852e8870-b3ec-4a21-a9b5-e31a423ddd3d] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:35:18.049201 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-49fa7f94-bbb7-46e8-939c-07e09afdb8c9 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:18.049896 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-49fa7f94-bbb7-46e8-939c-07e09afdb8c9 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:18.050333 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-49fa7f94-bbb7-46e8-939c-07e09afdb8c9 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:18.051027 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-49fa7f94-bbb7-46e8-939c-07e09afdb8c9 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:18.051506 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-49fa7f94-bbb7-46e8-939c-07e09afdb8c9 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:18.051956 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-49fa7f94-bbb7-46e8-939c-07e09afdb8c9 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:18.054666 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG dbcounter [-] [125441] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=125441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:35:18.207905 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-49fa7f94-bbb7-46e8-939c-07e09afdb8c9 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:35:18.213337 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-f534927a-b763-47ca-8943-c8a2d268c01a tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:35:18.213938 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-f534927a-b763-47ca-8943-c8a2d268c01a tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] [instance: ff125cf8-e8a5-4f00-ade9-045b18ee33f4] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:35:18.216556 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-49fa7f94-bbb7-46e8-939c-07e09afdb8c9 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:35:18.218010 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-49fa7f94-bbb7-46e8-939c-07e09afdb8c9 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:35:18.219878 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-49fa7f94-bbb7-46e8-939c-07e09afdb8c9 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] 10.222.0.15 "GET /compute/v2.1/servers/852e8870-b3ec-4a21-a9b5-e31a423ddd3d" status: 200 len: 1724 microversion: 2.20 time: 0.182666 Oct 31 12:35:18.235193 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 183/374] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Oct 31 12:35:18 2022] GET /compute/v2.1/servers/852e8870-b3ec-4a21-a9b5-e31a423ddd3d => generated 1724 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 12:35:18.236294 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-f534927a-b763-47ca-8943-c8a2d268c01a tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:18.236294 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-f534927a-b763-47ca-8943-c8a2d268c01a tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:18.236294 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-f534927a-b763-47ca-8943-c8a2d268c01a tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:18.236294 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-f534927a-b763-47ca-8943-c8a2d268c01a tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:18.236614 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-f534927a-b763-47ca-8943-c8a2d268c01a tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:18.236614 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-f534927a-b763-47ca-8943-c8a2d268c01a tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:18.361276 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-f534927a-b763-47ca-8943-c8a2d268c01a tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c1beb321e44908ab987b17f7b74484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a2bf9a5a484523a700e4e6c568d4de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:35:18.369647 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-f534927a-b763-47ca-8943-c8a2d268c01a tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] 10.222.0.15 "GET /compute/v2.1/servers/ff125cf8-e8a5-4f00-ade9-045b18ee33f4" status: 200 len: 1724 microversion: 2.1 time: 0.160040 Oct 31 12:35:18.370239 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 192/375] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:35:18 2022] GET /compute/v2.1/servers/ff125cf8-e8a5-4f00-ade9-045b18ee33f4 => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 12:35:18.693783 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-cf1a6e32-cfdf-4e84-b972-0484d33a3630 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:35:18.694386 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-cf1a6e32-cfdf-4e84-b972-0484d33a3630 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] [instance: d33a2d6b-f17c-4ce3-ad33-9086d790495d] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:35:18.696248 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG dbcounter [-] [125441] Writing DB stats nova_api:SELECT=60 {{(pid=125441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:35:18.701310 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-cf1a6e32-cfdf-4e84-b972-0484d33a3630 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:18.701787 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-cf1a6e32-cfdf-4e84-b972-0484d33a3630 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:18.702219 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-cf1a6e32-cfdf-4e84-b972-0484d33a3630 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:18.703523 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-cf1a6e32-cfdf-4e84-b972-0484d33a3630 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:18.703975 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-cf1a6e32-cfdf-4e84-b972-0484d33a3630 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:18.704390 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-cf1a6e32-cfdf-4e84-b972-0484d33a3630 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:18.834074 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-cf1a6e32-cfdf-4e84-b972-0484d33a3630 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2e978bcb824a5e9d593b861c9e3bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7573cb9c503243ab90b1649591d550e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:35:18.841797 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-cf1a6e32-cfdf-4e84-b972-0484d33a3630 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] 10.222.0.15 "GET /compute/v2.1/servers/d33a2d6b-f17c-4ce3-ad33-9086d790495d" status: 200 len: 1522 microversion: 2.1 time: 0.151808 Oct 31 12:35:18.842369 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 184/376] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:35:18 2022] GET /compute/v2.1/servers/d33a2d6b-f17c-4ce3-ad33-9086d790495d => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:35:19.247193 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-2bf1f85a-48f5-4ead-bac9-48804c3d0588 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:35:19.247823 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-2bf1f85a-48f5-4ead-bac9-48804c3d0588 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] [instance: 852e8870-b3ec-4a21-a9b5-e31a423ddd3d] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:35:19.254588 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-2bf1f85a-48f5-4ead-bac9-48804c3d0588 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:19.255072 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-2bf1f85a-48f5-4ead-bac9-48804c3d0588 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:19.255524 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-2bf1f85a-48f5-4ead-bac9-48804c3d0588 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:19.256212 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-2bf1f85a-48f5-4ead-bac9-48804c3d0588 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:19.256662 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-2bf1f85a-48f5-4ead-bac9-48804c3d0588 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:19.257082 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-2bf1f85a-48f5-4ead-bac9-48804c3d0588 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:19.393705 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-2bf1f85a-48f5-4ead-bac9-48804c3d0588 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:35:19.393895 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-10b6a636-aa41-4d52-8236-66349dd9341d tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:35:19.395041 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-10b6a636-aa41-4d52-8236-66349dd9341d tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] [instance: ff125cf8-e8a5-4f00-ade9-045b18ee33f4] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:35:19.402700 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-10b6a636-aa41-4d52-8236-66349dd9341d tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:19.403030 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-10b6a636-aa41-4d52-8236-66349dd9341d tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:19.403564 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-2bf1f85a-48f5-4ead-bac9-48804c3d0588 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:35:19.403915 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-10b6a636-aa41-4d52-8236-66349dd9341d tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:19.404756 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-10b6a636-aa41-4d52-8236-66349dd9341d tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:19.405143 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-2bf1f85a-48f5-4ead-bac9-48804c3d0588 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:35:19.405618 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-10b6a636-aa41-4d52-8236-66349dd9341d tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:19.406298 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-10b6a636-aa41-4d52-8236-66349dd9341d tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:19.406445 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-2bf1f85a-48f5-4ead-bac9-48804c3d0588 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] 10.222.0.15 "GET /compute/v2.1/servers/852e8870-b3ec-4a21-a9b5-e31a423ddd3d" status: 200 len: 1724 microversion: 2.20 time: 0.163023 Oct 31 12:35:19.407064 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 193/377] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Oct 31 12:35:19 2022] GET /compute/v2.1/servers/852e8870-b3ec-4a21-a9b5-e31a423ddd3d => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 12:35:19.550528 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-10b6a636-aa41-4d52-8236-66349dd9341d tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c1beb321e44908ab987b17f7b74484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a2bf9a5a484523a700e4e6c568d4de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:35:19.558556 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-10b6a636-aa41-4d52-8236-66349dd9341d tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] 10.222.0.15 "GET /compute/v2.1/servers/ff125cf8-e8a5-4f00-ade9-045b18ee33f4" status: 200 len: 1724 microversion: 2.1 time: 0.169901 Oct 31 12:35:19.559112 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 185/378] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:35:19 2022] GET /compute/v2.1/servers/ff125cf8-e8a5-4f00-ade9-045b18ee33f4 => generated 1724 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 12:35:19.865586 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-35eacb02-e830-4d1f-9ceb-5fb1a0948ede tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:35:19.866185 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-35eacb02-e830-4d1f-9ceb-5fb1a0948ede tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] [instance: d33a2d6b-f17c-4ce3-ad33-9086d790495d] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:35:19.872170 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-35eacb02-e830-4d1f-9ceb-5fb1a0948ede tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:19.872639 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-35eacb02-e830-4d1f-9ceb-5fb1a0948ede tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:19.873062 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-35eacb02-e830-4d1f-9ceb-5fb1a0948ede tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:19.873730 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-35eacb02-e830-4d1f-9ceb-5fb1a0948ede tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:19.874171 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-35eacb02-e830-4d1f-9ceb-5fb1a0948ede tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:19.874779 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-35eacb02-e830-4d1f-9ceb-5fb1a0948ede tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:20.003879 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-35eacb02-e830-4d1f-9ceb-5fb1a0948ede tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2e978bcb824a5e9d593b861c9e3bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7573cb9c503243ab90b1649591d550e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:35:20.011528 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-35eacb02-e830-4d1f-9ceb-5fb1a0948ede tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] 10.222.0.15 "GET /compute/v2.1/servers/d33a2d6b-f17c-4ce3-ad33-9086d790495d" status: 200 len: 1502 microversion: 2.1 time: 0.149801 Oct 31 12:35:20.012096 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 194/379] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:35:19 2022] GET /compute/v2.1/servers/d33a2d6b-f17c-4ce3-ad33-9086d790495d => generated 1502 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:35:20.035373 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-04eb1054-971e-4112-b085-9d2ac31449b6 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "31167771-70b3-4d10-866f-709f2c7c96a4"}} {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 12:35:20.037772 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-04eb1054-971e-4112-b085-9d2ac31449b6 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] [instance: d33a2d6b-f17c-4ce3-ad33-9086d790495d] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:35:20.043730 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-04eb1054-971e-4112-b085-9d2ac31449b6 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:20.044255 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-04eb1054-971e-4112-b085-9d2ac31449b6 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:20.044681 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-04eb1054-971e-4112-b085-9d2ac31449b6 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:20.045343 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-04eb1054-971e-4112-b085-9d2ac31449b6 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:20.045799 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-04eb1054-971e-4112-b085-9d2ac31449b6 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:20.046253 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-04eb1054-971e-4112-b085-9d2ac31449b6 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:20.069900 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.wsgi [None req-04eb1054-971e-4112-b085-9d2ac31449b6 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] HTTP exception thrown: Cannot 'attach_volume' instance d33a2d6b-f17c-4ce3-ad33-9086d790495d while it is in vm_state rescued Oct 31 12:35:20.071612 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-04eb1054-971e-4112-b085-9d2ac31449b6 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Request method failure captured: Oct 31 12:35:20.071612 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: request: POST /compute/v2.1/servers/d33a2d6b-f17c-4ce3-ad33-9086d790495d/os-volume_attachments HTTP/1.1 Oct 31 12:35:20.071612 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: Accept: application/json Oct 31 12:35:20.071612 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: Accept-Encoding: identity Oct 31 12:35:20.071612 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: Connection: close Oct 31 12:35:20.071612 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: Content-Length: 74 Oct 31 12:35:20.071612 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: Content-Type: application/json Oct 31 12:35:20.071612 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: Host: 10.222.0.15 Oct 31 12:35:20.071612 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: Openstack-System-Scope: None Oct 31 12:35:20.071612 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: User-Agent: python-urllib3/1.26.12 Oct 31 12:35:20.071612 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Auth-Token: gAAAAABjX8B9TbEC4h9BQ_Pg6iyHk1PnZ6xM8QTj0p7BN52PNmExSmli9L2RQnu8wsaJHiorFY0ROJy8DFUPBMj8D1dWQd22JAoLKdxFZnWHPiWQc3-KjGpPHBlTK_jmIsaeVJlcwD00sScGPd4UgCUOBwD-FKwNC8xgXuheB5YggUWlcx9L5tw Oct 31 12:35:20.071612 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Domain-Id: None Oct 31 12:35:20.071612 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Domain-Name: None Oct 31 12:35:20.071612 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Identity-Status: Confirmed Oct 31 12:35:20.071612 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Is-Admin-Project: True Oct 31 12:35:20.071612 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Project-Domain-Id: default Oct 31 12:35:20.071612 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Project-Domain-Name: Default Oct 31 12:35:20.071612 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Project-Id: 7573cb9c503243ab90b1649591d550e6 Oct 31 12:35:20.071612 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1357722577 Oct 31 12:35:20.071612 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Role: reader,member Oct 31 12:35:20.071612 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Roles: reader,member Oct 31 12:35:20.073149 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/7573cb9c503243ab90b1649591d550e6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_7573cb9c503243ab90b1649591d550e6", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/7573cb9c503243ab90b1649591d550e6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/7573cb9c503243ab90b1649591d550e6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Oct 31 12:35:20.073149 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1357722577 Oct 31 12:35:20.073149 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Tenant-Id: 7573cb9c503243ab90b1649591d550e6 Oct 31 12:35:20.073149 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1357722577 Oct 31 12:35:20.073149 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-User: tempest-ServerRescueNegativeTestJSON-1357722577-project Oct 31 12:35:20.073149 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-User-Domain-Id: default Oct 31 12:35:20.073149 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-User-Domain-Name: Default Oct 31 12:35:20.073149 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-User-Id: db2e978bcb824a5e9d593b861c9e3bd7 Oct 31 12:35:20.073149 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1357722577-project Oct 31 12:35:20.073149 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: Oct 31 12:35:20.073149 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: {"volumeAttachment": {"volumeId": "31167771-70b3-4d10-866f-709f2c7c96a4"}} Oct 31 12:35:20.073149 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: method: > Oct 31 12:35:20.074022 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: exception: Cannot 'attach_volume' instance d33a2d6b-f17c-4ce3-ad33-9086d790495d while it is in vm_state rescued Oct 31 12:35:20.074022 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: action_args: {'server_id': 'd33a2d6b-f17c-4ce3-ad33-9086d790495d', 'body': {'volumeAttachment': {'volumeId': '31167771-70b3-4d10-866f-709f2c7c96a4'}}} Oct 31 12:35:20.074022 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 12:35:20.074022 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 12:35:20.074022 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 31 12:35:20.074022 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 31 12:35:20.074022 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 31 12:35:20.074022 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 31 12:35:20.074022 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 31 12:35:20.074022 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 31 12:35:20.074022 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance d33a2d6b-f17c-4ce3-ad33-9086d790495d in vm_state rescued. Cannot attach_volume while the instance is in this state. Oct 31 12:35:20.074022 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Oct 31 12:35:20.074022 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 12:35:20.074022 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Oct 31 12:35:20.074022 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 12:35:20.074022 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 12:35:20.074022 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 12:35:20.074022 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 12:35:20.074022 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 12:35:20.075480 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 12:35:20.075480 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 12:35:20.075480 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 12:35:20.075480 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 12:35:20.075480 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 12:35:20.075480 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 12:35:20.075480 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 12:35:20.075480 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 12:35:20.075480 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Oct 31 12:35:20.075480 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 31 12:35:20.075480 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 31 12:35:20.075480 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 31 12:35:20.075480 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance d33a2d6b-f17c-4ce3-ad33-9086d790495d while it is in vm_state rescued Oct 31 12:35:20.075480 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Oct 31 12:35:20.075480 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 12:35:20.075480 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Oct 31 12:35:20.075480 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 12:35:20.075480 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 12:35:20.075480 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 12:35:20.076749 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 12:35:20.076749 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 12:35:20.076749 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance d33a2d6b-f17c-4ce3-ad33-9086d790495d while it is in vm_state rescued Oct 31 12:35:20.076749 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Oct 31 12:35:20.076749 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-04eb1054-971e-4112-b085-9d2ac31449b6 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Returning 409 to user: Cannot 'attach_volume' instance d33a2d6b-f17c-4ce3-ad33-9086d790495d while it is in vm_state rescued {{(pid=125441) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 12:35:20.076749 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-04eb1054-971e-4112-b085-9d2ac31449b6 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] 10.222.0.15 "POST /compute/v2.1/servers/d33a2d6b-f17c-4ce3-ad33-9086d790495d/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.042335 Oct 31 12:35:20.076749 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 186/380] 10.222.0.15 () {60 vars in 1323 bytes} [Mon Oct 31 12:35:20 2022] POST /compute/v2.1/servers/d33a2d6b-f17c-4ce3-ad33-9086d790495d/os-volume_attachments => generated 152 bytes in 43 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 31 12:35:20.083216 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-c1be81a0-4c71-4732-ab6a-d51ebd186c8b tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 12:35:20.083673 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-c1be81a0-4c71-4732-ab6a-d51ebd186c8b tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] [instance: d33a2d6b-f17c-4ce3-ad33-9086d790495d] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:35:20.089616 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-c1be81a0-4c71-4732-ab6a-d51ebd186c8b tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:20.090102 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-c1be81a0-4c71-4732-ab6a-d51ebd186c8b tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:20.090539 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-c1be81a0-4c71-4732-ab6a-d51ebd186c8b tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:20.091261 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-c1be81a0-4c71-4732-ab6a-d51ebd186c8b tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:20.091715 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-c1be81a0-4c71-4732-ab6a-d51ebd186c8b tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:20.092156 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-c1be81a0-4c71-4732-ab6a-d51ebd186c8b tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:20.171266 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-c1be81a0-4c71-4732-ab6a-d51ebd186c8b tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] 10.222.0.15 "POST /compute/v2.1/servers/d33a2d6b-f17c-4ce3-ad33-9086d790495d/action" status: 202 len: 0 microversion: 2.1 time: 0.091920 Oct 31 12:35:20.172442 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 195/381] 10.222.0.15 () {60 vars in 1278 bytes} [Mon Oct 31 12:35:20 2022] POST /compute/v2.1/servers/d33a2d6b-f17c-4ce3-ad33-9086d790495d/action => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 12:35:20.180613 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-daa0df81-157c-4389-a526-93ff1a7edcd7 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:35:20.181218 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-daa0df81-157c-4389-a526-93ff1a7edcd7 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] [instance: d33a2d6b-f17c-4ce3-ad33-9086d790495d] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:35:20.187687 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-daa0df81-157c-4389-a526-93ff1a7edcd7 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:20.188272 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-daa0df81-157c-4389-a526-93ff1a7edcd7 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:20.188779 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-daa0df81-157c-4389-a526-93ff1a7edcd7 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:20.189587 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-daa0df81-157c-4389-a526-93ff1a7edcd7 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:20.190042 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-daa0df81-157c-4389-a526-93ff1a7edcd7 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:20.190745 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-daa0df81-157c-4389-a526-93ff1a7edcd7 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:20.341446 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-daa0df81-157c-4389-a526-93ff1a7edcd7 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2e978bcb824a5e9d593b861c9e3bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7573cb9c503243ab90b1649591d550e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:35:20.349638 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-daa0df81-157c-4389-a526-93ff1a7edcd7 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] 10.222.0.15 "GET /compute/v2.1/servers/d33a2d6b-f17c-4ce3-ad33-9086d790495d" status: 200 len: 1510 microversion: 2.1 time: 0.172894 Oct 31 12:35:20.350232 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 187/382] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:35:20 2022] GET /compute/v2.1/servers/d33a2d6b-f17c-4ce3-ad33-9086d790495d => generated 1510 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 12:35:20.437449 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-c2476ef2-2474-4b33-83b4-b7dfe51f2ce1 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:35:20.437990 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-c2476ef2-2474-4b33-83b4-b7dfe51f2ce1 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] [instance: 852e8870-b3ec-4a21-a9b5-e31a423ddd3d] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:35:20.444222 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-c2476ef2-2474-4b33-83b4-b7dfe51f2ce1 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:20.445110 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-c2476ef2-2474-4b33-83b4-b7dfe51f2ce1 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:20.445260 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-c2476ef2-2474-4b33-83b4-b7dfe51f2ce1 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:20.445918 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-c2476ef2-2474-4b33-83b4-b7dfe51f2ce1 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:20.446378 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-c2476ef2-2474-4b33-83b4-b7dfe51f2ce1 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:20.446801 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-c2476ef2-2474-4b33-83b4-b7dfe51f2ce1 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:20.587105 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-ce04be3e-fbc2-4b65-9c53-e895a9fa626f tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:35:20.590474 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-ce04be3e-fbc2-4b65-9c53-e895a9fa626f tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] [instance: ff125cf8-e8a5-4f00-ade9-045b18ee33f4] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:35:20.598758 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-ce04be3e-fbc2-4b65-9c53-e895a9fa626f tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:20.599291 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-ce04be3e-fbc2-4b65-9c53-e895a9fa626f tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:20.599715 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-ce04be3e-fbc2-4b65-9c53-e895a9fa626f tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:20.600449 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-ce04be3e-fbc2-4b65-9c53-e895a9fa626f tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:20.600903 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-ce04be3e-fbc2-4b65-9c53-e895a9fa626f tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:20.601434 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-ce04be3e-fbc2-4b65-9c53-e895a9fa626f tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:20.731719 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-c2476ef2-2474-4b33-83b4-b7dfe51f2ce1 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:35:20.747658 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-c2476ef2-2474-4b33-83b4-b7dfe51f2ce1 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:35:20.752086 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-c2476ef2-2474-4b33-83b4-b7dfe51f2ce1 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:35:20.753440 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-c2476ef2-2474-4b33-83b4-b7dfe51f2ce1 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] 10.222.0.15 "GET /compute/v2.1/servers/852e8870-b3ec-4a21-a9b5-e31a423ddd3d" status: 200 len: 1724 microversion: 2.20 time: 0.322972 Oct 31 12:35:20.756205 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 196/383] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Oct 31 12:35:20 2022] GET /compute/v2.1/servers/852e8870-b3ec-4a21-a9b5-e31a423ddd3d => generated 1724 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 12:35:20.762339 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-ce04be3e-fbc2-4b65-9c53-e895a9fa626f tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c1beb321e44908ab987b17f7b74484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a2bf9a5a484523a700e4e6c568d4de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:35:20.773467 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-ce04be3e-fbc2-4b65-9c53-e895a9fa626f tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] 10.222.0.15 "GET /compute/v2.1/servers/ff125cf8-e8a5-4f00-ade9-045b18ee33f4" status: 200 len: 1724 microversion: 2.1 time: 0.194760 Oct 31 12:35:20.774257 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 188/384] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:35:20 2022] GET /compute/v2.1/servers/ff125cf8-e8a5-4f00-ade9-045b18ee33f4 => generated 1724 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 12:35:21.373022 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-5beae729-71ed-4c06-b8be-993137d6068f tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:35:21.373631 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-5beae729-71ed-4c06-b8be-993137d6068f tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] [instance: d33a2d6b-f17c-4ce3-ad33-9086d790495d] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:35:21.380136 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-5beae729-71ed-4c06-b8be-993137d6068f tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:21.380607 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-5beae729-71ed-4c06-b8be-993137d6068f tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:21.381034 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-5beae729-71ed-4c06-b8be-993137d6068f tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:21.381710 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-5beae729-71ed-4c06-b8be-993137d6068f tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:21.382163 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-5beae729-71ed-4c06-b8be-993137d6068f tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:21.382579 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-5beae729-71ed-4c06-b8be-993137d6068f tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:21.510677 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-5beae729-71ed-4c06-b8be-993137d6068f tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2e978bcb824a5e9d593b861c9e3bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7573cb9c503243ab90b1649591d550e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:35:21.518647 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-5beae729-71ed-4c06-b8be-993137d6068f tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] 10.222.0.15 "GET /compute/v2.1/servers/d33a2d6b-f17c-4ce3-ad33-9086d790495d" status: 200 len: 1510 microversion: 2.1 time: 0.149410 Oct 31 12:35:21.519228 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 197/385] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:35:21 2022] GET /compute/v2.1/servers/d33a2d6b-f17c-4ce3-ad33-9086d790495d => generated 1510 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:35:21.784912 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-7993e9f8-3d0a-4090-bf94-b76bc220b58b tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:35:21.785555 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-7993e9f8-3d0a-4090-bf94-b76bc220b58b tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] [instance: 852e8870-b3ec-4a21-a9b5-e31a423ddd3d] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:35:21.795290 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-7993e9f8-3d0a-4090-bf94-b76bc220b58b tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:21.796000 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-7993e9f8-3d0a-4090-bf94-b76bc220b58b tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:21.797999 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-7993e9f8-3d0a-4090-bf94-b76bc220b58b tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:21.798738 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-7993e9f8-3d0a-4090-bf94-b76bc220b58b tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:21.798881 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-7ffa0023-f4db-4d24-b0f1-1e8e011c278f tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:35:21.799229 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-7993e9f8-3d0a-4090-bf94-b76bc220b58b tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:21.799427 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-7ffa0023-f4db-4d24-b0f1-1e8e011c278f tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] [instance: ff125cf8-e8a5-4f00-ade9-045b18ee33f4] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:35:21.799658 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-7993e9f8-3d0a-4090-bf94-b76bc220b58b tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:21.805680 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-7ffa0023-f4db-4d24-b0f1-1e8e011c278f tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:21.806153 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-7ffa0023-f4db-4d24-b0f1-1e8e011c278f tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:21.806752 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-7ffa0023-f4db-4d24-b0f1-1e8e011c278f tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:21.807460 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-7ffa0023-f4db-4d24-b0f1-1e8e011c278f tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:21.808061 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-7ffa0023-f4db-4d24-b0f1-1e8e011c278f tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:21.808524 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-7ffa0023-f4db-4d24-b0f1-1e8e011c278f tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:21.951622 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-7993e9f8-3d0a-4090-bf94-b76bc220b58b tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:35:21.964026 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-7993e9f8-3d0a-4090-bf94-b76bc220b58b tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:35:21.965751 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-7993e9f8-3d0a-4090-bf94-b76bc220b58b tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:35:21.967361 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-7993e9f8-3d0a-4090-bf94-b76bc220b58b tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] 10.222.0.15 "GET /compute/v2.1/servers/852e8870-b3ec-4a21-a9b5-e31a423ddd3d" status: 200 len: 1724 microversion: 2.20 time: 0.186703 Oct 31 12:35:21.968679 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 189/386] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Oct 31 12:35:21 2022] GET /compute/v2.1/servers/852e8870-b3ec-4a21-a9b5-e31a423ddd3d => generated 1724 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 12:35:21.986100 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-7ffa0023-f4db-4d24-b0f1-1e8e011c278f tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c1beb321e44908ab987b17f7b74484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a2bf9a5a484523a700e4e6c568d4de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:35:21.989814 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG dbcounter [-] [125440] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:35:21.995532 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-7ffa0023-f4db-4d24-b0f1-1e8e011c278f tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] 10.222.0.15 "GET /compute/v2.1/servers/ff125cf8-e8a5-4f00-ade9-045b18ee33f4" status: 200 len: 1724 microversion: 2.1 time: 0.201286 Oct 31 12:35:21.996097 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 198/387] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:35:21 2022] GET /compute/v2.1/servers/ff125cf8-e8a5-4f00-ade9-045b18ee33f4 => generated 1724 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:35:22.541965 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-1ddcb916-5141-4d4d-9046-3cf33a3831ce tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:35:22.542570 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-1ddcb916-5141-4d4d-9046-3cf33a3831ce tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] [instance: d33a2d6b-f17c-4ce3-ad33-9086d790495d] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:35:22.549276 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-1ddcb916-5141-4d4d-9046-3cf33a3831ce tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:22.549752 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-1ddcb916-5141-4d4d-9046-3cf33a3831ce tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:22.550179 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-1ddcb916-5141-4d4d-9046-3cf33a3831ce tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:22.550851 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-1ddcb916-5141-4d4d-9046-3cf33a3831ce tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:22.551326 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-1ddcb916-5141-4d4d-9046-3cf33a3831ce tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:22.551737 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-1ddcb916-5141-4d4d-9046-3cf33a3831ce tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:22.680657 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-1ddcb916-5141-4d4d-9046-3cf33a3831ce tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2e978bcb824a5e9d593b861c9e3bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7573cb9c503243ab90b1649591d550e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:35:22.688998 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-1ddcb916-5141-4d4d-9046-3cf33a3831ce tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] 10.222.0.15 "GET /compute/v2.1/servers/d33a2d6b-f17c-4ce3-ad33-9086d790495d" status: 200 len: 1510 microversion: 2.1 time: 0.150921 Oct 31 12:35:22.689566 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 190/388] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:35:22 2022] GET /compute/v2.1/servers/d33a2d6b-f17c-4ce3-ad33-9086d790495d => generated 1510 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:35:22.994817 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-2ecdc6d5-b8b7-4b8d-96d2-b63721824d00 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:35:22.995439 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-2ecdc6d5-b8b7-4b8d-96d2-b63721824d00 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] [instance: 852e8870-b3ec-4a21-a9b5-e31a423ddd3d] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:35:23.003191 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-2ecdc6d5-b8b7-4b8d-96d2-b63721824d00 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:23.003757 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-2ecdc6d5-b8b7-4b8d-96d2-b63721824d00 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:23.004181 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-2ecdc6d5-b8b7-4b8d-96d2-b63721824d00 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:23.004854 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-2ecdc6d5-b8b7-4b8d-96d2-b63721824d00 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:23.005300 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-2ecdc6d5-b8b7-4b8d-96d2-b63721824d00 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:23.005714 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-2ecdc6d5-b8b7-4b8d-96d2-b63721824d00 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:23.019345 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-fd954d2d-9ae4-4646-ab75-239630ba2da2 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:35:23.019963 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-fd954d2d-9ae4-4646-ab75-239630ba2da2 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] [instance: ff125cf8-e8a5-4f00-ade9-045b18ee33f4] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:35:23.027344 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-fd954d2d-9ae4-4646-ab75-239630ba2da2 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:23.028046 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-fd954d2d-9ae4-4646-ab75-239630ba2da2 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:23.028633 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-fd954d2d-9ae4-4646-ab75-239630ba2da2 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:23.029595 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-fd954d2d-9ae4-4646-ab75-239630ba2da2 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:23.030209 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-fd954d2d-9ae4-4646-ab75-239630ba2da2 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:23.030858 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-fd954d2d-9ae4-4646-ab75-239630ba2da2 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:23.150298 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-2ecdc6d5-b8b7-4b8d-96d2-b63721824d00 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:35:23.165688 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-fd954d2d-9ae4-4646-ab75-239630ba2da2 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c1beb321e44908ab987b17f7b74484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a2bf9a5a484523a700e4e6c568d4de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:35:23.174779 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-fd954d2d-9ae4-4646-ab75-239630ba2da2 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] 10.222.0.15 "GET /compute/v2.1/servers/ff125cf8-e8a5-4f00-ade9-045b18ee33f4" status: 200 len: 1724 microversion: 2.1 time: 0.159371 Oct 31 12:35:23.177095 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 191/389] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:35:23 2022] GET /compute/v2.1/servers/ff125cf8-e8a5-4f00-ade9-045b18ee33f4 => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 12:35:23.177250 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-2ecdc6d5-b8b7-4b8d-96d2-b63721824d00 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:35:23.178553 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-2ecdc6d5-b8b7-4b8d-96d2-b63721824d00 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:35:23.179795 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-2ecdc6d5-b8b7-4b8d-96d2-b63721824d00 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] 10.222.0.15 "GET /compute/v2.1/servers/852e8870-b3ec-4a21-a9b5-e31a423ddd3d" status: 200 len: 1724 microversion: 2.20 time: 0.189634 Oct 31 12:35:23.180416 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 199/390] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Oct 31 12:35:22 2022] GET /compute/v2.1/servers/852e8870-b3ec-4a21-a9b5-e31a423ddd3d => generated 1724 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 12:35:23.712605 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-d1082657-ba28-46f5-aa76-d07d96d3f140 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:35:23.713216 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-d1082657-ba28-46f5-aa76-d07d96d3f140 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] [instance: d33a2d6b-f17c-4ce3-ad33-9086d790495d] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:35:23.719553 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-d1082657-ba28-46f5-aa76-d07d96d3f140 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:23.720031 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-d1082657-ba28-46f5-aa76-d07d96d3f140 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:23.720474 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-d1082657-ba28-46f5-aa76-d07d96d3f140 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:23.721141 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-d1082657-ba28-46f5-aa76-d07d96d3f140 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:23.721748 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-d1082657-ba28-46f5-aa76-d07d96d3f140 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:23.722229 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-d1082657-ba28-46f5-aa76-d07d96d3f140 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:23.855496 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-d1082657-ba28-46f5-aa76-d07d96d3f140 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2e978bcb824a5e9d593b861c9e3bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7573cb9c503243ab90b1649591d550e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:35:23.863638 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-d1082657-ba28-46f5-aa76-d07d96d3f140 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] 10.222.0.15 "GET /compute/v2.1/servers/d33a2d6b-f17c-4ce3-ad33-9086d790495d" status: 200 len: 1510 microversion: 2.1 time: 0.154876 Oct 31 12:35:23.864196 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 192/391] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:35:23 2022] GET /compute/v2.1/servers/d33a2d6b-f17c-4ce3-ad33-9086d790495d => generated 1510 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:35:24.198457 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-2f7dd1a4-92ba-4d4d-956c-0ae8390b9f49 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:35:24.199062 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-2f7dd1a4-92ba-4d4d-956c-0ae8390b9f49 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] [instance: ff125cf8-e8a5-4f00-ade9-045b18ee33f4] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:35:24.205843 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-2f7dd1a4-92ba-4d4d-956c-0ae8390b9f49 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:24.206209 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-a23c0686-28ae-4197-bc83-feb9ec7b8c8f tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:35:24.206643 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-2f7dd1a4-92ba-4d4d-956c-0ae8390b9f49 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:24.206738 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-2f7dd1a4-92ba-4d4d-956c-0ae8390b9f49 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:24.208172 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-2f7dd1a4-92ba-4d4d-956c-0ae8390b9f49 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:24.208621 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-2f7dd1a4-92ba-4d4d-956c-0ae8390b9f49 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:24.209036 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-2f7dd1a4-92ba-4d4d-956c-0ae8390b9f49 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:24.211205 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-a23c0686-28ae-4197-bc83-feb9ec7b8c8f tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] [instance: 852e8870-b3ec-4a21-a9b5-e31a423ddd3d] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:35:24.220386 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-a23c0686-28ae-4197-bc83-feb9ec7b8c8f tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:24.220998 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-a23c0686-28ae-4197-bc83-feb9ec7b8c8f tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:24.221428 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-a23c0686-28ae-4197-bc83-feb9ec7b8c8f tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:24.222124 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-a23c0686-28ae-4197-bc83-feb9ec7b8c8f tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:24.222575 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-a23c0686-28ae-4197-bc83-feb9ec7b8c8f tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:24.222994 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-a23c0686-28ae-4197-bc83-feb9ec7b8c8f tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:24.341420 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-2f7dd1a4-92ba-4d4d-956c-0ae8390b9f49 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c1beb321e44908ab987b17f7b74484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a2bf9a5a484523a700e4e6c568d4de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:35:24.349846 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-2f7dd1a4-92ba-4d4d-956c-0ae8390b9f49 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] 10.222.0.15 "GET /compute/v2.1/servers/ff125cf8-e8a5-4f00-ade9-045b18ee33f4" status: 200 len: 1724 microversion: 2.1 time: 0.155529 Oct 31 12:35:24.350423 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 200/392] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:35:24 2022] GET /compute/v2.1/servers/ff125cf8-e8a5-4f00-ade9-045b18ee33f4 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:35:24.355427 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-a23c0686-28ae-4197-bc83-feb9ec7b8c8f tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:35:24.364268 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-a23c0686-28ae-4197-bc83-feb9ec7b8c8f tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:35:24.365728 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-a23c0686-28ae-4197-bc83-feb9ec7b8c8f tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:35:24.366867 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-a23c0686-28ae-4197-bc83-feb9ec7b8c8f tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] 10.222.0.15 "GET /compute/v2.1/servers/852e8870-b3ec-4a21-a9b5-e31a423ddd3d" status: 200 len: 1724 microversion: 2.20 time: 0.165550 Oct 31 12:35:24.367448 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 193/393] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Oct 31 12:35:24 2022] GET /compute/v2.1/servers/852e8870-b3ec-4a21-a9b5-e31a423ddd3d => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 12:35:24.885820 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-4d6d91ae-b6f7-451a-82be-a239f75c5032 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:35:24.886365 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-4d6d91ae-b6f7-451a-82be-a239f75c5032 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] [instance: d33a2d6b-f17c-4ce3-ad33-9086d790495d] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:35:24.892483 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-4d6d91ae-b6f7-451a-82be-a239f75c5032 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:24.892958 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-4d6d91ae-b6f7-451a-82be-a239f75c5032 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:24.893383 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-4d6d91ae-b6f7-451a-82be-a239f75c5032 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:24.894078 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-4d6d91ae-b6f7-451a-82be-a239f75c5032 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:24.894507 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-4d6d91ae-b6f7-451a-82be-a239f75c5032 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:24.894922 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-4d6d91ae-b6f7-451a-82be-a239f75c5032 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:25.029136 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-4d6d91ae-b6f7-451a-82be-a239f75c5032 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2e978bcb824a5e9d593b861c9e3bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7573cb9c503243ab90b1649591d550e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:35:25.038459 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-4d6d91ae-b6f7-451a-82be-a239f75c5032 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] 10.222.0.15 "GET /compute/v2.1/servers/d33a2d6b-f17c-4ce3-ad33-9086d790495d" status: 200 len: 1510 microversion: 2.1 time: 0.156516 Oct 31 12:35:25.039027 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 201/394] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:35:24 2022] GET /compute/v2.1/servers/d33a2d6b-f17c-4ce3-ad33-9086d790495d => generated 1510 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:35:25.373510 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-d259d85b-479b-4c43-9afe-ce47fb09e16c tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:35:25.374122 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-d259d85b-479b-4c43-9afe-ce47fb09e16c tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] [instance: ff125cf8-e8a5-4f00-ade9-045b18ee33f4] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:35:25.381763 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-d259d85b-479b-4c43-9afe-ce47fb09e16c tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:25.382240 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-d259d85b-479b-4c43-9afe-ce47fb09e16c tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:25.382665 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-d259d85b-479b-4c43-9afe-ce47fb09e16c tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:25.383378 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-d259d85b-479b-4c43-9afe-ce47fb09e16c tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:25.383825 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-d259d85b-479b-4c43-9afe-ce47fb09e16c tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:25.384242 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-d259d85b-479b-4c43-9afe-ce47fb09e16c tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:25.394755 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-fd7c4d51-f672-42a1-9083-258d5cb8d17f tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:35:25.395720 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-fd7c4d51-f672-42a1-9083-258d5cb8d17f tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] [instance: 852e8870-b3ec-4a21-a9b5-e31a423ddd3d] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:35:25.402601 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-fd7c4d51-f672-42a1-9083-258d5cb8d17f tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:25.403396 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-fd7c4d51-f672-42a1-9083-258d5cb8d17f tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:25.404010 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-fd7c4d51-f672-42a1-9083-258d5cb8d17f tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:25.404797 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-fd7c4d51-f672-42a1-9083-258d5cb8d17f tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:25.405337 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-fd7c4d51-f672-42a1-9083-258d5cb8d17f tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:25.405852 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-fd7c4d51-f672-42a1-9083-258d5cb8d17f tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:25.542102 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-fd7c4d51-f672-42a1-9083-258d5cb8d17f tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:35:25.550296 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-fd7c4d51-f672-42a1-9083-258d5cb8d17f tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:35:25.552056 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-fd7c4d51-f672-42a1-9083-258d5cb8d17f tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:35:25.553190 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-fd7c4d51-f672-42a1-9083-258d5cb8d17f tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] 10.222.0.15 "GET /compute/v2.1/servers/852e8870-b3ec-4a21-a9b5-e31a423ddd3d" status: 200 len: 1724 microversion: 2.20 time: 0.164531 Oct 31 12:35:25.553737 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 202/395] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Oct 31 12:35:25 2022] GET /compute/v2.1/servers/852e8870-b3ec-4a21-a9b5-e31a423ddd3d => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 12:35:25.634375 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-d259d85b-479b-4c43-9afe-ce47fb09e16c tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c1beb321e44908ab987b17f7b74484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a2bf9a5a484523a700e4e6c568d4de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:35:25.642995 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-d259d85b-479b-4c43-9afe-ce47fb09e16c tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] 10.222.0.15 "GET /compute/v2.1/servers/ff125cf8-e8a5-4f00-ade9-045b18ee33f4" status: 200 len: 1724 microversion: 2.1 time: 0.273351 Oct 31 12:35:25.643656 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 194/396] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:35:25 2022] GET /compute/v2.1/servers/ff125cf8-e8a5-4f00-ade9-045b18ee33f4 => generated 1724 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:35:26.061555 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-eed25a4e-e831-4925-abe1-ea01f5a30487 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:35:26.062151 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-eed25a4e-e831-4925-abe1-ea01f5a30487 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] [instance: d33a2d6b-f17c-4ce3-ad33-9086d790495d] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:35:26.068092 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-eed25a4e-e831-4925-abe1-ea01f5a30487 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:26.068563 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-eed25a4e-e831-4925-abe1-ea01f5a30487 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:26.068985 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-eed25a4e-e831-4925-abe1-ea01f5a30487 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:26.069662 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-eed25a4e-e831-4925-abe1-ea01f5a30487 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:26.070105 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-eed25a4e-e831-4925-abe1-ea01f5a30487 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:26.070516 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-eed25a4e-e831-4925-abe1-ea01f5a30487 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:26.210594 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-eed25a4e-e831-4925-abe1-ea01f5a30487 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2e978bcb824a5e9d593b861c9e3bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7573cb9c503243ab90b1649591d550e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:35:26.218372 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-eed25a4e-e831-4925-abe1-ea01f5a30487 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] 10.222.0.15 "GET /compute/v2.1/servers/d33a2d6b-f17c-4ce3-ad33-9086d790495d" status: 200 len: 1510 microversion: 2.1 time: 0.160900 Oct 31 12:35:26.219410 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 203/397] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:35:26 2022] GET /compute/v2.1/servers/d33a2d6b-f17c-4ce3-ad33-9086d790495d => generated 1510 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:35:26.578809 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-ca338720-c1c9-48e0-abbf-c311be95baf6 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:35:26.579458 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-ca338720-c1c9-48e0-abbf-c311be95baf6 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] [instance: 852e8870-b3ec-4a21-a9b5-e31a423ddd3d] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:35:26.585807 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-ca338720-c1c9-48e0-abbf-c311be95baf6 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:26.586280 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-ca338720-c1c9-48e0-abbf-c311be95baf6 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:26.586707 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-ca338720-c1c9-48e0-abbf-c311be95baf6 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:26.587408 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-ca338720-c1c9-48e0-abbf-c311be95baf6 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:26.587863 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-ca338720-c1c9-48e0-abbf-c311be95baf6 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:26.588279 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-ca338720-c1c9-48e0-abbf-c311be95baf6 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:26.665796 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-a9f3f1f2-04ca-452c-af4c-5429109bd1c0 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:35:26.666393 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-a9f3f1f2-04ca-452c-af4c-5429109bd1c0 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] [instance: ff125cf8-e8a5-4f00-ade9-045b18ee33f4] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:35:26.673276 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-a9f3f1f2-04ca-452c-af4c-5429109bd1c0 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:26.673748 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-a9f3f1f2-04ca-452c-af4c-5429109bd1c0 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:26.674172 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-a9f3f1f2-04ca-452c-af4c-5429109bd1c0 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:26.674849 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-a9f3f1f2-04ca-452c-af4c-5429109bd1c0 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:26.675448 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-a9f3f1f2-04ca-452c-af4c-5429109bd1c0 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:26.675861 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-a9f3f1f2-04ca-452c-af4c-5429109bd1c0 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:26.718730 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-ca338720-c1c9-48e0-abbf-c311be95baf6 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:35:26.727109 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-ca338720-c1c9-48e0-abbf-c311be95baf6 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:35:26.728577 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-ca338720-c1c9-48e0-abbf-c311be95baf6 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:35:26.729734 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-ca338720-c1c9-48e0-abbf-c311be95baf6 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] 10.222.0.15 "GET /compute/v2.1/servers/852e8870-b3ec-4a21-a9b5-e31a423ddd3d" status: 200 len: 1724 microversion: 2.20 time: 0.154890 Oct 31 12:35:26.730540 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 195/398] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Oct 31 12:35:26 2022] GET /compute/v2.1/servers/852e8870-b3ec-4a21-a9b5-e31a423ddd3d => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 12:35:26.809570 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-a9f3f1f2-04ca-452c-af4c-5429109bd1c0 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c1beb321e44908ab987b17f7b74484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a2bf9a5a484523a700e4e6c568d4de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:35:26.818463 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-a9f3f1f2-04ca-452c-af4c-5429109bd1c0 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] 10.222.0.15 "GET /compute/v2.1/servers/ff125cf8-e8a5-4f00-ade9-045b18ee33f4" status: 200 len: 1724 microversion: 2.1 time: 0.156518 Oct 31 12:35:26.819032 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 204/399] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:35:26 2022] GET /compute/v2.1/servers/ff125cf8-e8a5-4f00-ade9-045b18ee33f4 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 12:35:27.240111 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-bbc22c7e-014b-440d-b929-3b47bdb0f21f tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:35:27.240715 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-bbc22c7e-014b-440d-b929-3b47bdb0f21f tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] [instance: d33a2d6b-f17c-4ce3-ad33-9086d790495d] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:35:27.246513 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-bbc22c7e-014b-440d-b929-3b47bdb0f21f tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:27.246992 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-bbc22c7e-014b-440d-b929-3b47bdb0f21f tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:27.247454 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-bbc22c7e-014b-440d-b929-3b47bdb0f21f tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:27.248135 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-bbc22c7e-014b-440d-b929-3b47bdb0f21f tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:27.248585 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-bbc22c7e-014b-440d-b929-3b47bdb0f21f tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:27.249002 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-bbc22c7e-014b-440d-b929-3b47bdb0f21f tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:27.378212 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-bbc22c7e-014b-440d-b929-3b47bdb0f21f tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2e978bcb824a5e9d593b861c9e3bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7573cb9c503243ab90b1649591d550e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:35:27.386025 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-bbc22c7e-014b-440d-b929-3b47bdb0f21f tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] 10.222.0.15 "GET /compute/v2.1/servers/d33a2d6b-f17c-4ce3-ad33-9086d790495d" status: 200 len: 1510 microversion: 2.1 time: 0.149762 Oct 31 12:35:27.386597 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 196/400] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:35:27 2022] GET /compute/v2.1/servers/d33a2d6b-f17c-4ce3-ad33-9086d790495d => generated 1510 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:35:27.756517 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-ebfb9616-7f75-46fb-9b6c-4af66b4d7995 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:35:27.757057 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-ebfb9616-7f75-46fb-9b6c-4af66b4d7995 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] [instance: 852e8870-b3ec-4a21-a9b5-e31a423ddd3d] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:35:27.763943 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-ebfb9616-7f75-46fb-9b6c-4af66b4d7995 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:27.764550 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-ebfb9616-7f75-46fb-9b6c-4af66b4d7995 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:27.765099 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-ebfb9616-7f75-46fb-9b6c-4af66b4d7995 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:27.766068 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-ebfb9616-7f75-46fb-9b6c-4af66b4d7995 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:27.766696 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-ebfb9616-7f75-46fb-9b6c-4af66b4d7995 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:27.767919 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-ebfb9616-7f75-46fb-9b6c-4af66b4d7995 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:27.841935 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-f8406979-2bca-4d0b-aaf9-632f05cc851e tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:35:27.842540 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-f8406979-2bca-4d0b-aaf9-632f05cc851e tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] [instance: ff125cf8-e8a5-4f00-ade9-045b18ee33f4] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:35:27.848978 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-f8406979-2bca-4d0b-aaf9-632f05cc851e tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:27.849452 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-f8406979-2bca-4d0b-aaf9-632f05cc851e tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:27.849873 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-f8406979-2bca-4d0b-aaf9-632f05cc851e tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:27.850555 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-f8406979-2bca-4d0b-aaf9-632f05cc851e tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:27.851001 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-f8406979-2bca-4d0b-aaf9-632f05cc851e tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:27.851439 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-f8406979-2bca-4d0b-aaf9-632f05cc851e tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:27.899184 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-ebfb9616-7f75-46fb-9b6c-4af66b4d7995 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:35:27.907249 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-ebfb9616-7f75-46fb-9b6c-4af66b4d7995 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:35:27.908713 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-ebfb9616-7f75-46fb-9b6c-4af66b4d7995 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:35:27.909821 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-ebfb9616-7f75-46fb-9b6c-4af66b4d7995 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] 10.222.0.15 "GET /compute/v2.1/servers/852e8870-b3ec-4a21-a9b5-e31a423ddd3d" status: 200 len: 1724 microversion: 2.20 time: 0.157337 Oct 31 12:35:27.910385 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 205/401] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Oct 31 12:35:27 2022] GET /compute/v2.1/servers/852e8870-b3ec-4a21-a9b5-e31a423ddd3d => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 12:35:27.983730 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-f8406979-2bca-4d0b-aaf9-632f05cc851e tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c1beb321e44908ab987b17f7b74484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a2bf9a5a484523a700e4e6c568d4de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:35:28.004312 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-f8406979-2bca-4d0b-aaf9-632f05cc851e tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] 10.222.0.15 "GET /compute/v2.1/servers/ff125cf8-e8a5-4f00-ade9-045b18ee33f4" status: 200 len: 1724 microversion: 2.1 time: 0.166230 Oct 31 12:35:28.004889 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 197/402] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:35:27 2022] GET /compute/v2.1/servers/ff125cf8-e8a5-4f00-ade9-045b18ee33f4 => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 12:35:28.412092 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-8b324309-0b9c-4ede-b738-1cf355db187d tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:35:28.412765 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-8b324309-0b9c-4ede-b738-1cf355db187d tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] [instance: d33a2d6b-f17c-4ce3-ad33-9086d790495d] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:35:28.418794 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-8b324309-0b9c-4ede-b738-1cf355db187d tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:28.419315 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-8b324309-0b9c-4ede-b738-1cf355db187d tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:28.419738 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-8b324309-0b9c-4ede-b738-1cf355db187d tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:28.420413 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-8b324309-0b9c-4ede-b738-1cf355db187d tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:28.420863 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-8b324309-0b9c-4ede-b738-1cf355db187d tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:28.421280 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-8b324309-0b9c-4ede-b738-1cf355db187d tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:28.557163 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-8b324309-0b9c-4ede-b738-1cf355db187d tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2e978bcb824a5e9d593b861c9e3bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7573cb9c503243ab90b1649591d550e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:35:28.564961 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-8b324309-0b9c-4ede-b738-1cf355db187d tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] 10.222.0.15 "GET /compute/v2.1/servers/d33a2d6b-f17c-4ce3-ad33-9086d790495d" status: 200 len: 1510 microversion: 2.1 time: 0.157459 Oct 31 12:35:28.565748 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 206/403] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:35:28 2022] GET /compute/v2.1/servers/d33a2d6b-f17c-4ce3-ad33-9086d790495d => generated 1510 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:35:28.935615 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-f20773f3-0c07-491f-97fc-fcbc6a7f134d tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:35:28.936221 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-f20773f3-0c07-491f-97fc-fcbc6a7f134d tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] [instance: 852e8870-b3ec-4a21-a9b5-e31a423ddd3d] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:35:28.942555 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-f20773f3-0c07-491f-97fc-fcbc6a7f134d tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:28.943028 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-f20773f3-0c07-491f-97fc-fcbc6a7f134d tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:28.943497 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-f20773f3-0c07-491f-97fc-fcbc6a7f134d tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:28.944181 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-f20773f3-0c07-491f-97fc-fcbc6a7f134d tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:28.944631 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-f20773f3-0c07-491f-97fc-fcbc6a7f134d tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:28.945073 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-f20773f3-0c07-491f-97fc-fcbc6a7f134d tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:29.036217 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-8265bf01-efef-4ea2-8576-956d72a19094 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:35:29.036818 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-8265bf01-efef-4ea2-8576-956d72a19094 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] [instance: ff125cf8-e8a5-4f00-ade9-045b18ee33f4] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:35:29.043098 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-8265bf01-efef-4ea2-8576-956d72a19094 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:29.043610 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-8265bf01-efef-4ea2-8576-956d72a19094 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:29.044026 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-8265bf01-efef-4ea2-8576-956d72a19094 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:29.044715 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-8265bf01-efef-4ea2-8576-956d72a19094 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:29.045161 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-8265bf01-efef-4ea2-8576-956d72a19094 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:29.045572 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-8265bf01-efef-4ea2-8576-956d72a19094 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:29.079601 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-f20773f3-0c07-491f-97fc-fcbc6a7f134d tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:35:29.088765 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-f20773f3-0c07-491f-97fc-fcbc6a7f134d tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:35:29.090218 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-f20773f3-0c07-491f-97fc-fcbc6a7f134d tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:35:29.091434 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-f20773f3-0c07-491f-97fc-fcbc6a7f134d tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] 10.222.0.15 "GET /compute/v2.1/servers/852e8870-b3ec-4a21-a9b5-e31a423ddd3d" status: 200 len: 1724 microversion: 2.20 time: 0.159699 Oct 31 12:35:29.091993 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 198/404] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Oct 31 12:35:28 2022] GET /compute/v2.1/servers/852e8870-b3ec-4a21-a9b5-e31a423ddd3d => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 12:35:29.176169 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-8265bf01-efef-4ea2-8576-956d72a19094 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c1beb321e44908ab987b17f7b74484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a2bf9a5a484523a700e4e6c568d4de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:35:29.184350 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-8265bf01-efef-4ea2-8576-956d72a19094 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] 10.222.0.15 "GET /compute/v2.1/servers/ff125cf8-e8a5-4f00-ade9-045b18ee33f4" status: 200 len: 1701 microversion: 2.1 time: 0.151961 Oct 31 12:35:29.184924 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 207/405] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:35:29 2022] GET /compute/v2.1/servers/ff125cf8-e8a5-4f00-ade9-045b18ee33f4 => generated 1701 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:35:29.208030 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-0fc746ec-9508-42ef-a8b4-64a1f07c1945 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 12:35:29.213926 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-0fc746ec-9508-42ef-a8b4-64a1f07c1945 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:29.214406 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-0fc746ec-9508-42ef-a8b4-64a1f07c1945 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:29.214835 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-0fc746ec-9508-42ef-a8b4-64a1f07c1945 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:29.276683 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-0fc746ec-9508-42ef-a8b4-64a1f07c1945 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] [instance: ff125cf8-e8a5-4f00-ade9-045b18ee33f4] Going to try to start instance {{(pid=125441) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 31 12:35:29.294387 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG dbcounter [-] [125441] Writing DB stats nova_cell1:SELECT=100 {{(pid=125441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:35:29.327622 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-0fc746ec-9508-42ef-a8b4-64a1f07c1945 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] 10.222.0.15 "POST /compute/v2.1/servers/ff125cf8-e8a5-4f00-ade9-045b18ee33f4/action" status: 202 len: 0 microversion: 2.1 time: 0.123931 Oct 31 12:35:29.328924 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 199/406] 10.222.0.15 () {60 vars in 1278 bytes} [Mon Oct 31 12:35:29 2022] POST /compute/v2.1/servers/ff125cf8-e8a5-4f00-ade9-045b18ee33f4/action => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 12:35:29.343486 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-d6bcb779-082f-4748-81da-552d4c3feb87 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:35:29.344078 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-d6bcb779-082f-4748-81da-552d4c3feb87 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] [instance: ff125cf8-e8a5-4f00-ade9-045b18ee33f4] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:35:29.350759 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-d6bcb779-082f-4748-81da-552d4c3feb87 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:29.351268 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-d6bcb779-082f-4748-81da-552d4c3feb87 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:29.351696 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-d6bcb779-082f-4748-81da-552d4c3feb87 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:29.352388 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-d6bcb779-082f-4748-81da-552d4c3feb87 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:29.352835 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-d6bcb779-082f-4748-81da-552d4c3feb87 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:29.353248 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-d6bcb779-082f-4748-81da-552d4c3feb87 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:29.500392 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-d6bcb779-082f-4748-81da-552d4c3feb87 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c1beb321e44908ab987b17f7b74484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a2bf9a5a484523a700e4e6c568d4de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:35:29.509467 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-d6bcb779-082f-4748-81da-552d4c3feb87 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] 10.222.0.15 "GET /compute/v2.1/servers/ff125cf8-e8a5-4f00-ade9-045b18ee33f4" status: 200 len: 1710 microversion: 2.1 time: 0.169968 Oct 31 12:35:29.510022 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 208/407] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:35:29 2022] GET /compute/v2.1/servers/ff125cf8-e8a5-4f00-ade9-045b18ee33f4 => generated 1710 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:35:29.588527 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-c0431edb-0da9-471d-aea3-3fd94004f7a4 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:35:29.589277 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-c0431edb-0da9-471d-aea3-3fd94004f7a4 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] [instance: d33a2d6b-f17c-4ce3-ad33-9086d790495d] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:35:29.596187 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-c0431edb-0da9-471d-aea3-3fd94004f7a4 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:29.596939 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-c0431edb-0da9-471d-aea3-3fd94004f7a4 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:29.597408 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-c0431edb-0da9-471d-aea3-3fd94004f7a4 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:29.598102 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-c0431edb-0da9-471d-aea3-3fd94004f7a4 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:29.598553 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-c0431edb-0da9-471d-aea3-3fd94004f7a4 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:29.598971 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-c0431edb-0da9-471d-aea3-3fd94004f7a4 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:29.757168 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-c0431edb-0da9-471d-aea3-3fd94004f7a4 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2e978bcb824a5e9d593b861c9e3bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7573cb9c503243ab90b1649591d550e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:35:29.758317 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-c0431edb-0da9-471d-aea3-3fd94004f7a4 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] 10.222.0.15 "GET /compute/v2.1/servers/d33a2d6b-f17c-4ce3-ad33-9086d790495d" status: 200 len: 1516 microversion: 2.1 time: 0.173943 Oct 31 12:35:29.759239 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 200/408] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:35:29 2022] GET /compute/v2.1/servers/d33a2d6b-f17c-4ce3-ad33-9086d790495d => generated 1516 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 12:35:30.119792 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-873e9a48-9ff6-4696-bda9-318d9c1e0bda tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:35:30.122504 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-873e9a48-9ff6-4696-bda9-318d9c1e0bda tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] [instance: 852e8870-b3ec-4a21-a9b5-e31a423ddd3d] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:35:30.131135 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-873e9a48-9ff6-4696-bda9-318d9c1e0bda tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:30.132848 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-873e9a48-9ff6-4696-bda9-318d9c1e0bda tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:30.133287 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-873e9a48-9ff6-4696-bda9-318d9c1e0bda tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:30.133999 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-873e9a48-9ff6-4696-bda9-318d9c1e0bda tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:30.134450 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-873e9a48-9ff6-4696-bda9-318d9c1e0bda tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:30.134867 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-873e9a48-9ff6-4696-bda9-318d9c1e0bda tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:30.273949 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-11ea3648-5490-4c5e-8c04-4a24a29b3da3 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Action: 'create', calling method: .version_select at 0x7f2aa518af70>, body: {"keypair": {"name": "tempest-keypair-913735954", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD5uvjunbqlBMSnAkzoSZZZR+t/kdX5lAZsPzmNKiSrYd/b89rZQqSqR2EfOUu36/IPSE9vtKI77HkPEOjjtvI3zF43oJpWBtpezqj2NMDWg8RIOFg9gPO1vRT0cZpUftA=="}} {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 12:35:30.290707 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.quota [None req-11ea3648-5490-4c5e-8c04-4a24a29b3da3 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Getting quotas for project bfbc3a46f12942299b99cdd20c989e1f. Resources: {'key_pairs'} {{(pid=125441) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 12:35:30.294780 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.quota [None req-11ea3648-5490-4c5e-8c04-4a24a29b3da3 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Getting quotas for user b2c03f0365ee4a26b8c076ae365325b2 and project bfbc3a46f12942299b99cdd20c989e1f. Resources: {'key_pairs'} {{(pid=125441) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 12:35:30.320173 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-11ea3648-5490-4c5e-8c04-4a24a29b3da3 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.050257 Oct 31 12:35:30.320777 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 201/409] 10.222.0.15 () {60 vars in 1159 bytes} [Mon Oct 31 12:35:30 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 12:35:30.373246 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-873e9a48-9ff6-4696-bda9-318d9c1e0bda tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:35:30.384640 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-873e9a48-9ff6-4696-bda9-318d9c1e0bda tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:35:30.386237 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-873e9a48-9ff6-4696-bda9-318d9c1e0bda tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:35:30.387546 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-873e9a48-9ff6-4696-bda9-318d9c1e0bda tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] 10.222.0.15 "GET /compute/v2.1/servers/852e8870-b3ec-4a21-a9b5-e31a423ddd3d" status: 200 len: 1724 microversion: 2.20 time: 0.273510 Oct 31 12:35:30.388185 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 209/410] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Oct 31 12:35:30 2022] GET /compute/v2.1/servers/852e8870-b3ec-4a21-a9b5-e31a423ddd3d => generated 1724 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 12:35:30.533978 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-b83b83c5-43b1-4766-9f05-b76d0c6666e2 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:35:30.534654 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-b83b83c5-43b1-4766-9f05-b76d0c6666e2 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] [instance: ff125cf8-e8a5-4f00-ade9-045b18ee33f4] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:35:30.540551 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-b83b83c5-43b1-4766-9f05-b76d0c6666e2 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:30.541030 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-b83b83c5-43b1-4766-9f05-b76d0c6666e2 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:30.541456 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-b83b83c5-43b1-4766-9f05-b76d0c6666e2 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:30.542134 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-b83b83c5-43b1-4766-9f05-b76d0c6666e2 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:30.542579 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-b83b83c5-43b1-4766-9f05-b76d0c6666e2 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:30.543016 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-b83b83c5-43b1-4766-9f05-b76d0c6666e2 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:30.676967 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-b83b83c5-43b1-4766-9f05-b76d0c6666e2 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c1beb321e44908ab987b17f7b74484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a2bf9a5a484523a700e4e6c568d4de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:35:30.686702 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-b83b83c5-43b1-4766-9f05-b76d0c6666e2 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] 10.222.0.15 "GET /compute/v2.1/servers/ff125cf8-e8a5-4f00-ade9-045b18ee33f4" status: 200 len: 1710 microversion: 2.1 time: 0.157307 Oct 31 12:35:30.687300 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 202/411] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:35:30 2022] GET /compute/v2.1/servers/ff125cf8-e8a5-4f00-ade9-045b18ee33f4 => generated 1710 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:35:31.257074 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-9a6dd551-a96b-4330-b71a-63ec68031dce tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Action: 'create', calling method: .version_select at 0x7f2aa5277c10>, body: {"keypair": {"name": "tempest-keypair-1165024382", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHsOeeEvyuxkdVkZISZfqOIUBDbVZWj8DAAFyvJpZgamZGHfPIR9ZBgzz4XyEWY4AvD5H39QdsFPEXHJGTu+sXytW8zD8ue8oj8ZlVTJwFXk6qR3o+Sfhx2cCXIaH69tPg=="}} {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 12:35:31.277222 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.quota [None req-9a6dd551-a96b-4330-b71a-63ec68031dce tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Getting quotas for project 7573cb9c503243ab90b1649591d550e6. Resources: {'key_pairs'} {{(pid=125440) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 12:35:31.282417 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.quota [None req-9a6dd551-a96b-4330-b71a-63ec68031dce tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Getting quotas for user db2e978bcb824a5e9d593b861c9e3bd7 and project 7573cb9c503243ab90b1649591d550e6. Resources: {'key_pairs'} {{(pid=125440) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 12:35:31.310003 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-9a6dd551-a96b-4330-b71a-63ec68031dce tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.056762 Oct 31 12:35:31.311256 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 210/412] 10.222.0.15 () {60 vars in 1159 bytes} [Mon Oct 31 12:35:31 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 12:35:31.414636 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-c29a4ff2-5b76-4ce0-a2f2-603d68163a15 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:35:31.416741 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-c29a4ff2-5b76-4ce0-a2f2-603d68163a15 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] [instance: 852e8870-b3ec-4a21-a9b5-e31a423ddd3d] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:35:31.422342 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-c29a4ff2-5b76-4ce0-a2f2-603d68163a15 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:31.422828 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-c29a4ff2-5b76-4ce0-a2f2-603d68163a15 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:31.423674 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-c29a4ff2-5b76-4ce0-a2f2-603d68163a15 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:31.424615 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-c29a4ff2-5b76-4ce0-a2f2-603d68163a15 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:31.425064 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-c29a4ff2-5b76-4ce0-a2f2-603d68163a15 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:31.425645 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-c29a4ff2-5b76-4ce0-a2f2-603d68163a15 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:31.691408 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-c29a4ff2-5b76-4ce0-a2f2-603d68163a15 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:35:31.700341 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-c29a4ff2-5b76-4ce0-a2f2-603d68163a15 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:35:31.702163 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-c29a4ff2-5b76-4ce0-a2f2-603d68163a15 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:35:31.703361 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-c29a4ff2-5b76-4ce0-a2f2-603d68163a15 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] 10.222.0.15 "GET /compute/v2.1/servers/852e8870-b3ec-4a21-a9b5-e31a423ddd3d" status: 200 len: 1724 microversion: 2.20 time: 0.293619 Oct 31 12:35:31.703915 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 203/413] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Oct 31 12:35:31 2022] GET /compute/v2.1/servers/852e8870-b3ec-4a21-a9b5-e31a423ddd3d => generated 1724 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 12:35:31.718826 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-c375ffc8-37e0-493d-9772-ad4e77a851ae tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:35:31.721837 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-c375ffc8-37e0-493d-9772-ad4e77a851ae tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] [instance: ff125cf8-e8a5-4f00-ade9-045b18ee33f4] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:35:31.730191 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-c375ffc8-37e0-493d-9772-ad4e77a851ae tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:31.731649 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-c375ffc8-37e0-493d-9772-ad4e77a851ae tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:31.732884 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-c375ffc8-37e0-493d-9772-ad4e77a851ae tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:31.733943 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-c375ffc8-37e0-493d-9772-ad4e77a851ae tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:31.735184 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-c375ffc8-37e0-493d-9772-ad4e77a851ae tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:31.735900 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-c375ffc8-37e0-493d-9772-ad4e77a851ae tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:31.979749 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-c375ffc8-37e0-493d-9772-ad4e77a851ae tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c1beb321e44908ab987b17f7b74484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a2bf9a5a484523a700e4e6c568d4de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:35:31.995661 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-c375ffc8-37e0-493d-9772-ad4e77a851ae tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] 10.222.0.15 "GET /compute/v2.1/servers/ff125cf8-e8a5-4f00-ade9-045b18ee33f4" status: 200 len: 1710 microversion: 2.1 time: 0.282672 Oct 31 12:35:31.996642 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 211/414] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:35:31 2022] GET /compute/v2.1/servers/ff125cf8-e8a5-4f00-ade9-045b18ee33f4 => generated 1710 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:35:32.148954 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-419d35bb-db8a-46ec-a92f-80811d42890b tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-629291590", "imageRef": "fbbea321-8f0d-4092-b070-b67a6931d610", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6630ddc4-dc53-4e5a-8b9d-7632c3075289"}], "security_groups": [{"name": "tempest-securitygroup--985216286"}], "key_name": "tempest-keypair-913735954", "user_data": "}} {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 12:35:32.275722 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.network.neutron [None req-419d35bb-db8a-46ec-a92f-80811d42890b tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] validate_networks() for [('6630ddc4-dc53-4e5a-8b9d-7632c3075289', None, None, None, None, None)] {{(pid=125441) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 12:35:32.731154 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-12e5a10a-af38-4870-8c79-1da029223230 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:35:32.731727 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-12e5a10a-af38-4870-8c79-1da029223230 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] [instance: 852e8870-b3ec-4a21-a9b5-e31a423ddd3d] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:35:32.737825 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-12e5a10a-af38-4870-8c79-1da029223230 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:32.738303 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-12e5a10a-af38-4870-8c79-1da029223230 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:32.738876 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-12e5a10a-af38-4870-8c79-1da029223230 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:32.739601 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-12e5a10a-af38-4870-8c79-1da029223230 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:32.740210 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-12e5a10a-af38-4870-8c79-1da029223230 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:32.740951 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-12e5a10a-af38-4870-8c79-1da029223230 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:32.810333 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.virt.hardware [None req-419d35bb-db8a-46ec-a92f-80811d42890b tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Flavor limits 0:0:0 {{(pid=125441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 12:35:32.810840 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.virt.hardware [None req-419d35bb-db8a-46ec-a92f-80811d42890b tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Image limits 0:0:0 {{(pid=125441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 12:35:32.811213 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.virt.hardware [None req-419d35bb-db8a-46ec-a92f-80811d42890b tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Flavor pref 0:0:0 {{(pid=125441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 12:35:32.811613 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.virt.hardware [None req-419d35bb-db8a-46ec-a92f-80811d42890b tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Image pref 0:0:0 {{(pid=125441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 12:35:32.812012 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.virt.hardware [None req-419d35bb-db8a-46ec-a92f-80811d42890b tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 12:35:32.821534 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-419d35bb-db8a-46ec-a92f-80811d42890b tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:32.822009 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-419d35bb-db8a-46ec-a92f-80811d42890b tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:32.822433 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-419d35bb-db8a-46ec-a92f-80811d42890b tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:32.823138 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-419d35bb-db8a-46ec-a92f-80811d42890b tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:32.823613 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-419d35bb-db8a-46ec-a92f-80811d42890b tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:32.824029 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-419d35bb-db8a-46ec-a92f-80811d42890b tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:32.841182 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.quota [None req-419d35bb-db8a-46ec-a92f-80811d42890b tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Getting quotas for project bfbc3a46f12942299b99cdd20c989e1f. Resources: {'instances', 'cores', 'ram'} {{(pid=125441) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 12:35:32.845209 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.quota [None req-419d35bb-db8a-46ec-a92f-80811d42890b tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Getting quotas for user b2c03f0365ee4a26b8c076ae365325b2 and project bfbc3a46f12942299b99cdd20c989e1f. Resources: {'instances', 'cores', 'ram'} {{(pid=125441) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 12:35:32.858225 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-419d35bb-db8a-46ec-a92f-80811d42890b tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Going to run 1 instances... {{(pid=125441) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 12:35:32.862014 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-419d35bb-db8a-46ec-a92f-80811d42890b tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] [instance: d1bb54dd-d9ba-4789-b2a0-c91a292cb466] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fbbea321-8f0d-4092-b070-b67a6931d610',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125441) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 12:35:32.915484 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-419d35bb-db8a-46ec-a92f-80811d42890b tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.772891 Oct 31 12:35:32.925793 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-12e5a10a-af38-4870-8c79-1da029223230 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:35:32.927353 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 204/415] 10.222.0.15 () {60 vars in 1147 bytes} [Mon Oct 31 12:35:32 2022] POST /compute/v2.1/servers => generated 401 bytes in 786 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 12:35:32.934906 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-12e5a10a-af38-4870-8c79-1da029223230 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:35:32.936640 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-12e5a10a-af38-4870-8c79-1da029223230 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:35:32.938080 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-12e5a10a-af38-4870-8c79-1da029223230 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] 10.222.0.15 "GET /compute/v2.1/servers/852e8870-b3ec-4a21-a9b5-e31a423ddd3d" status: 200 len: 1724 microversion: 2.20 time: 0.211591 Oct 31 12:35:32.943985 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 212/416] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Oct 31 12:35:32 2022] GET /compute/v2.1/servers/852e8870-b3ec-4a21-a9b5-e31a423ddd3d => generated 1724 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 12:35:32.951247 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-64573ca0-ad9b-41e6-b28f-6462abc8382f tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1760257482", "imageRef": "fbbea321-8f0d-4092-b070-b67a6931d610", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9c998076-e873-4913-aa9f-032e3218ef2a"}], "security_groups": [{"name": "tempest-securitygroup--1675032200"}], "key_name": "tempest-keypair-1165024382", "user_data": "}} {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 12:35:32.960082 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-e195a8da-bf16-4e4e-a482-2d1eae0bcb8f tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:35:32.960844 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-e195a8da-bf16-4e4e-a482-2d1eae0bcb8f tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] [instance: d1bb54dd-d9ba-4789-b2a0-c91a292cb466] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:35:33.026414 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-e195a8da-bf16-4e4e-a482-2d1eae0bcb8f tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c03f0365ee4a26b8c076ae365325b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfbc3a46f12942299b99cdd20c989e1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:35:33.036670 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-e195a8da-bf16-4e4e-a482-2d1eae0bcb8f tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] 10.222.0.15 "GET /compute/v2.1/servers/d1bb54dd-d9ba-4789-b2a0-c91a292cb466" status: 200 len: 1240 microversion: 2.1 time: 0.095587 Oct 31 12:35:33.038242 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 213/417] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:35:32 2022] GET /compute/v2.1/servers/d1bb54dd-d9ba-4789-b2a0-c91a292cb466 => generated 1240 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:35:33.046880 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-6f3310d2-3495-4190-b71e-ba9bce1741cb tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:35:33.048600 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-6f3310d2-3495-4190-b71e-ba9bce1741cb tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] [instance: ff125cf8-e8a5-4f00-ade9-045b18ee33f4] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:35:33.056986 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-6f3310d2-3495-4190-b71e-ba9bce1741cb tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:33.057887 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-6f3310d2-3495-4190-b71e-ba9bce1741cb tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:33.058201 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-6f3310d2-3495-4190-b71e-ba9bce1741cb tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:33.059351 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-6f3310d2-3495-4190-b71e-ba9bce1741cb tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:33.059791 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-6f3310d2-3495-4190-b71e-ba9bce1741cb tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:33.060276 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-6f3310d2-3495-4190-b71e-ba9bce1741cb tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:33.080905 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.network.neutron [None req-64573ca0-ad9b-41e6-b28f-6462abc8382f tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] validate_networks() for [('9c998076-e873-4913-aa9f-032e3218ef2a', None, None, None, None, None)] {{(pid=125441) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 12:35:33.231460 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-6f3310d2-3495-4190-b71e-ba9bce1741cb tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c1beb321e44908ab987b17f7b74484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a2bf9a5a484523a700e4e6c568d4de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:35:33.242629 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-6f3310d2-3495-4190-b71e-ba9bce1741cb tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] 10.222.0.15 "GET /compute/v2.1/servers/ff125cf8-e8a5-4f00-ade9-045b18ee33f4" status: 200 len: 1714 microversion: 2.1 time: 0.203012 Oct 31 12:35:33.243229 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 214/418] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:35:33 2022] GET /compute/v2.1/servers/ff125cf8-e8a5-4f00-ade9-045b18ee33f4 => generated 1714 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:35:33.583789 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.virt.hardware [None req-64573ca0-ad9b-41e6-b28f-6462abc8382f tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Flavor limits 0:0:0 {{(pid=125441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 12:35:33.584369 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.virt.hardware [None req-64573ca0-ad9b-41e6-b28f-6462abc8382f tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Image limits 0:0:0 {{(pid=125441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 12:35:33.585071 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.virt.hardware [None req-64573ca0-ad9b-41e6-b28f-6462abc8382f tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Flavor pref 0:0:0 {{(pid=125441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 12:35:33.585527 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.virt.hardware [None req-64573ca0-ad9b-41e6-b28f-6462abc8382f tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Image pref 0:0:0 {{(pid=125441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 12:35:33.586089 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.virt.hardware [None req-64573ca0-ad9b-41e6-b28f-6462abc8382f tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 12:35:33.596458 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-64573ca0-ad9b-41e6-b28f-6462abc8382f tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:33.597188 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-64573ca0-ad9b-41e6-b28f-6462abc8382f tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:33.597587 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-64573ca0-ad9b-41e6-b28f-6462abc8382f tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:33.598337 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-64573ca0-ad9b-41e6-b28f-6462abc8382f tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:33.598782 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-64573ca0-ad9b-41e6-b28f-6462abc8382f tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:33.599442 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-64573ca0-ad9b-41e6-b28f-6462abc8382f tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:33.622526 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.quota [None req-64573ca0-ad9b-41e6-b28f-6462abc8382f tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Getting quotas for project 7573cb9c503243ab90b1649591d550e6. Resources: {'instances', 'cores', 'ram'} {{(pid=125441) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 12:35:33.627045 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.quota [None req-64573ca0-ad9b-41e6-b28f-6462abc8382f tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Getting quotas for user db2e978bcb824a5e9d593b861c9e3bd7 and project 7573cb9c503243ab90b1649591d550e6. Resources: {'instances', 'cores', 'ram'} {{(pid=125441) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 12:35:33.643375 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-64573ca0-ad9b-41e6-b28f-6462abc8382f tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Going to run 1 instances... {{(pid=125441) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 12:35:33.643375 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-64573ca0-ad9b-41e6-b28f-6462abc8382f tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] [instance: ee260508-cdfb-468d-9ff4-df06cc3bdadf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fbbea321-8f0d-4092-b070-b67a6931d610',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125441) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 12:35:33.701449 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-64573ca0-ad9b-41e6-b28f-6462abc8382f tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.771831 Oct 31 12:35:33.702427 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 205/419] 10.222.0.15 () {60 vars in 1147 bytes} [Mon Oct 31 12:35:32 2022] POST /compute/v2.1/servers => generated 409 bytes in 773 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 12:35:33.713261 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-40ca71d0-09f2-48d3-b774-f1167c775ecc tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:35:33.714147 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-40ca71d0-09f2-48d3-b774-f1167c775ecc tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] [instance: ee260508-cdfb-468d-9ff4-df06cc3bdadf] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:35:33.783112 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-40ca71d0-09f2-48d3-b774-f1167c775ecc tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2e978bcb824a5e9d593b861c9e3bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7573cb9c503243ab90b1649591d550e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:35:33.795215 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-40ca71d0-09f2-48d3-b774-f1167c775ecc tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] 10.222.0.15 "GET /compute/v2.1/servers/ee260508-cdfb-468d-9ff4-df06cc3bdadf" status: 200 len: 1246 microversion: 2.1 time: 0.085634 Oct 31 12:35:33.795980 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 215/420] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:35:33 2022] GET /compute/v2.1/servers/ee260508-cdfb-468d-9ff4-df06cc3bdadf => generated 1246 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:35:33.964278 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-46963fd5-e2fc-4fde-9c61-d376968d26ed tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:35:33.965374 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-46963fd5-e2fc-4fde-9c61-d376968d26ed tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] [instance: 852e8870-b3ec-4a21-a9b5-e31a423ddd3d] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:35:33.971403 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-46963fd5-e2fc-4fde-9c61-d376968d26ed tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:33.972069 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-46963fd5-e2fc-4fde-9c61-d376968d26ed tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:33.972654 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-46963fd5-e2fc-4fde-9c61-d376968d26ed tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:33.973527 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-46963fd5-e2fc-4fde-9c61-d376968d26ed tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:33.974393 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-46963fd5-e2fc-4fde-9c61-d376968d26ed tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:33.974968 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-46963fd5-e2fc-4fde-9c61-d376968d26ed tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:34.059361 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-b93fe50a-38a2-4d76-b0d2-9c91b4f0e5c3 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:35:34.060165 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-b93fe50a-38a2-4d76-b0d2-9c91b4f0e5c3 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] [instance: d1bb54dd-d9ba-4789-b2a0-c91a292cb466] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:35:34.068648 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-b93fe50a-38a2-4d76-b0d2-9c91b4f0e5c3 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:34.069388 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-b93fe50a-38a2-4d76-b0d2-9c91b4f0e5c3 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:34.070042 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-b93fe50a-38a2-4d76-b0d2-9c91b4f0e5c3 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:34.070962 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-b93fe50a-38a2-4d76-b0d2-9c91b4f0e5c3 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:34.071640 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-b93fe50a-38a2-4d76-b0d2-9c91b4f0e5c3 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:34.072352 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-b93fe50a-38a2-4d76-b0d2-9c91b4f0e5c3 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:34.185654 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-b93fe50a-38a2-4d76-b0d2-9c91b4f0e5c3 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c03f0365ee4a26b8c076ae365325b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfbc3a46f12942299b99cdd20c989e1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:35:34.197228 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-b93fe50a-38a2-4d76-b0d2-9c91b4f0e5c3 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] 10.222.0.15 "GET /compute/v2.1/servers/d1bb54dd-d9ba-4789-b2a0-c91a292cb466" status: 200 len: 1292 microversion: 2.1 time: 0.141407 Oct 31 12:35:34.199965 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 216/421] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:35:34 2022] GET /compute/v2.1/servers/d1bb54dd-d9ba-4789-b2a0-c91a292cb466 => generated 1292 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 12:35:34.213371 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-46963fd5-e2fc-4fde-9c61-d376968d26ed tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:35:34.221601 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-46963fd5-e2fc-4fde-9c61-d376968d26ed tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:35:34.223667 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-46963fd5-e2fc-4fde-9c61-d376968d26ed tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:35:34.224830 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-46963fd5-e2fc-4fde-9c61-d376968d26ed tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] 10.222.0.15 "GET /compute/v2.1/servers/852e8870-b3ec-4a21-a9b5-e31a423ddd3d" status: 200 len: 1724 microversion: 2.20 time: 0.264729 Oct 31 12:35:34.225380 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 206/422] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Oct 31 12:35:33 2022] GET /compute/v2.1/servers/852e8870-b3ec-4a21-a9b5-e31a423ddd3d => generated 1724 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 12:35:34.819050 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-47289aef-aaa1-4baf-a459-12f98f1061f5 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:35:34.827626 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-47289aef-aaa1-4baf-a459-12f98f1061f5 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] [instance: ee260508-cdfb-468d-9ff4-df06cc3bdadf] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:35:34.834497 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-47289aef-aaa1-4baf-a459-12f98f1061f5 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:34.838915 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-47289aef-aaa1-4baf-a459-12f98f1061f5 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:34.840847 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-47289aef-aaa1-4baf-a459-12f98f1061f5 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:34.842555 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-47289aef-aaa1-4baf-a459-12f98f1061f5 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:34.844610 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-47289aef-aaa1-4baf-a459-12f98f1061f5 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:34.845426 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-47289aef-aaa1-4baf-a459-12f98f1061f5 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:34.937914 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-47289aef-aaa1-4baf-a459-12f98f1061f5 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2e978bcb824a5e9d593b861c9e3bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7573cb9c503243ab90b1649591d550e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:35:34.946797 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-47289aef-aaa1-4baf-a459-12f98f1061f5 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] 10.222.0.15 "GET /compute/v2.1/servers/ee260508-cdfb-468d-9ff4-df06cc3bdadf" status: 200 len: 1298 microversion: 2.1 time: 0.132630 Oct 31 12:35:34.947802 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 217/423] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:35:34 2022] GET /compute/v2.1/servers/ee260508-cdfb-468d-9ff4-df06cc3bdadf => generated 1298 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:35:35.230399 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-6c52af96-f51a-4f8d-ac0b-4ff4d72a4fcd tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:35:35.232200 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-6c52af96-f51a-4f8d-ac0b-4ff4d72a4fcd tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] [instance: d1bb54dd-d9ba-4789-b2a0-c91a292cb466] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:35:35.243144 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-6c52af96-f51a-4f8d-ac0b-4ff4d72a4fcd tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:35.243575 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-6c52af96-f51a-4f8d-ac0b-4ff4d72a4fcd tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:35.244017 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-6c52af96-f51a-4f8d-ac0b-4ff4d72a4fcd tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:35.244909 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-6c52af96-f51a-4f8d-ac0b-4ff4d72a4fcd tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:35.246388 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-6c52af96-f51a-4f8d-ac0b-4ff4d72a4fcd tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:35.246978 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-6c52af96-f51a-4f8d-ac0b-4ff4d72a4fcd tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:35.253559 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-2afe05af-33f1-4e9e-973d-3bc822457625 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:35:35.254336 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-2afe05af-33f1-4e9e-973d-3bc822457625 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] [instance: 852e8870-b3ec-4a21-a9b5-e31a423ddd3d] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:35:35.260765 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-2afe05af-33f1-4e9e-973d-3bc822457625 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:35.262365 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-2afe05af-33f1-4e9e-973d-3bc822457625 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:35.262881 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-2afe05af-33f1-4e9e-973d-3bc822457625 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:35.263713 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-2afe05af-33f1-4e9e-973d-3bc822457625 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:35.264169 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-2afe05af-33f1-4e9e-973d-3bc822457625 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:35.264639 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-2afe05af-33f1-4e9e-973d-3bc822457625 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:35.285960 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG dbcounter [-] [125440] Writing DB stats nova_cell1:SELECT=100 {{(pid=125440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:35:35.327349 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-6c52af96-f51a-4f8d-ac0b-4ff4d72a4fcd tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c03f0365ee4a26b8c076ae365325b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfbc3a46f12942299b99cdd20c989e1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:35:35.336997 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-6c52af96-f51a-4f8d-ac0b-4ff4d72a4fcd tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] 10.222.0.15 "GET /compute/v2.1/servers/d1bb54dd-d9ba-4789-b2a0-c91a292cb466" status: 200 len: 1298 microversion: 2.1 time: 0.112920 Oct 31 12:35:35.337590 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 207/424] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:35:35 2022] GET /compute/v2.1/servers/d1bb54dd-d9ba-4789-b2a0-c91a292cb466 => generated 1298 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:35:35.638597 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-2afe05af-33f1-4e9e-973d-3bc822457625 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:35:35.648340 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-2afe05af-33f1-4e9e-973d-3bc822457625 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:35:35.649878 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-2afe05af-33f1-4e9e-973d-3bc822457625 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:35:35.651548 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-2afe05af-33f1-4e9e-973d-3bc822457625 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] 10.222.0.15 "GET /compute/v2.1/servers/852e8870-b3ec-4a21-a9b5-e31a423ddd3d" status: 200 len: 1724 microversion: 2.20 time: 0.402344 Oct 31 12:35:35.652368 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 218/425] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Oct 31 12:35:35 2022] GET /compute/v2.1/servers/852e8870-b3ec-4a21-a9b5-e31a423ddd3d => generated 1724 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 12:35:35.971544 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-a67e5a6c-7fc5-4ee7-81ce-3e9d0a88f35f tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:35:35.972426 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-a67e5a6c-7fc5-4ee7-81ce-3e9d0a88f35f tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] [instance: ee260508-cdfb-468d-9ff4-df06cc3bdadf] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:35:35.980450 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-a67e5a6c-7fc5-4ee7-81ce-3e9d0a88f35f tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:35.981201 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-a67e5a6c-7fc5-4ee7-81ce-3e9d0a88f35f tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:35.981803 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-a67e5a6c-7fc5-4ee7-81ce-3e9d0a88f35f tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:35.982980 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-a67e5a6c-7fc5-4ee7-81ce-3e9d0a88f35f tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:35.984541 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-a67e5a6c-7fc5-4ee7-81ce-3e9d0a88f35f tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:35.985426 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-a67e5a6c-7fc5-4ee7-81ce-3e9d0a88f35f tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:36.062232 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-a67e5a6c-7fc5-4ee7-81ce-3e9d0a88f35f tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2e978bcb824a5e9d593b861c9e3bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7573cb9c503243ab90b1649591d550e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:35:36.083369 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-a67e5a6c-7fc5-4ee7-81ce-3e9d0a88f35f tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] 10.222.0.15 "GET /compute/v2.1/servers/ee260508-cdfb-468d-9ff4-df06cc3bdadf" status: 200 len: 1304 microversion: 2.1 time: 0.106740 Oct 31 12:35:36.085754 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 208/426] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:35:35 2022] GET /compute/v2.1/servers/ee260508-cdfb-468d-9ff4-df06cc3bdadf => generated 1304 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:35:36.364218 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-aabb0486-7a6b-42f2-b383-3ca81874881c tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:35:36.364755 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-aabb0486-7a6b-42f2-b383-3ca81874881c tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] [instance: d1bb54dd-d9ba-4789-b2a0-c91a292cb466] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:35:36.371134 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-aabb0486-7a6b-42f2-b383-3ca81874881c tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:36.371716 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-aabb0486-7a6b-42f2-b383-3ca81874881c tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:36.372140 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-aabb0486-7a6b-42f2-b383-3ca81874881c tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:36.372821 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-aabb0486-7a6b-42f2-b383-3ca81874881c tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:36.373265 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-aabb0486-7a6b-42f2-b383-3ca81874881c tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:36.373678 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-aabb0486-7a6b-42f2-b383-3ca81874881c tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:36.590698 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-aabb0486-7a6b-42f2-b383-3ca81874881c tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c03f0365ee4a26b8c076ae365325b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfbc3a46f12942299b99cdd20c989e1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:35:36.598942 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-aabb0486-7a6b-42f2-b383-3ca81874881c tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] 10.222.0.15 "GET /compute/v2.1/servers/d1bb54dd-d9ba-4789-b2a0-c91a292cb466" status: 200 len: 1365 microversion: 2.1 time: 0.239276 Oct 31 12:35:36.599661 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 219/427] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:35:36 2022] GET /compute/v2.1/servers/d1bb54dd-d9ba-4789-b2a0-c91a292cb466 => generated 1365 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:35:36.678254 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-9205b1e0-7d07-4d61-966f-a7259f614e0e tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:35:36.679125 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-9205b1e0-7d07-4d61-966f-a7259f614e0e tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] [instance: 852e8870-b3ec-4a21-a9b5-e31a423ddd3d] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:35:36.686005 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-9205b1e0-7d07-4d61-966f-a7259f614e0e tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:36.686763 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-9205b1e0-7d07-4d61-966f-a7259f614e0e tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:36.687263 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-9205b1e0-7d07-4d61-966f-a7259f614e0e tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:36.688021 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-9205b1e0-7d07-4d61-966f-a7259f614e0e tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:36.688554 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-9205b1e0-7d07-4d61-966f-a7259f614e0e tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:36.689242 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-9205b1e0-7d07-4d61-966f-a7259f614e0e tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:36.831699 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-9205b1e0-7d07-4d61-966f-a7259f614e0e tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:35:36.839952 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-9205b1e0-7d07-4d61-966f-a7259f614e0e tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:35:36.841432 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-9205b1e0-7d07-4d61-966f-a7259f614e0e tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:35:36.842633 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-9205b1e0-7d07-4d61-966f-a7259f614e0e tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] 10.222.0.15 "GET /compute/v2.1/servers/852e8870-b3ec-4a21-a9b5-e31a423ddd3d" status: 200 len: 1724 microversion: 2.20 time: 0.168424 Oct 31 12:35:36.843245 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 209/428] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Oct 31 12:35:36 2022] GET /compute/v2.1/servers/852e8870-b3ec-4a21-a9b5-e31a423ddd3d => generated 1724 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 12:35:37.113948 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-c7abab6e-654f-44e1-ad7c-463a7090bf08 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:35:37.114479 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-c7abab6e-654f-44e1-ad7c-463a7090bf08 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] [instance: ee260508-cdfb-468d-9ff4-df06cc3bdadf] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:35:37.120410 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-c7abab6e-654f-44e1-ad7c-463a7090bf08 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:37.120876 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-c7abab6e-654f-44e1-ad7c-463a7090bf08 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:37.121296 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-c7abab6e-654f-44e1-ad7c-463a7090bf08 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:37.121962 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-c7abab6e-654f-44e1-ad7c-463a7090bf08 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:37.122404 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-c7abab6e-654f-44e1-ad7c-463a7090bf08 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:37.122816 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-c7abab6e-654f-44e1-ad7c-463a7090bf08 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:37.249030 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-c7abab6e-654f-44e1-ad7c-463a7090bf08 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2e978bcb824a5e9d593b861c9e3bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7573cb9c503243ab90b1649591d550e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:35:37.257452 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-c7abab6e-654f-44e1-ad7c-463a7090bf08 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] 10.222.0.15 "GET /compute/v2.1/servers/ee260508-cdfb-468d-9ff4-df06cc3bdadf" status: 200 len: 1372 microversion: 2.1 time: 0.147502 Oct 31 12:35:37.258013 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 220/429] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:35:37 2022] GET /compute/v2.1/servers/ee260508-cdfb-468d-9ff4-df06cc3bdadf => generated 1372 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:35:37.622187 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-353d176f-9216-4c73-a37b-bc9cebff922a tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:35:37.622823 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-353d176f-9216-4c73-a37b-bc9cebff922a tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] [instance: d1bb54dd-d9ba-4789-b2a0-c91a292cb466] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:35:37.628933 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-353d176f-9216-4c73-a37b-bc9cebff922a tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:37.629406 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-353d176f-9216-4c73-a37b-bc9cebff922a tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:37.629835 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-353d176f-9216-4c73-a37b-bc9cebff922a tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:37.630513 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-353d176f-9216-4c73-a37b-bc9cebff922a tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:37.630962 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-353d176f-9216-4c73-a37b-bc9cebff922a tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:37.631402 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-353d176f-9216-4c73-a37b-bc9cebff922a tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:37.759208 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-353d176f-9216-4c73-a37b-bc9cebff922a tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c03f0365ee4a26b8c076ae365325b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfbc3a46f12942299b99cdd20c989e1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:35:37.768108 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-353d176f-9216-4c73-a37b-bc9cebff922a tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] 10.222.0.15 "GET /compute/v2.1/servers/d1bb54dd-d9ba-4789-b2a0-c91a292cb466" status: 200 len: 1365 microversion: 2.1 time: 0.149616 Oct 31 12:35:37.768754 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 210/430] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:35:37 2022] GET /compute/v2.1/servers/d1bb54dd-d9ba-4789-b2a0-c91a292cb466 => generated 1365 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:35:37.868247 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-bec4a8f5-a5c1-416d-8dc4-2141b2d84b33 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:35:37.868846 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-bec4a8f5-a5c1-416d-8dc4-2141b2d84b33 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] [instance: 852e8870-b3ec-4a21-a9b5-e31a423ddd3d] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:35:37.875223 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-bec4a8f5-a5c1-416d-8dc4-2141b2d84b33 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:37.875729 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-bec4a8f5-a5c1-416d-8dc4-2141b2d84b33 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:37.876155 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-bec4a8f5-a5c1-416d-8dc4-2141b2d84b33 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:37.876839 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-bec4a8f5-a5c1-416d-8dc4-2141b2d84b33 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:37.877290 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-bec4a8f5-a5c1-416d-8dc4-2141b2d84b33 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:37.877700 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-bec4a8f5-a5c1-416d-8dc4-2141b2d84b33 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:38.008367 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-bec4a8f5-a5c1-416d-8dc4-2141b2d84b33 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:35:38.016705 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-bec4a8f5-a5c1-416d-8dc4-2141b2d84b33 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:35:38.018976 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-bec4a8f5-a5c1-416d-8dc4-2141b2d84b33 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:35:38.020158 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-bec4a8f5-a5c1-416d-8dc4-2141b2d84b33 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] 10.222.0.15 "GET /compute/v2.1/servers/852e8870-b3ec-4a21-a9b5-e31a423ddd3d" status: 200 len: 1724 microversion: 2.20 time: 0.155827 Oct 31 12:35:38.021422 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 221/431] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Oct 31 12:35:37 2022] GET /compute/v2.1/servers/852e8870-b3ec-4a21-a9b5-e31a423ddd3d => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 12:35:38.280338 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-c94ed643-2d4c-4f81-9136-33896607326c tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:35:38.280941 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-c94ed643-2d4c-4f81-9136-33896607326c tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] [instance: ee260508-cdfb-468d-9ff4-df06cc3bdadf] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:35:38.286973 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-c94ed643-2d4c-4f81-9136-33896607326c tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:38.287485 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-c94ed643-2d4c-4f81-9136-33896607326c tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:38.287907 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-c94ed643-2d4c-4f81-9136-33896607326c tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:38.288582 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-c94ed643-2d4c-4f81-9136-33896607326c tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:38.289024 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-c94ed643-2d4c-4f81-9136-33896607326c tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:38.289441 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-c94ed643-2d4c-4f81-9136-33896607326c tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:38.414892 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-c94ed643-2d4c-4f81-9136-33896607326c tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2e978bcb824a5e9d593b861c9e3bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7573cb9c503243ab90b1649591d550e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:35:38.422405 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-c94ed643-2d4c-4f81-9136-33896607326c tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] 10.222.0.15 "GET /compute/v2.1/servers/ee260508-cdfb-468d-9ff4-df06cc3bdadf" status: 200 len: 1372 microversion: 2.1 time: 0.145902 Oct 31 12:35:38.422964 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 211/432] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:35:38 2022] GET /compute/v2.1/servers/ee260508-cdfb-468d-9ff4-df06cc3bdadf => generated 1372 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:35:38.793099 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-f85b263d-9801-4cc1-b127-79dd794e2250 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:35:38.793942 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-f85b263d-9801-4cc1-b127-79dd794e2250 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] [instance: d1bb54dd-d9ba-4789-b2a0-c91a292cb466] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:35:38.801149 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-f85b263d-9801-4cc1-b127-79dd794e2250 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:38.801636 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-f85b263d-9801-4cc1-b127-79dd794e2250 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:38.802070 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-f85b263d-9801-4cc1-b127-79dd794e2250 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:38.802767 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-f85b263d-9801-4cc1-b127-79dd794e2250 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:38.803241 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-f85b263d-9801-4cc1-b127-79dd794e2250 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:38.803663 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-f85b263d-9801-4cc1-b127-79dd794e2250 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:39.046292 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-73f9de26-6695-4c95-9249-aad053a0cec6 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:35:39.046901 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-73f9de26-6695-4c95-9249-aad053a0cec6 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] [instance: 852e8870-b3ec-4a21-a9b5-e31a423ddd3d] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:35:39.054226 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-73f9de26-6695-4c95-9249-aad053a0cec6 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:39.054713 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-73f9de26-6695-4c95-9249-aad053a0cec6 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:39.055210 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-73f9de26-6695-4c95-9249-aad053a0cec6 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:39.056113 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-73f9de26-6695-4c95-9249-aad053a0cec6 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:39.056599 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-73f9de26-6695-4c95-9249-aad053a0cec6 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:39.057031 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-73f9de26-6695-4c95-9249-aad053a0cec6 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:39.165954 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-f85b263d-9801-4cc1-b127-79dd794e2250 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c03f0365ee4a26b8c076ae365325b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfbc3a46f12942299b99cdd20c989e1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:35:39.175466 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-f85b263d-9801-4cc1-b127-79dd794e2250 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] 10.222.0.15 "GET /compute/v2.1/servers/d1bb54dd-d9ba-4789-b2a0-c91a292cb466" status: 200 len: 1365 microversion: 2.1 time: 0.386141 Oct 31 12:35:39.176641 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 222/433] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:35:38 2022] GET /compute/v2.1/servers/d1bb54dd-d9ba-4789-b2a0-c91a292cb466 => generated 1365 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:35:39.203259 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-73f9de26-6695-4c95-9249-aad053a0cec6 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:35:39.212405 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-73f9de26-6695-4c95-9249-aad053a0cec6 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:35:39.213840 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-73f9de26-6695-4c95-9249-aad053a0cec6 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:35:39.214987 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-73f9de26-6695-4c95-9249-aad053a0cec6 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] 10.222.0.15 "GET /compute/v2.1/servers/852e8870-b3ec-4a21-a9b5-e31a423ddd3d" status: 200 len: 1724 microversion: 2.20 time: 0.172817 Oct 31 12:35:39.215566 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 212/434] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Oct 31 12:35:39 2022] GET /compute/v2.1/servers/852e8870-b3ec-4a21-a9b5-e31a423ddd3d => generated 1724 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 12:35:39.445640 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-c6aa0069-947f-419f-a325-070b042103a3 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:35:39.446252 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-c6aa0069-947f-419f-a325-070b042103a3 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] [instance: ee260508-cdfb-468d-9ff4-df06cc3bdadf] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:35:39.452834 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-c6aa0069-947f-419f-a325-070b042103a3 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:39.453317 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-c6aa0069-947f-419f-a325-070b042103a3 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:39.453757 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-c6aa0069-947f-419f-a325-070b042103a3 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:39.455116 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-c6aa0069-947f-419f-a325-070b042103a3 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:39.456264 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-c6aa0069-947f-419f-a325-070b042103a3 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:39.456691 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-c6aa0069-947f-419f-a325-070b042103a3 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:39.793996 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-c6aa0069-947f-419f-a325-070b042103a3 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2e978bcb824a5e9d593b861c9e3bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7573cb9c503243ab90b1649591d550e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:35:39.802819 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-c6aa0069-947f-419f-a325-070b042103a3 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] 10.222.0.15 "GET /compute/v2.1/servers/ee260508-cdfb-468d-9ff4-df06cc3bdadf" status: 200 len: 1372 microversion: 2.1 time: 0.360956 Oct 31 12:35:39.803425 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 223/435] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:35:39 2022] GET /compute/v2.1/servers/ee260508-cdfb-468d-9ff4-df06cc3bdadf => generated 1372 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:35:40.031471 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [req-2efa837a-26ef-4268-aaa8-748f6744deb5 req-1a206a11-cb21-428f-854a-e3f0abc3f97c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d1bb54dd-d9ba-4789-b2a0-c91a292cb466", "tag": "2bcb3176-596a-4211-910f-3e00167f2763"}]} {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 12:35:40.040045 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG dbcounter [-] [125441] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=125441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:35:40.051343 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [req-2efa837a-26ef-4268-aaa8-748f6744deb5 req-1a206a11-cb21-428f-854a-e3f0abc3f97c service nova] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:40.052195 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [req-2efa837a-26ef-4268-aaa8-748f6744deb5 req-1a206a11-cb21-428f-854a-e3f0abc3f97c service nova] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:40.052386 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [req-2efa837a-26ef-4268-aaa8-748f6744deb5 req-1a206a11-cb21-428f-854a-e3f0abc3f97c service nova] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:40.067431 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.compute.server_external_events [req-2efa837a-26ef-4268-aaa8-748f6744deb5 req-1a206a11-cb21-428f-854a-e3f0abc3f97c service nova] Creating event network-changed:2bcb3176-596a-4211-910f-3e00167f2763 for instance d1bb54dd-d9ba-4789-b2a0-c91a292cb466 on hv-cinder-79617 Oct 31 12:35:40.072593 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [req-2efa837a-26ef-4268-aaa8-748f6744deb5 req-1a206a11-cb21-428f-854a-e3f0abc3f97c service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044721 Oct 31 12:35:40.073555 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 213/436] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Oct 31 12:35:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 12:35:40.200222 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-37b1121e-938e-46dc-905b-a191dadcd3c4 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:35:40.200963 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-37b1121e-938e-46dc-905b-a191dadcd3c4 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] [instance: d1bb54dd-d9ba-4789-b2a0-c91a292cb466] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:35:40.208980 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-37b1121e-938e-46dc-905b-a191dadcd3c4 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:40.209639 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-37b1121e-938e-46dc-905b-a191dadcd3c4 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:40.210079 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-37b1121e-938e-46dc-905b-a191dadcd3c4 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:40.210797 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-37b1121e-938e-46dc-905b-a191dadcd3c4 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:40.211483 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-37b1121e-938e-46dc-905b-a191dadcd3c4 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:40.211965 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-37b1121e-938e-46dc-905b-a191dadcd3c4 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:40.242209 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-5d8429f6-dac5-4a78-8e07-940ace4c771a tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:35:40.242910 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-5d8429f6-dac5-4a78-8e07-940ace4c771a tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] [instance: 852e8870-b3ec-4a21-a9b5-e31a423ddd3d] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:35:40.250832 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-5d8429f6-dac5-4a78-8e07-940ace4c771a tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:40.252237 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-5d8429f6-dac5-4a78-8e07-940ace4c771a tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:40.252642 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-5d8429f6-dac5-4a78-8e07-940ace4c771a tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:40.253662 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-5d8429f6-dac5-4a78-8e07-940ace4c771a tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:40.254110 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-5d8429f6-dac5-4a78-8e07-940ace4c771a tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:40.254525 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-5d8429f6-dac5-4a78-8e07-940ace4c771a tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:40.394303 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-5d8429f6-dac5-4a78-8e07-940ace4c771a tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:35:40.402474 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-5d8429f6-dac5-4a78-8e07-940ace4c771a tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:35:40.403933 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-5d8429f6-dac5-4a78-8e07-940ace4c771a tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:35:40.405072 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-5d8429f6-dac5-4a78-8e07-940ace4c771a tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] 10.222.0.15 "GET /compute/v2.1/servers/852e8870-b3ec-4a21-a9b5-e31a423ddd3d" status: 200 len: 1724 microversion: 2.20 time: 0.167599 Oct 31 12:35:40.405628 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 214/437] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Oct 31 12:35:40 2022] GET /compute/v2.1/servers/852e8870-b3ec-4a21-a9b5-e31a423ddd3d => generated 1724 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 12:35:40.579106 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-37b1121e-938e-46dc-905b-a191dadcd3c4 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c03f0365ee4a26b8c076ae365325b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfbc3a46f12942299b99cdd20c989e1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:35:40.587502 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-37b1121e-938e-46dc-905b-a191dadcd3c4 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] 10.222.0.15 "GET /compute/v2.1/servers/d1bb54dd-d9ba-4789-b2a0-c91a292cb466" status: 200 len: 1365 microversion: 2.1 time: 0.391296 Oct 31 12:35:40.588075 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 224/438] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:35:40 2022] GET /compute/v2.1/servers/d1bb54dd-d9ba-4789-b2a0-c91a292cb466 => generated 1365 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:35:40.825820 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-8d8b1327-816c-4ef0-bd57-300db6b2e042 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:35:40.826517 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-8d8b1327-816c-4ef0-bd57-300db6b2e042 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] [instance: ee260508-cdfb-468d-9ff4-df06cc3bdadf] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:35:40.833059 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-8d8b1327-816c-4ef0-bd57-300db6b2e042 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:40.833535 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-8d8b1327-816c-4ef0-bd57-300db6b2e042 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:40.833967 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-8d8b1327-816c-4ef0-bd57-300db6b2e042 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:40.834657 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-8d8b1327-816c-4ef0-bd57-300db6b2e042 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:40.835117 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-8d8b1327-816c-4ef0-bd57-300db6b2e042 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:40.835560 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-8d8b1327-816c-4ef0-bd57-300db6b2e042 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:40.976225 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-8d8b1327-816c-4ef0-bd57-300db6b2e042 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2e978bcb824a5e9d593b861c9e3bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7573cb9c503243ab90b1649591d550e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:35:40.984088 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-8d8b1327-816c-4ef0-bd57-300db6b2e042 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] 10.222.0.15 "GET /compute/v2.1/servers/ee260508-cdfb-468d-9ff4-df06cc3bdadf" status: 200 len: 1372 microversion: 2.1 time: 0.162233 Oct 31 12:35:40.984720 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 215/439] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:35:40 2022] GET /compute/v2.1/servers/ee260508-cdfb-468d-9ff4-df06cc3bdadf => generated 1372 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:35:41.435527 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-f781ff5f-6d42-4191-94ef-cb715010d1c1 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:35:41.436123 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-f781ff5f-6d42-4191-94ef-cb715010d1c1 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] [instance: 852e8870-b3ec-4a21-a9b5-e31a423ddd3d] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:35:41.442453 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-f781ff5f-6d42-4191-94ef-cb715010d1c1 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:41.442972 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-f781ff5f-6d42-4191-94ef-cb715010d1c1 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:41.443404 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-f781ff5f-6d42-4191-94ef-cb715010d1c1 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:41.444096 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-f781ff5f-6d42-4191-94ef-cb715010d1c1 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:41.444547 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-f781ff5f-6d42-4191-94ef-cb715010d1c1 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:41.444967 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-f781ff5f-6d42-4191-94ef-cb715010d1c1 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:41.580729 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-f781ff5f-6d42-4191-94ef-cb715010d1c1 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:35:41.588715 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-f781ff5f-6d42-4191-94ef-cb715010d1c1 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:35:41.590155 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-f781ff5f-6d42-4191-94ef-cb715010d1c1 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:35:41.591360 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-f781ff5f-6d42-4191-94ef-cb715010d1c1 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] 10.222.0.15 "GET /compute/v2.1/servers/852e8870-b3ec-4a21-a9b5-e31a423ddd3d" status: 200 len: 1745 microversion: 2.20 time: 0.159749 Oct 31 12:35:41.591968 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 225/440] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Oct 31 12:35:41 2022] GET /compute/v2.1/servers/852e8870-b3ec-4a21-a9b5-e31a423ddd3d => generated 1745 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 12:35:41.609845 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-c60d91c2-7239-46e1-a9fb-a987a6a4e020 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:35:41.610932 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-c60d91c2-7239-46e1-a9fb-a987a6a4e020 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] [instance: d1bb54dd-d9ba-4789-b2a0-c91a292cb466] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:35:41.617736 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-c60d91c2-7239-46e1-a9fb-a987a6a4e020 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:41.618206 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-c60d91c2-7239-46e1-a9fb-a987a6a4e020 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:41.618626 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-c60d91c2-7239-46e1-a9fb-a987a6a4e020 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:41.619718 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-c60d91c2-7239-46e1-a9fb-a987a6a4e020 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:41.620166 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-c60d91c2-7239-46e1-a9fb-a987a6a4e020 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:41.620579 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-c60d91c2-7239-46e1-a9fb-a987a6a4e020 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:41.746034 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-c60d91c2-7239-46e1-a9fb-a987a6a4e020 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c03f0365ee4a26b8c076ae365325b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfbc3a46f12942299b99cdd20c989e1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:35:41.754687 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-c60d91c2-7239-46e1-a9fb-a987a6a4e020 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] 10.222.0.15 "GET /compute/v2.1/servers/d1bb54dd-d9ba-4789-b2a0-c91a292cb466" status: 200 len: 1365 microversion: 2.1 time: 0.148791 Oct 31 12:35:41.755263 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 216/441] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:35:41 2022] GET /compute/v2.1/servers/d1bb54dd-d9ba-4789-b2a0-c91a292cb466 => generated 1365 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:35:42.007786 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-46855a9c-ca81-4978-809b-551b40518302 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:35:42.008360 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-46855a9c-ca81-4978-809b-551b40518302 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] [instance: ee260508-cdfb-468d-9ff4-df06cc3bdadf] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:35:42.014295 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-46855a9c-ca81-4978-809b-551b40518302 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:42.014762 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-46855a9c-ca81-4978-809b-551b40518302 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:42.015209 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-46855a9c-ca81-4978-809b-551b40518302 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:42.015882 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-46855a9c-ca81-4978-809b-551b40518302 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:42.016328 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-46855a9c-ca81-4978-809b-551b40518302 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:42.016800 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-46855a9c-ca81-4978-809b-551b40518302 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:42.094577 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [req-df6fc6a5-cf61-4f58-8fd3-247a757d4f4d req-149b0fc5-1cd0-434c-9530-e3ecc3dda4c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee260508-cdfb-468d-9ff4-df06cc3bdadf", "tag": "7591dba3-56f4-4739-8b1f-33a42a9073b1"}]} {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 12:35:42.104503 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [req-df6fc6a5-cf61-4f58-8fd3-247a757d4f4d req-149b0fc5-1cd0-434c-9530-e3ecc3dda4c9 service nova] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:42.104972 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [req-df6fc6a5-cf61-4f58-8fd3-247a757d4f4d req-149b0fc5-1cd0-434c-9530-e3ecc3dda4c9 service nova] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:42.105388 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [req-df6fc6a5-cf61-4f58-8fd3-247a757d4f4d req-149b0fc5-1cd0-434c-9530-e3ecc3dda4c9 service nova] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:42.117250 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.compute.server_external_events [req-df6fc6a5-cf61-4f58-8fd3-247a757d4f4d req-149b0fc5-1cd0-434c-9530-e3ecc3dda4c9 service nova] Creating event network-changed:7591dba3-56f4-4739-8b1f-33a42a9073b1 for instance ee260508-cdfb-468d-9ff4-df06cc3bdadf on hv-cinder-79617 Oct 31 12:35:42.122311 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [req-df6fc6a5-cf61-4f58-8fd3-247a757d4f4d req-149b0fc5-1cd0-434c-9530-e3ecc3dda4c9 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031382 Oct 31 12:35:42.122896 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 217/442] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Oct 31 12:35:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 12:35:42.152271 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-46855a9c-ca81-4978-809b-551b40518302 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2e978bcb824a5e9d593b861c9e3bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7573cb9c503243ab90b1649591d550e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:35:42.160961 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-46855a9c-ca81-4978-809b-551b40518302 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] 10.222.0.15 "GET /compute/v2.1/servers/ee260508-cdfb-468d-9ff4-df06cc3bdadf" status: 200 len: 1372 microversion: 2.1 time: 0.157373 Oct 31 12:35:42.161527 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 226/443] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:35:42 2022] GET /compute/v2.1/servers/ee260508-cdfb-468d-9ff4-df06cc3bdadf => generated 1372 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:35:42.618069 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-541ab5b3-4399-46a0-bb86-85c710379fa0 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:35:42.618784 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-541ab5b3-4399-46a0-bb86-85c710379fa0 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] [instance: 852e8870-b3ec-4a21-a9b5-e31a423ddd3d] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:35:42.625664 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-541ab5b3-4399-46a0-bb86-85c710379fa0 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:42.627065 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-541ab5b3-4399-46a0-bb86-85c710379fa0 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:42.627594 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-541ab5b3-4399-46a0-bb86-85c710379fa0 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:42.628462 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-541ab5b3-4399-46a0-bb86-85c710379fa0 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:42.628982 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-541ab5b3-4399-46a0-bb86-85c710379fa0 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:42.629521 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-541ab5b3-4399-46a0-bb86-85c710379fa0 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:42.778063 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-4fc43366-1e52-4cf1-84ac-826c8c4c36d6 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:35:42.779333 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-4fc43366-1e52-4cf1-84ac-826c8c4c36d6 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] [instance: d1bb54dd-d9ba-4789-b2a0-c91a292cb466] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:35:42.786415 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-4fc43366-1e52-4cf1-84ac-826c8c4c36d6 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:42.786927 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-4fc43366-1e52-4cf1-84ac-826c8c4c36d6 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:42.787644 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-4fc43366-1e52-4cf1-84ac-826c8c4c36d6 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:42.788430 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-4fc43366-1e52-4cf1-84ac-826c8c4c36d6 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:42.788952 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-4fc43366-1e52-4cf1-84ac-826c8c4c36d6 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:42.789441 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-4fc43366-1e52-4cf1-84ac-826c8c4c36d6 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:42.802553 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-541ab5b3-4399-46a0-bb86-85c710379fa0 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:35:42.812098 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-541ab5b3-4399-46a0-bb86-85c710379fa0 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:35:42.814093 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-541ab5b3-4399-46a0-bb86-85c710379fa0 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:35:42.815803 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-541ab5b3-4399-46a0-bb86-85c710379fa0 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] 10.222.0.15 "GET /compute/v2.1/servers/852e8870-b3ec-4a21-a9b5-e31a423ddd3d" status: 200 len: 1745 microversion: 2.20 time: 0.202009 Oct 31 12:35:42.816580 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 218/444] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Oct 31 12:35:42 2022] GET /compute/v2.1/servers/852e8870-b3ec-4a21-a9b5-e31a423ddd3d => generated 1745 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 12:35:42.958423 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-4fc43366-1e52-4cf1-84ac-826c8c4c36d6 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c03f0365ee4a26b8c076ae365325b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfbc3a46f12942299b99cdd20c989e1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:35:42.968012 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-4fc43366-1e52-4cf1-84ac-826c8c4c36d6 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] 10.222.0.15 "GET /compute/v2.1/servers/d1bb54dd-d9ba-4789-b2a0-c91a292cb466" status: 200 len: 1365 microversion: 2.1 time: 0.193832 Oct 31 12:35:42.968910 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 227/445] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:35:42 2022] GET /compute/v2.1/servers/d1bb54dd-d9ba-4789-b2a0-c91a292cb466 => generated 1365 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:35:43.184099 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-9644ec98-b502-41c0-9352-f17d5c16a55f tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:35:43.184714 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-9644ec98-b502-41c0-9352-f17d5c16a55f tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] [instance: ee260508-cdfb-468d-9ff4-df06cc3bdadf] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:35:43.191739 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-9644ec98-b502-41c0-9352-f17d5c16a55f tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:43.192228 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-9644ec98-b502-41c0-9352-f17d5c16a55f tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:43.192799 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-9644ec98-b502-41c0-9352-f17d5c16a55f tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:43.193537 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-9644ec98-b502-41c0-9352-f17d5c16a55f tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:43.193991 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-9644ec98-b502-41c0-9352-f17d5c16a55f tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:43.194410 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-9644ec98-b502-41c0-9352-f17d5c16a55f tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:43.214211 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG dbcounter [-] [125441] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:35:43.347380 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-9644ec98-b502-41c0-9352-f17d5c16a55f tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2e978bcb824a5e9d593b861c9e3bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7573cb9c503243ab90b1649591d550e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:35:43.360241 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-9644ec98-b502-41c0-9352-f17d5c16a55f tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] 10.222.0.15 "GET /compute/v2.1/servers/ee260508-cdfb-468d-9ff4-df06cc3bdadf" status: 200 len: 1372 microversion: 2.1 time: 0.179558 Oct 31 12:35:43.361747 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 219/446] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:35:43 2022] GET /compute/v2.1/servers/ee260508-cdfb-468d-9ff4-df06cc3bdadf => generated 1372 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:35:43.842934 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-d0b2e3ca-5154-41c9-bc03-2e294e941ad8 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:35:43.843565 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-d0b2e3ca-5154-41c9-bc03-2e294e941ad8 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] [instance: 852e8870-b3ec-4a21-a9b5-e31a423ddd3d] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:35:43.845999 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG dbcounter [-] [125440] Writing DB stats nova_cell0:SELECT=8 {{(pid=125440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:35:43.852655 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-d0b2e3ca-5154-41c9-bc03-2e294e941ad8 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:43.853143 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-d0b2e3ca-5154-41c9-bc03-2e294e941ad8 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:43.853570 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-d0b2e3ca-5154-41c9-bc03-2e294e941ad8 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:43.854452 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-d0b2e3ca-5154-41c9-bc03-2e294e941ad8 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:43.854908 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-d0b2e3ca-5154-41c9-bc03-2e294e941ad8 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:43.855629 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-d0b2e3ca-5154-41c9-bc03-2e294e941ad8 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:43.996832 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-a0743416-39f5-40cf-ae96-55c8efa465ef tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:35:43.997595 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-a0743416-39f5-40cf-ae96-55c8efa465ef tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] [instance: d1bb54dd-d9ba-4789-b2a0-c91a292cb466] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:35:44.004357 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG dbcounter [-] [125441] Writing DB stats nova_cell0:SELECT=4 {{(pid=125441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:35:44.007200 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG dbcounter [-] [125441] Writing DB stats nova_cell0:SELECT=16 {{(pid=125441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:35:44.031556 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-a0743416-39f5-40cf-ae96-55c8efa465ef tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:44.032063 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-a0743416-39f5-40cf-ae96-55c8efa465ef tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:44.033391 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-a0743416-39f5-40cf-ae96-55c8efa465ef tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:44.034367 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-a0743416-39f5-40cf-ae96-55c8efa465ef tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:44.034917 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-a0743416-39f5-40cf-ae96-55c8efa465ef tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:44.056024 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-a0743416-39f5-40cf-ae96-55c8efa465ef tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:44.205515 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-d0b2e3ca-5154-41c9-bc03-2e294e941ad8 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:35:44.218326 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-d0b2e3ca-5154-41c9-bc03-2e294e941ad8 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:35:44.223341 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-d0b2e3ca-5154-41c9-bc03-2e294e941ad8 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:35:44.226426 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-d0b2e3ca-5154-41c9-bc03-2e294e941ad8 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] 10.222.0.15 "GET /compute/v2.1/servers/852e8870-b3ec-4a21-a9b5-e31a423ddd3d" status: 200 len: 1745 microversion: 2.20 time: 0.387302 Oct 31 12:35:44.235749 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 228/447] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Oct 31 12:35:43 2022] GET /compute/v2.1/servers/852e8870-b3ec-4a21-a9b5-e31a423ddd3d => generated 1745 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 12:35:44.378191 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-a0743416-39f5-40cf-ae96-55c8efa465ef tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c03f0365ee4a26b8c076ae365325b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfbc3a46f12942299b99cdd20c989e1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:35:44.386253 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-84e9def0-1fce-4d18-bae9-13307bc5aa7c tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:35:44.386677 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-a0743416-39f5-40cf-ae96-55c8efa465ef tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] 10.222.0.15 "GET /compute/v2.1/servers/d1bb54dd-d9ba-4789-b2a0-c91a292cb466" status: 200 len: 1365 microversion: 2.1 time: 0.398331 Oct 31 12:35:44.387218 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-84e9def0-1fce-4d18-bae9-13307bc5aa7c tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] [instance: ee260508-cdfb-468d-9ff4-df06cc3bdadf] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:35:44.395898 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-84e9def0-1fce-4d18-bae9-13307bc5aa7c tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:44.396673 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-84e9def0-1fce-4d18-bae9-13307bc5aa7c tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:44.397383 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-84e9def0-1fce-4d18-bae9-13307bc5aa7c tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:44.398340 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-84e9def0-1fce-4d18-bae9-13307bc5aa7c tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:44.398530 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 220/448] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:35:43 2022] GET /compute/v2.1/servers/d1bb54dd-d9ba-4789-b2a0-c91a292cb466 => generated 1365 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 12:35:44.399209 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-84e9def0-1fce-4d18-bae9-13307bc5aa7c tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:44.399842 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-84e9def0-1fce-4d18-bae9-13307bc5aa7c tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:44.545639 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-84e9def0-1fce-4d18-bae9-13307bc5aa7c tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2e978bcb824a5e9d593b861c9e3bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7573cb9c503243ab90b1649591d550e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:35:44.553717 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-84e9def0-1fce-4d18-bae9-13307bc5aa7c tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] 10.222.0.15 "GET /compute/v2.1/servers/ee260508-cdfb-468d-9ff4-df06cc3bdadf" status: 200 len: 1372 microversion: 2.1 time: 0.172538 Oct 31 12:35:44.554401 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 229/449] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:35:44 2022] GET /compute/v2.1/servers/ee260508-cdfb-468d-9ff4-df06cc3bdadf => generated 1372 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:35:45.254957 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-94a5af6c-c7e6-4229-a4c3-1432345089b4 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:35:45.255559 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-94a5af6c-c7e6-4229-a4c3-1432345089b4 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] [instance: 852e8870-b3ec-4a21-a9b5-e31a423ddd3d] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:35:45.261918 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-94a5af6c-c7e6-4229-a4c3-1432345089b4 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:45.262619 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-94a5af6c-c7e6-4229-a4c3-1432345089b4 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:45.263043 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-94a5af6c-c7e6-4229-a4c3-1432345089b4 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:45.263764 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-94a5af6c-c7e6-4229-a4c3-1432345089b4 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:45.264367 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-94a5af6c-c7e6-4229-a4c3-1432345089b4 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:45.265049 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-94a5af6c-c7e6-4229-a4c3-1432345089b4 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:45.412711 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-65f81829-6317-4371-9f75-872c21a4dc97 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:35:45.413504 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-65f81829-6317-4371-9f75-872c21a4dc97 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] [instance: d1bb54dd-d9ba-4789-b2a0-c91a292cb466] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:35:45.420946 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-65f81829-6317-4371-9f75-872c21a4dc97 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:45.421496 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-65f81829-6317-4371-9f75-872c21a4dc97 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:45.421986 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-65f81829-6317-4371-9f75-872c21a4dc97 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:45.422773 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-65f81829-6317-4371-9f75-872c21a4dc97 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:45.423908 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-65f81829-6317-4371-9f75-872c21a4dc97 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:45.424576 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-65f81829-6317-4371-9f75-872c21a4dc97 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:45.614662 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-65f81829-6317-4371-9f75-872c21a4dc97 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c03f0365ee4a26b8c076ae365325b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfbc3a46f12942299b99cdd20c989e1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:35:45.627399 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-65f81829-6317-4371-9f75-872c21a4dc97 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] 10.222.0.15 "GET /compute/v2.1/servers/d1bb54dd-d9ba-4789-b2a0-c91a292cb466" status: 200 len: 1365 microversion: 2.1 time: 0.219671 Oct 31 12:35:45.628248 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 230/450] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:35:45 2022] GET /compute/v2.1/servers/d1bb54dd-d9ba-4789-b2a0-c91a292cb466 => generated 1365 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 12:35:45.650833 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [req-5d359553-c22e-4286-b81e-a2a4686d24e6 req-b2262306-6b53-4f27-82c5-d6a1c8c27e71 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1bb54dd-d9ba-4789-b2a0-c91a292cb466", "name": "network-vif-plugged", "status": "completed", "tag": "2bcb3176-596a-4211-910f-3e00167f2763"}]} {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 12:35:45.667412 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [req-5d359553-c22e-4286-b81e-a2a4686d24e6 req-b2262306-6b53-4f27-82c5-d6a1c8c27e71 service nova] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:45.670109 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [req-5d359553-c22e-4286-b81e-a2a4686d24e6 req-b2262306-6b53-4f27-82c5-d6a1c8c27e71 service nova] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:45.670550 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [req-5d359553-c22e-4286-b81e-a2a4686d24e6 req-b2262306-6b53-4f27-82c5-d6a1c8c27e71 service nova] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:45.685733 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.compute.server_external_events [req-5d359553-c22e-4286-b81e-a2a4686d24e6 req-b2262306-6b53-4f27-82c5-d6a1c8c27e71 service nova] Creating event network-vif-plugged:2bcb3176-596a-4211-910f-3e00167f2763 for instance d1bb54dd-d9ba-4789-b2a0-c91a292cb466 on hv-cinder-79617 Oct 31 12:35:45.706857 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [req-5d359553-c22e-4286-b81e-a2a4686d24e6 req-b2262306-6b53-4f27-82c5-d6a1c8c27e71 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065171 Oct 31 12:35:45.708036 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 231/451] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Oct 31 12:35:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 12:35:45.715734 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-624f491a-68e8-4809-a85b-82f07a9db3da tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:35:45.716957 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-624f491a-68e8-4809-a85b-82f07a9db3da tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] [instance: ee260508-cdfb-468d-9ff4-df06cc3bdadf] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:35:45.734145 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-624f491a-68e8-4809-a85b-82f07a9db3da tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:45.734993 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-624f491a-68e8-4809-a85b-82f07a9db3da tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:45.736606 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-624f491a-68e8-4809-a85b-82f07a9db3da tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:45.737797 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-624f491a-68e8-4809-a85b-82f07a9db3da tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:45.739769 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-624f491a-68e8-4809-a85b-82f07a9db3da tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:45.742403 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-624f491a-68e8-4809-a85b-82f07a9db3da tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:45.979916 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-94a5af6c-c7e6-4229-a4c3-1432345089b4 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:35:45.989017 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-624f491a-68e8-4809-a85b-82f07a9db3da tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2e978bcb824a5e9d593b861c9e3bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7573cb9c503243ab90b1649591d550e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:35:45.992207 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-94a5af6c-c7e6-4229-a4c3-1432345089b4 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:35:45.995831 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-94a5af6c-c7e6-4229-a4c3-1432345089b4 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:35:46.001638 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-94a5af6c-c7e6-4229-a4c3-1432345089b4 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] 10.222.0.15 "GET /compute/v2.1/servers/852e8870-b3ec-4a21-a9b5-e31a423ddd3d" status: 200 len: 1745 microversion: 2.20 time: 0.750052 Oct 31 12:35:46.002018 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-624f491a-68e8-4809-a85b-82f07a9db3da tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] 10.222.0.15 "GET /compute/v2.1/servers/ee260508-cdfb-468d-9ff4-df06cc3bdadf" status: 200 len: 1372 microversion: 2.1 time: 0.290143 Oct 31 12:35:46.002967 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 232/452] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:35:45 2022] GET /compute/v2.1/servers/ee260508-cdfb-468d-9ff4-df06cc3bdadf => generated 1372 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:35:46.006265 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 221/453] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Oct 31 12:35:45 2022] GET /compute/v2.1/servers/852e8870-b3ec-4a21-a9b5-e31a423ddd3d => generated 1745 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 12:35:46.653497 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-a10d353a-0cb0-40af-a673-a85be897b401 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:35:46.654691 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-a10d353a-0cb0-40af-a673-a85be897b401 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] [instance: d1bb54dd-d9ba-4789-b2a0-c91a292cb466] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:35:46.658149 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG dbcounter [-] [125440] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=125440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:35:46.667828 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-a10d353a-0cb0-40af-a673-a85be897b401 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:46.668318 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-a10d353a-0cb0-40af-a673-a85be897b401 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:46.668747 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-a10d353a-0cb0-40af-a673-a85be897b401 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:46.669510 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-a10d353a-0cb0-40af-a673-a85be897b401 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:46.670179 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-a10d353a-0cb0-40af-a673-a85be897b401 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:46.671027 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-a10d353a-0cb0-40af-a673-a85be897b401 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:46.934716 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-a10d353a-0cb0-40af-a673-a85be897b401 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c03f0365ee4a26b8c076ae365325b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfbc3a46f12942299b99cdd20c989e1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:35:46.944583 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-a10d353a-0cb0-40af-a673-a85be897b401 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] 10.222.0.15 "GET /compute/v2.1/servers/d1bb54dd-d9ba-4789-b2a0-c91a292cb466" status: 200 len: 1365 microversion: 2.1 time: 0.295002 Oct 31 12:35:46.947444 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 233/454] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:35:46 2022] GET /compute/v2.1/servers/d1bb54dd-d9ba-4789-b2a0-c91a292cb466 => generated 1365 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:35:47.032898 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-09dddb9e-3f31-4bb3-9679-503542240d4b tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:35:47.033788 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-09dddb9e-3f31-4bb3-9679-503542240d4b tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] [instance: 852e8870-b3ec-4a21-a9b5-e31a423ddd3d] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:35:47.045726 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-09dddb9e-3f31-4bb3-9679-503542240d4b tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:47.046429 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-09dddb9e-3f31-4bb3-9679-503542240d4b tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:47.046937 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-026076f6-7523-4ce8-853f-0d64597024f4 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:35:47.047430 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-09dddb9e-3f31-4bb3-9679-503542240d4b tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:47.047884 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-09dddb9e-3f31-4bb3-9679-503542240d4b tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:47.048798 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-09dddb9e-3f31-4bb3-9679-503542240d4b tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:47.049225 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-09dddb9e-3f31-4bb3-9679-503542240d4b tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:47.049742 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-026076f6-7523-4ce8-853f-0d64597024f4 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] [instance: ee260508-cdfb-468d-9ff4-df06cc3bdadf] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:35:47.056387 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-026076f6-7523-4ce8-853f-0d64597024f4 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:47.057173 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-026076f6-7523-4ce8-853f-0d64597024f4 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:47.057819 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-026076f6-7523-4ce8-853f-0d64597024f4 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:47.059493 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-026076f6-7523-4ce8-853f-0d64597024f4 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:47.060405 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-026076f6-7523-4ce8-853f-0d64597024f4 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:47.061057 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-026076f6-7523-4ce8-853f-0d64597024f4 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:47.310399 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-026076f6-7523-4ce8-853f-0d64597024f4 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2e978bcb824a5e9d593b861c9e3bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7573cb9c503243ab90b1649591d550e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:35:47.326343 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-026076f6-7523-4ce8-853f-0d64597024f4 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] 10.222.0.15 "GET /compute/v2.1/servers/ee260508-cdfb-468d-9ff4-df06cc3bdadf" status: 200 len: 1372 microversion: 2.1 time: 0.305659 Oct 31 12:35:47.327589 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 222/455] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:35:47 2022] GET /compute/v2.1/servers/ee260508-cdfb-468d-9ff4-df06cc3bdadf => generated 1372 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:35:47.671962 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-09dddb9e-3f31-4bb3-9679-503542240d4b tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:35:47.693292 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-09dddb9e-3f31-4bb3-9679-503542240d4b tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:35:47.695081 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-09dddb9e-3f31-4bb3-9679-503542240d4b tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:35:47.697208 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-09dddb9e-3f31-4bb3-9679-503542240d4b tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] 10.222.0.15 "GET /compute/v2.1/servers/852e8870-b3ec-4a21-a9b5-e31a423ddd3d" status: 200 len: 1740 microversion: 2.20 time: 0.669319 Oct 31 12:35:47.698300 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 234/456] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Oct 31 12:35:47 2022] GET /compute/v2.1/servers/852e8870-b3ec-4a21-a9b5-e31a423ddd3d => generated 1740 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 12:35:47.770663 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [req-5b8e4c90-5819-4a71-bf65-061d8fd2526a req-f1be75e5-b4d9-4832-b0dc-3b73e5793d27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "852e8870-b3ec-4a21-a9b5-e31a423ddd3d", "name": "network-vif-plugged", "status": "completed", "tag": "dffec82d-007b-4838-9898-19da61885395"}]} {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 12:35:47.780617 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [req-5b8e4c90-5819-4a71-bf65-061d8fd2526a req-f1be75e5-b4d9-4832-b0dc-3b73e5793d27 service nova] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:47.781050 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [req-5b8e4c90-5819-4a71-bf65-061d8fd2526a req-f1be75e5-b4d9-4832-b0dc-3b73e5793d27 service nova] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:47.781720 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [req-5b8e4c90-5819-4a71-bf65-061d8fd2526a req-f1be75e5-b4d9-4832-b0dc-3b73e5793d27 service nova] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:47.796203 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.compute.server_external_events [req-5b8e4c90-5819-4a71-bf65-061d8fd2526a req-f1be75e5-b4d9-4832-b0dc-3b73e5793d27 service nova] Creating event network-vif-plugged:dffec82d-007b-4838-9898-19da61885395 for instance 852e8870-b3ec-4a21-a9b5-e31a423ddd3d on hv-cinder-79617 Oct 31 12:35:47.803730 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [req-5b8e4c90-5819-4a71-bf65-061d8fd2526a req-f1be75e5-b4d9-4832-b0dc-3b73e5793d27 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036687 Oct 31 12:35:47.805144 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 223/457] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Oct 31 12:35:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 12:35:47.970294 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-75687642-d729-47a5-9a83-f5a7996710ad tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:35:47.971298 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-75687642-d729-47a5-9a83-f5a7996710ad tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] [instance: d1bb54dd-d9ba-4789-b2a0-c91a292cb466] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:35:47.977675 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-75687642-d729-47a5-9a83-f5a7996710ad tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:47.987929 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-75687642-d729-47a5-9a83-f5a7996710ad tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:47.988378 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-75687642-d729-47a5-9a83-f5a7996710ad tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:47.990382 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-75687642-d729-47a5-9a83-f5a7996710ad tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:47.990382 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-75687642-d729-47a5-9a83-f5a7996710ad tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:47.990382 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-75687642-d729-47a5-9a83-f5a7996710ad tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:48.286121 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-75687642-d729-47a5-9a83-f5a7996710ad tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c03f0365ee4a26b8c076ae365325b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfbc3a46f12942299b99cdd20c989e1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:35:48.294034 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG dbcounter [-] [125440] Writing DB stats nova_cell1:SELECT=100 {{(pid=125440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:35:48.318956 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-75687642-d729-47a5-9a83-f5a7996710ad tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] 10.222.0.15 "GET /compute/v2.1/servers/d1bb54dd-d9ba-4789-b2a0-c91a292cb466" status: 200 len: 1365 microversion: 2.1 time: 0.352296 Oct 31 12:35:48.323675 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 235/458] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:35:47 2022] GET /compute/v2.1/servers/d1bb54dd-d9ba-4789-b2a0-c91a292cb466 => generated 1365 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:35:48.362316 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-108c3431-b642-4fa4-9510-6e0b158a5ea4 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:35:48.363568 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-108c3431-b642-4fa4-9510-6e0b158a5ea4 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] [instance: ee260508-cdfb-468d-9ff4-df06cc3bdadf] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:35:48.399699 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-108c3431-b642-4fa4-9510-6e0b158a5ea4 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:48.400452 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-108c3431-b642-4fa4-9510-6e0b158a5ea4 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:48.400895 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-108c3431-b642-4fa4-9510-6e0b158a5ea4 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:48.415594 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-108c3431-b642-4fa4-9510-6e0b158a5ea4 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:48.418565 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-108c3431-b642-4fa4-9510-6e0b158a5ea4 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:48.421287 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-108c3431-b642-4fa4-9510-6e0b158a5ea4 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:48.652559 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-108c3431-b642-4fa4-9510-6e0b158a5ea4 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2e978bcb824a5e9d593b861c9e3bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7573cb9c503243ab90b1649591d550e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:35:48.661384 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-108c3431-b642-4fa4-9510-6e0b158a5ea4 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] 10.222.0.15 "GET /compute/v2.1/servers/ee260508-cdfb-468d-9ff4-df06cc3bdadf" status: 200 len: 1372 microversion: 2.1 time: 0.314938 Oct 31 12:35:48.679075 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 224/459] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:35:48 2022] GET /compute/v2.1/servers/ee260508-cdfb-468d-9ff4-df06cc3bdadf => generated 1372 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:35:48.726146 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-fe135a82-8438-40c3-becb-b53043d3e80c tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:35:48.726813 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-fe135a82-8438-40c3-becb-b53043d3e80c tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] [instance: 852e8870-b3ec-4a21-a9b5-e31a423ddd3d] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:35:48.739516 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-fe135a82-8438-40c3-becb-b53043d3e80c tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:48.740003 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-fe135a82-8438-40c3-becb-b53043d3e80c tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:48.740430 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-fe135a82-8438-40c3-becb-b53043d3e80c tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:48.741131 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-fe135a82-8438-40c3-becb-b53043d3e80c tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:48.741602 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-fe135a82-8438-40c3-becb-b53043d3e80c tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:48.742008 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-fe135a82-8438-40c3-becb-b53043d3e80c tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:49.145783 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-fe135a82-8438-40c3-becb-b53043d3e80c tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:35:49.156783 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-fe135a82-8438-40c3-becb-b53043d3e80c tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:35:49.162680 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-fe135a82-8438-40c3-becb-b53043d3e80c tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:35:49.164074 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-fe135a82-8438-40c3-becb-b53043d3e80c tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] 10.222.0.15 "GET /compute/v2.1/servers/852e8870-b3ec-4a21-a9b5-e31a423ddd3d" status: 200 len: 1740 microversion: 2.20 time: 0.444312 Oct 31 12:35:49.164789 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 236/460] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Oct 31 12:35:48 2022] GET /compute/v2.1/servers/852e8870-b3ec-4a21-a9b5-e31a423ddd3d => generated 1740 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 12:35:49.347808 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-7766d424-cf9c-4241-9b51-f87da7c98970 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:35:49.349136 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-7766d424-cf9c-4241-9b51-f87da7c98970 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] [instance: d1bb54dd-d9ba-4789-b2a0-c91a292cb466] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:35:49.362432 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-7766d424-cf9c-4241-9b51-f87da7c98970 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:49.367000 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-7766d424-cf9c-4241-9b51-f87da7c98970 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:49.367751 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-7766d424-cf9c-4241-9b51-f87da7c98970 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:49.369836 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-7766d424-cf9c-4241-9b51-f87da7c98970 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:49.370493 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-7766d424-cf9c-4241-9b51-f87da7c98970 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:49.371852 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-7766d424-cf9c-4241-9b51-f87da7c98970 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:49.592090 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-7766d424-cf9c-4241-9b51-f87da7c98970 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c03f0365ee4a26b8c076ae365325b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfbc3a46f12942299b99cdd20c989e1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:35:49.611585 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-7766d424-cf9c-4241-9b51-f87da7c98970 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] 10.222.0.15 "GET /compute/v2.1/servers/d1bb54dd-d9ba-4789-b2a0-c91a292cb466" status: 200 len: 1556 microversion: 2.1 time: 0.268791 Oct 31 12:35:49.617627 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 225/461] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:35:49 2022] GET /compute/v2.1/servers/d1bb54dd-d9ba-4789-b2a0-c91a292cb466 => generated 1556 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:35:49.638564 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-6188823c-757c-4d12-b0a3-6ca4549c2493 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:35:49.639047 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-6188823c-757c-4d12-b0a3-6ca4549c2493 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] [instance: d1bb54dd-d9ba-4789-b2a0-c91a292cb466] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:35:49.645881 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-6188823c-757c-4d12-b0a3-6ca4549c2493 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:49.646351 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-6188823c-757c-4d12-b0a3-6ca4549c2493 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:49.646965 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-6188823c-757c-4d12-b0a3-6ca4549c2493 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:49.647892 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-6188823c-757c-4d12-b0a3-6ca4549c2493 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:49.659855 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-6188823c-757c-4d12-b0a3-6ca4549c2493 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:49.660725 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-6188823c-757c-4d12-b0a3-6ca4549c2493 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:49.686807 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-5f6128a2-40b1-4771-b41f-061a60192461 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:35:49.687702 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-5f6128a2-40b1-4771-b41f-061a60192461 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] [instance: ee260508-cdfb-468d-9ff4-df06cc3bdadf] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:35:49.697731 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-5f6128a2-40b1-4771-b41f-061a60192461 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:49.702336 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-5f6128a2-40b1-4771-b41f-061a60192461 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:49.702791 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-5f6128a2-40b1-4771-b41f-061a60192461 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:49.703553 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-5f6128a2-40b1-4771-b41f-061a60192461 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:49.705450 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-5f6128a2-40b1-4771-b41f-061a60192461 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:49.706052 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-5f6128a2-40b1-4771-b41f-061a60192461 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:49.772785 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-6188823c-757c-4d12-b0a3-6ca4549c2493 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] 10.222.0.15 "GET /compute/v2.1/servers/d1bb54dd-d9ba-4789-b2a0-c91a292cb466/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.137975 Oct 31 12:35:49.773496 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 237/462] 10.222.0.15 () {58 vars in 1275 bytes} [Mon Oct 31 12:35:49 2022] GET /compute/v2.1/servers/d1bb54dd-d9ba-4789-b2a0-c91a292cb466/os-interface => generated 285 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 12:35:49.831044 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [req-57234e69-590c-4954-a237-9472559444d8 req-6a8affd8-d588-4b39-bd8d-47e19ccd7eec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee260508-cdfb-468d-9ff4-df06cc3bdadf", "name": "network-vif-plugged", "status": "completed", "tag": "7591dba3-56f4-4739-8b1f-33a42a9073b1"}]} {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 12:35:49.842717 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [req-57234e69-590c-4954-a237-9472559444d8 req-6a8affd8-d588-4b39-bd8d-47e19ccd7eec service nova] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:49.843487 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [req-57234e69-590c-4954-a237-9472559444d8 req-6a8affd8-d588-4b39-bd8d-47e19ccd7eec service nova] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:49.844057 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [req-57234e69-590c-4954-a237-9472559444d8 req-6a8affd8-d588-4b39-bd8d-47e19ccd7eec service nova] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:49.859033 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.compute.server_external_events [req-57234e69-590c-4954-a237-9472559444d8 req-6a8affd8-d588-4b39-bd8d-47e19ccd7eec service nova] Creating event network-vif-plugged:7591dba3-56f4-4739-8b1f-33a42a9073b1 for instance ee260508-cdfb-468d-9ff4-df06cc3bdadf on hv-cinder-79617 Oct 31 12:35:49.865344 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [req-57234e69-590c-4954-a237-9472559444d8 req-6a8affd8-d588-4b39-bd8d-47e19ccd7eec service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039197 Oct 31 12:35:49.868296 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 238/463] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Oct 31 12:35:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 12:35:50.061709 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-5f6128a2-40b1-4771-b41f-061a60192461 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2e978bcb824a5e9d593b861c9e3bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7573cb9c503243ab90b1649591d550e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:35:50.075331 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-5f6128a2-40b1-4771-b41f-061a60192461 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] 10.222.0.15 "GET /compute/v2.1/servers/ee260508-cdfb-468d-9ff4-df06cc3bdadf" status: 200 len: 1372 microversion: 2.1 time: 0.393199 Oct 31 12:35:50.076586 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 226/464] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:35:49 2022] GET /compute/v2.1/servers/ee260508-cdfb-468d-9ff4-df06cc3bdadf => generated 1372 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 12:35:50.191845 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-d27c93b0-5ccb-4227-922f-b2f83961ef44 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:35:50.192830 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-d27c93b0-5ccb-4227-922f-b2f83961ef44 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] [instance: 852e8870-b3ec-4a21-a9b5-e31a423ddd3d] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:35:50.203470 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-d27c93b0-5ccb-4227-922f-b2f83961ef44 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:50.204353 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-d27c93b0-5ccb-4227-922f-b2f83961ef44 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:50.206193 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-d27c93b0-5ccb-4227-922f-b2f83961ef44 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:50.207145 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-d27c93b0-5ccb-4227-922f-b2f83961ef44 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:50.211319 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-d27c93b0-5ccb-4227-922f-b2f83961ef44 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:50.213134 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-d27c93b0-5ccb-4227-922f-b2f83961ef44 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:50.545421 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-d27c93b0-5ccb-4227-922f-b2f83961ef44 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:35:50.562221 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-d27c93b0-5ccb-4227-922f-b2f83961ef44 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:35:50.565203 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-d27c93b0-5ccb-4227-922f-b2f83961ef44 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:35:50.566490 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-d27c93b0-5ccb-4227-922f-b2f83961ef44 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] 10.222.0.15 "GET /compute/v2.1/servers/852e8870-b3ec-4a21-a9b5-e31a423ddd3d" status: 200 len: 1740 microversion: 2.20 time: 0.379671 Oct 31 12:35:50.567308 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 239/465] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Oct 31 12:35:50 2022] GET /compute/v2.1/servers/852e8870-b3ec-4a21-a9b5-e31a423ddd3d => generated 1740 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 12:35:51.098637 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-ef7e9dc9-fdce-466d-899b-36558d8612c6 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:35:51.099509 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-ef7e9dc9-fdce-466d-899b-36558d8612c6 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] [instance: ee260508-cdfb-468d-9ff4-df06cc3bdadf] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:35:51.112694 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-ef7e9dc9-fdce-466d-899b-36558d8612c6 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:51.113463 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-ef7e9dc9-fdce-466d-899b-36558d8612c6 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:51.114124 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-ef7e9dc9-fdce-466d-899b-36558d8612c6 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:51.115035 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-ef7e9dc9-fdce-466d-899b-36558d8612c6 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:51.115801 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-ef7e9dc9-fdce-466d-899b-36558d8612c6 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:51.116378 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-ef7e9dc9-fdce-466d-899b-36558d8612c6 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:51.482832 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [req-a938f44d-63b9-4042-aea0-143e64de1b7a req-e7525528-867a-4d67-9b90-48864b838475 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d1bb54dd-d9ba-4789-b2a0-c91a292cb466", "tag": "2bcb3176-596a-4211-910f-3e00167f2763"}]} {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 12:35:51.497935 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-ef7e9dc9-fdce-466d-899b-36558d8612c6 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2e978bcb824a5e9d593b861c9e3bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7573cb9c503243ab90b1649591d550e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:35:51.511295 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-ef7e9dc9-fdce-466d-899b-36558d8612c6 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] 10.222.0.15 "GET /compute/v2.1/servers/ee260508-cdfb-468d-9ff4-df06cc3bdadf" status: 200 len: 1372 microversion: 2.1 time: 0.417037 Oct 31 12:35:51.518210 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 227/466] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:35:51 2022] GET /compute/v2.1/servers/ee260508-cdfb-468d-9ff4-df06cc3bdadf => generated 1372 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:35:51.553127 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [req-a938f44d-63b9-4042-aea0-143e64de1b7a req-e7525528-867a-4d67-9b90-48864b838475 service nova] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:51.553633 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [req-a938f44d-63b9-4042-aea0-143e64de1b7a req-e7525528-867a-4d67-9b90-48864b838475 service nova] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:51.554123 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [req-a938f44d-63b9-4042-aea0-143e64de1b7a req-e7525528-867a-4d67-9b90-48864b838475 service nova] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:51.569676 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.compute.server_external_events [req-a938f44d-63b9-4042-aea0-143e64de1b7a req-e7525528-867a-4d67-9b90-48864b838475 service nova] Creating event network-changed:2bcb3176-596a-4211-910f-3e00167f2763 for instance d1bb54dd-d9ba-4789-b2a0-c91a292cb466 on hv-cinder-79617 Oct 31 12:35:51.588979 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [req-a938f44d-63b9-4042-aea0-143e64de1b7a req-e7525528-867a-4d67-9b90-48864b838475 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109791 Oct 31 12:35:51.590006 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 240/467] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Oct 31 12:35:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 12:35:51.599026 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-35f2358f-0621-4cc6-8ce0-97cd931e1865 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:35:51.600066 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-35f2358f-0621-4cc6-8ce0-97cd931e1865 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] [instance: 852e8870-b3ec-4a21-a9b5-e31a423ddd3d] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:35:51.608185 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-35f2358f-0621-4cc6-8ce0-97cd931e1865 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:51.608892 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-35f2358f-0621-4cc6-8ce0-97cd931e1865 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:51.609536 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-35f2358f-0621-4cc6-8ce0-97cd931e1865 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:51.611925 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-35f2358f-0621-4cc6-8ce0-97cd931e1865 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:51.612639 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-35f2358f-0621-4cc6-8ce0-97cd931e1865 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:51.614190 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-35f2358f-0621-4cc6-8ce0-97cd931e1865 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:51.921429 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-35f2358f-0621-4cc6-8ce0-97cd931e1865 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:35:51.937081 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-35f2358f-0621-4cc6-8ce0-97cd931e1865 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:35:51.941330 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-35f2358f-0621-4cc6-8ce0-97cd931e1865 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:35:51.942634 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-35f2358f-0621-4cc6-8ce0-97cd931e1865 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] 10.222.0.15 "GET /compute/v2.1/servers/852e8870-b3ec-4a21-a9b5-e31a423ddd3d" status: 200 len: 1740 microversion: 2.20 time: 0.350361 Oct 31 12:35:51.947875 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 228/468] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Oct 31 12:35:51 2022] GET /compute/v2.1/servers/852e8870-b3ec-4a21-a9b5-e31a423ddd3d => generated 1740 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 12:35:52.547712 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-fbc9c43d-a073-4550-af48-2449ea3aae60 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:35:52.549077 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-fbc9c43d-a073-4550-af48-2449ea3aae60 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] [instance: ee260508-cdfb-468d-9ff4-df06cc3bdadf] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:35:52.562731 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-fbc9c43d-a073-4550-af48-2449ea3aae60 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:52.569007 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-fbc9c43d-a073-4550-af48-2449ea3aae60 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:52.570452 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-fbc9c43d-a073-4550-af48-2449ea3aae60 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:52.571388 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-fbc9c43d-a073-4550-af48-2449ea3aae60 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:52.572670 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-fbc9c43d-a073-4550-af48-2449ea3aae60 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:52.573281 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-fbc9c43d-a073-4550-af48-2449ea3aae60 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:52.972234 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-e05fb6bb-1b58-49f6-af4d-8eb172f3e5eb tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:35:52.972864 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-e05fb6bb-1b58-49f6-af4d-8eb172f3e5eb tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] [instance: 852e8870-b3ec-4a21-a9b5-e31a423ddd3d] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:35:52.984365 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-e05fb6bb-1b58-49f6-af4d-8eb172f3e5eb tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:52.984861 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-e05fb6bb-1b58-49f6-af4d-8eb172f3e5eb tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:52.985337 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-e05fb6bb-1b58-49f6-af4d-8eb172f3e5eb tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:52.986180 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-e05fb6bb-1b58-49f6-af4d-8eb172f3e5eb tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:52.986505 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-e05fb6bb-1b58-49f6-af4d-8eb172f3e5eb tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:52.986931 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-e05fb6bb-1b58-49f6-af4d-8eb172f3e5eb tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:53.065483 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-fbc9c43d-a073-4550-af48-2449ea3aae60 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2e978bcb824a5e9d593b861c9e3bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7573cb9c503243ab90b1649591d550e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:35:53.088569 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-fbc9c43d-a073-4550-af48-2449ea3aae60 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] 10.222.0.15 "GET /compute/v2.1/servers/ee260508-cdfb-468d-9ff4-df06cc3bdadf" status: 200 len: 1372 microversion: 2.1 time: 0.545865 Oct 31 12:35:53.107194 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 241/469] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:35:52 2022] GET /compute/v2.1/servers/ee260508-cdfb-468d-9ff4-df06cc3bdadf => generated 1372 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:35:53.338575 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-e05fb6bb-1b58-49f6-af4d-8eb172f3e5eb tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:35:53.362251 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-e05fb6bb-1b58-49f6-af4d-8eb172f3e5eb tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:35:53.378574 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-e05fb6bb-1b58-49f6-af4d-8eb172f3e5eb tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:35:53.383876 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-e05fb6bb-1b58-49f6-af4d-8eb172f3e5eb tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] 10.222.0.15 "GET /compute/v2.1/servers/852e8870-b3ec-4a21-a9b5-e31a423ddd3d" status: 200 len: 1740 microversion: 2.20 time: 0.414436 Oct 31 12:35:53.388563 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 229/470] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Oct 31 12:35:52 2022] GET /compute/v2.1/servers/852e8870-b3ec-4a21-a9b5-e31a423ddd3d => generated 1740 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 12:35:54.114926 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-32944422-cd0c-4c8d-8639-07c819d6d7f8 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:35:54.118704 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-32944422-cd0c-4c8d-8639-07c819d6d7f8 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] [instance: ee260508-cdfb-468d-9ff4-df06cc3bdadf] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:35:54.130156 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-32944422-cd0c-4c8d-8639-07c819d6d7f8 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:54.133713 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-32944422-cd0c-4c8d-8639-07c819d6d7f8 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:54.135088 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-32944422-cd0c-4c8d-8639-07c819d6d7f8 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:54.135993 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-32944422-cd0c-4c8d-8639-07c819d6d7f8 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:54.137668 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-32944422-cd0c-4c8d-8639-07c819d6d7f8 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:54.138293 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-32944422-cd0c-4c8d-8639-07c819d6d7f8 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:54.427133 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-5affe10c-0892-4d15-8900-1f5ca21cd564 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:35:54.428677 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-5affe10c-0892-4d15-8900-1f5ca21cd564 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] [instance: 852e8870-b3ec-4a21-a9b5-e31a423ddd3d] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:35:54.462692 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-5affe10c-0892-4d15-8900-1f5ca21cd564 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:54.466713 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-5affe10c-0892-4d15-8900-1f5ca21cd564 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:54.468909 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-5affe10c-0892-4d15-8900-1f5ca21cd564 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:54.470690 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-5affe10c-0892-4d15-8900-1f5ca21cd564 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:54.474096 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-5affe10c-0892-4d15-8900-1f5ca21cd564 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:54.474729 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-5affe10c-0892-4d15-8900-1f5ca21cd564 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:54.760685 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-32944422-cd0c-4c8d-8639-07c819d6d7f8 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2e978bcb824a5e9d593b861c9e3bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7573cb9c503243ab90b1649591d550e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:35:54.773522 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-32944422-cd0c-4c8d-8639-07c819d6d7f8 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] 10.222.0.15 "GET /compute/v2.1/servers/ee260508-cdfb-468d-9ff4-df06cc3bdadf" status: 200 len: 1566 microversion: 2.1 time: 0.663370 Oct 31 12:35:54.792714 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 242/471] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:35:54 2022] GET /compute/v2.1/servers/ee260508-cdfb-468d-9ff4-df06cc3bdadf => generated 1566 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:35:54.796405 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-5affe10c-0892-4d15-8900-1f5ca21cd564 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:35:54.798636 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-da96856a-5e98-446c-bdbb-d15a16672c4d tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:35:54.799064 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-da96856a-5e98-446c-bdbb-d15a16672c4d tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] [instance: ee260508-cdfb-468d-9ff4-df06cc3bdadf] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:35:54.810643 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-5affe10c-0892-4d15-8900-1f5ca21cd564 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:35:54.812480 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-5affe10c-0892-4d15-8900-1f5ca21cd564 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:35:54.813895 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-da96856a-5e98-446c-bdbb-d15a16672c4d tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:54.816947 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-5affe10c-0892-4d15-8900-1f5ca21cd564 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] 10.222.0.15 "GET /compute/v2.1/servers/852e8870-b3ec-4a21-a9b5-e31a423ddd3d" status: 200 len: 1740 microversion: 2.20 time: 0.405499 Oct 31 12:35:54.817763 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 230/472] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Oct 31 12:35:54 2022] GET /compute/v2.1/servers/852e8870-b3ec-4a21-a9b5-e31a423ddd3d => generated 1740 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 12:35:54.818510 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-da96856a-5e98-446c-bdbb-d15a16672c4d tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:54.819194 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-da96856a-5e98-446c-bdbb-d15a16672c4d tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:54.819936 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-da96856a-5e98-446c-bdbb-d15a16672c4d tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:54.820402 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-da96856a-5e98-446c-bdbb-d15a16672c4d tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:54.820820 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-da96856a-5e98-446c-bdbb-d15a16672c4d tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:55.033439 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-da96856a-5e98-446c-bdbb-d15a16672c4d tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] 10.222.0.15 "GET /compute/v2.1/servers/ee260508-cdfb-468d-9ff4-df06cc3bdadf/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.239278 Oct 31 12:35:55.034211 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 243/473] 10.222.0.15 () {58 vars in 1275 bytes} [Mon Oct 31 12:35:54 2022] GET /compute/v2.1/servers/ee260508-cdfb-468d-9ff4-df06cc3bdadf/os-interface => generated 284 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 12:35:55.859322 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-3128b8c2-ff5b-423c-bb83-56eeb0563aa6 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:35:55.860364 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-3128b8c2-ff5b-423c-bb83-56eeb0563aa6 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] [instance: 852e8870-b3ec-4a21-a9b5-e31a423ddd3d] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:35:55.873408 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-3128b8c2-ff5b-423c-bb83-56eeb0563aa6 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:55.875724 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-3128b8c2-ff5b-423c-bb83-56eeb0563aa6 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:55.876422 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-3128b8c2-ff5b-423c-bb83-56eeb0563aa6 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:55.879704 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-3128b8c2-ff5b-423c-bb83-56eeb0563aa6 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:55.880479 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-3128b8c2-ff5b-423c-bb83-56eeb0563aa6 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:55.883468 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-3128b8c2-ff5b-423c-bb83-56eeb0563aa6 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:56.399491 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-3128b8c2-ff5b-423c-bb83-56eeb0563aa6 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:35:56.413296 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-3128b8c2-ff5b-423c-bb83-56eeb0563aa6 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:35:56.422086 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-3128b8c2-ff5b-423c-bb83-56eeb0563aa6 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:35:56.424261 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-3128b8c2-ff5b-423c-bb83-56eeb0563aa6 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] 10.222.0.15 "GET /compute/v2.1/servers/852e8870-b3ec-4a21-a9b5-e31a423ddd3d" status: 200 len: 1740 microversion: 2.20 time: 0.574686 Oct 31 12:35:56.430754 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 231/474] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Oct 31 12:35:55 2022] GET /compute/v2.1/servers/852e8870-b3ec-4a21-a9b5-e31a423ddd3d => generated 1740 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 12:35:57.088118 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [req-81636241-4d4f-4050-af84-304a70302ba2 req-7c75f8d9-4981-4d8c-8e3e-daf11a94d895 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee260508-cdfb-468d-9ff4-df06cc3bdadf", "tag": "7591dba3-56f4-4739-8b1f-33a42a9073b1"}]} {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 12:35:57.115527 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [req-81636241-4d4f-4050-af84-304a70302ba2 req-7c75f8d9-4981-4d8c-8e3e-daf11a94d895 service nova] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:57.116253 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [req-81636241-4d4f-4050-af84-304a70302ba2 req-7c75f8d9-4981-4d8c-8e3e-daf11a94d895 service nova] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:57.116900 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [req-81636241-4d4f-4050-af84-304a70302ba2 req-7c75f8d9-4981-4d8c-8e3e-daf11a94d895 service nova] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:57.164396 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.compute.server_external_events [req-81636241-4d4f-4050-af84-304a70302ba2 req-7c75f8d9-4981-4d8c-8e3e-daf11a94d895 service nova] Creating event network-changed:7591dba3-56f4-4739-8b1f-33a42a9073b1 for instance ee260508-cdfb-468d-9ff4-df06cc3bdadf on hv-cinder-79617 Oct 31 12:35:57.172060 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [req-81636241-4d4f-4050-af84-304a70302ba2 req-7c75f8d9-4981-4d8c-8e3e-daf11a94d895 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087778 Oct 31 12:35:57.174291 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 244/475] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Oct 31 12:35:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 12:35:57.457713 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-94ff3df2-1c71-4038-a886-6dd787fcff0f tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:35:57.458917 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-94ff3df2-1c71-4038-a886-6dd787fcff0f tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] [instance: 852e8870-b3ec-4a21-a9b5-e31a423ddd3d] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:35:57.485778 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-94ff3df2-1c71-4038-a886-6dd787fcff0f tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:57.486657 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-94ff3df2-1c71-4038-a886-6dd787fcff0f tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:57.487102 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-94ff3df2-1c71-4038-a886-6dd787fcff0f tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:57.487857 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-94ff3df2-1c71-4038-a886-6dd787fcff0f tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:57.494241 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-94ff3df2-1c71-4038-a886-6dd787fcff0f tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:57.495679 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-94ff3df2-1c71-4038-a886-6dd787fcff0f tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:57.774192 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-94ff3df2-1c71-4038-a886-6dd787fcff0f tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:35:57.785867 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-94ff3df2-1c71-4038-a886-6dd787fcff0f tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:35:57.787802 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-94ff3df2-1c71-4038-a886-6dd787fcff0f tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:35:57.789031 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-94ff3df2-1c71-4038-a886-6dd787fcff0f tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] 10.222.0.15 "GET /compute/v2.1/servers/852e8870-b3ec-4a21-a9b5-e31a423ddd3d" status: 200 len: 1740 microversion: 2.20 time: 0.335931 Oct 31 12:35:57.790115 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 232/476] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Oct 31 12:35:57 2022] GET /compute/v2.1/servers/852e8870-b3ec-4a21-a9b5-e31a423ddd3d => generated 1740 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 12:35:58.823558 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-c9447b05-c075-42ee-b82d-f139b5037788 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:35:58.824424 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-c9447b05-c075-42ee-b82d-f139b5037788 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] [instance: 852e8870-b3ec-4a21-a9b5-e31a423ddd3d] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:35:58.837679 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-c9447b05-c075-42ee-b82d-f139b5037788 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:58.838691 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-c9447b05-c075-42ee-b82d-f139b5037788 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:58.839486 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-c9447b05-c075-42ee-b82d-f139b5037788 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:58.840474 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-c9447b05-c075-42ee-b82d-f139b5037788 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:35:58.841171 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-c9447b05-c075-42ee-b82d-f139b5037788 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:35:58.841914 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-c9447b05-c075-42ee-b82d-f139b5037788 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:35:59.399531 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-c9447b05-c075-42ee-b82d-f139b5037788 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:35:59.415967 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-c9447b05-c075-42ee-b82d-f139b5037788 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:35:59.417720 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-c9447b05-c075-42ee-b82d-f139b5037788 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:35:59.419107 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-c9447b05-c075-42ee-b82d-f139b5037788 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] 10.222.0.15 "GET /compute/v2.1/servers/852e8870-b3ec-4a21-a9b5-e31a423ddd3d" status: 200 len: 1740 microversion: 2.20 time: 0.604397 Oct 31 12:35:59.420178 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 245/477] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Oct 31 12:35:58 2022] GET /compute/v2.1/servers/852e8870-b3ec-4a21-a9b5-e31a423ddd3d => generated 1740 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 12:36:00.253658 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-b1e6a17f-3bd5-4513-ab84-9682fec031b6 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Action: 'create', calling method: .version_select at 0x7f2aa50eb310>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-899997443", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFScjjguyZMyJ4NssDM/S8LkMwo7MAHC2Am63rHyQGS9/P3YOxI9T+/Edxd3KCapdwT9Ce4KYxbC+e8QDJ/AjdhciuroTNfbN1HboJEXzgUn3TeJPFB4Mh/3JlBd2ATLOg=="}} {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 12:36:00.271522 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.quota [None req-b1e6a17f-3bd5-4513-ab84-9682fec031b6 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Getting quotas for project 8ae8c589d0b84ce096451a10717fc601. Resources: {'key_pairs'} {{(pid=125441) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 12:36:00.282608 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.quota [None req-b1e6a17f-3bd5-4513-ab84-9682fec031b6 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Getting quotas for user 49b76d81ee9446cf9014a2e695ef03e7 and project 8ae8c589d0b84ce096451a10717fc601. Resources: {'key_pairs'} {{(pid=125441) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 12:36:00.317250 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-b1e6a17f-3bd5-4513-ab84-9682fec031b6 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.287880 Oct 31 12:36:00.318229 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 233/478] 10.222.0.15 () {60 vars in 1159 bytes} [Mon Oct 31 12:36:00 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 12:36:00.449195 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-29f4ab37-3167-4881-bdf5-af677d123a51 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:36:00.449800 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-29f4ab37-3167-4881-bdf5-af677d123a51 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] [instance: 852e8870-b3ec-4a21-a9b5-e31a423ddd3d] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:36:00.456630 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-29f4ab37-3167-4881-bdf5-af677d123a51 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:36:00.463726 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-29f4ab37-3167-4881-bdf5-af677d123a51 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:36:00.464467 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-29f4ab37-3167-4881-bdf5-af677d123a51 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:36:00.466688 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-29f4ab37-3167-4881-bdf5-af677d123a51 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:36:00.467367 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-29f4ab37-3167-4881-bdf5-af677d123a51 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:36:00.473904 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-29f4ab37-3167-4881-bdf5-af677d123a51 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:36:00.653798 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-29f4ab37-3167-4881-bdf5-af677d123a51 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:36:00.666492 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-29f4ab37-3167-4881-bdf5-af677d123a51 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:36:00.668076 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-29f4ab37-3167-4881-bdf5-af677d123a51 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:36:00.672487 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-29f4ab37-3167-4881-bdf5-af677d123a51 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] 10.222.0.15 "GET /compute/v2.1/servers/852e8870-b3ec-4a21-a9b5-e31a423ddd3d" status: 200 len: 1740 microversion: 2.20 time: 0.226215 Oct 31 12:36:00.675862 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 246/479] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Oct 31 12:36:00 2022] GET /compute/v2.1/servers/852e8870-b3ec-4a21-a9b5-e31a423ddd3d => generated 1740 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 12:36:01.697803 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-024812e4-ddba-46dd-b881-d22f92f08b6b tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:36:01.699208 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-024812e4-ddba-46dd-b881-d22f92f08b6b tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] [instance: 852e8870-b3ec-4a21-a9b5-e31a423ddd3d] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:36:01.708233 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-024812e4-ddba-46dd-b881-d22f92f08b6b tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:36:01.708910 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-024812e4-ddba-46dd-b881-d22f92f08b6b tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:36:01.709352 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-024812e4-ddba-46dd-b881-d22f92f08b6b tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:36:01.710051 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-024812e4-ddba-46dd-b881-d22f92f08b6b tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:36:01.710510 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-024812e4-ddba-46dd-b881-d22f92f08b6b tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:36:01.710923 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-024812e4-ddba-46dd-b881-d22f92f08b6b tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:36:01.926253 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-024812e4-ddba-46dd-b881-d22f92f08b6b tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:36:01.939117 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-024812e4-ddba-46dd-b881-d22f92f08b6b tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:36:01.940607 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-024812e4-ddba-46dd-b881-d22f92f08b6b tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:36:01.944351 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-024812e4-ddba-46dd-b881-d22f92f08b6b tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] 10.222.0.15 "GET /compute/v2.1/servers/852e8870-b3ec-4a21-a9b5-e31a423ddd3d" status: 200 len: 1740 microversion: 2.20 time: 0.250407 Oct 31 12:36:01.957474 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 234/480] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Oct 31 12:36:01 2022] GET /compute/v2.1/servers/852e8870-b3ec-4a21-a9b5-e31a423ddd3d => generated 1740 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 12:36:02.971822 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-f9f53839-777d-4d53-9e2a-45d4b60d051f tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:36:02.973175 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-f9f53839-777d-4d53-9e2a-45d4b60d051f tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] [instance: 852e8870-b3ec-4a21-a9b5-e31a423ddd3d] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:36:02.984473 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-f9f53839-777d-4d53-9e2a-45d4b60d051f tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:36:02.985695 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-f9f53839-777d-4d53-9e2a-45d4b60d051f tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:36:02.986550 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-f9f53839-777d-4d53-9e2a-45d4b60d051f tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:36:02.987518 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-f9f53839-777d-4d53-9e2a-45d4b60d051f tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:36:02.988124 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-f9f53839-777d-4d53-9e2a-45d4b60d051f tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:36:02.988691 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-f9f53839-777d-4d53-9e2a-45d4b60d051f tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:36:03.225846 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-f9f53839-777d-4d53-9e2a-45d4b60d051f tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:36:03.241836 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-f9f53839-777d-4d53-9e2a-45d4b60d051f tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:36:03.243695 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-f9f53839-777d-4d53-9e2a-45d4b60d051f tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:36:03.245206 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-f9f53839-777d-4d53-9e2a-45d4b60d051f tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] 10.222.0.15 "GET /compute/v2.1/servers/852e8870-b3ec-4a21-a9b5-e31a423ddd3d" status: 200 len: 1740 microversion: 2.20 time: 0.278896 Oct 31 12:36:03.246313 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 247/481] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Oct 31 12:36:02 2022] GET /compute/v2.1/servers/852e8870-b3ec-4a21-a9b5-e31a423ddd3d => generated 1740 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 12:36:04.282964 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-4e976fd3-8c47-43b2-88e9-cd7902c4b308 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:36:04.283596 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-4e976fd3-8c47-43b2-88e9-cd7902c4b308 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] [instance: 852e8870-b3ec-4a21-a9b5-e31a423ddd3d] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:36:04.290230 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-4e976fd3-8c47-43b2-88e9-cd7902c4b308 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:36:04.290892 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-4e976fd3-8c47-43b2-88e9-cd7902c4b308 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:36:04.291412 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-4e976fd3-8c47-43b2-88e9-cd7902c4b308 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:36:04.292345 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-4e976fd3-8c47-43b2-88e9-cd7902c4b308 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:36:04.292963 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-4e976fd3-8c47-43b2-88e9-cd7902c4b308 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:36:04.293565 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-4e976fd3-8c47-43b2-88e9-cd7902c4b308 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:36:04.456761 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-4e976fd3-8c47-43b2-88e9-cd7902c4b308 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:36:04.467675 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-4e976fd3-8c47-43b2-88e9-cd7902c4b308 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:36:04.469983 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-4e976fd3-8c47-43b2-88e9-cd7902c4b308 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:36:04.471190 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-4e976fd3-8c47-43b2-88e9-cd7902c4b308 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] 10.222.0.15 "GET /compute/v2.1/servers/852e8870-b3ec-4a21-a9b5-e31a423ddd3d" status: 200 len: 1722 microversion: 2.20 time: 0.193192 Oct 31 12:36:04.471818 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 235/482] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Oct 31 12:36:04 2022] GET /compute/v2.1/servers/852e8870-b3ec-4a21-a9b5-e31a423ddd3d => generated 1722 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 12:36:05.497841 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-875e7fd1-87ef-4fc3-8fba-69c560ce94c9 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:36:05.498452 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-875e7fd1-87ef-4fc3-8fba-69c560ce94c9 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] [instance: 852e8870-b3ec-4a21-a9b5-e31a423ddd3d] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:36:05.505674 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-875e7fd1-87ef-4fc3-8fba-69c560ce94c9 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:36:05.506156 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-875e7fd1-87ef-4fc3-8fba-69c560ce94c9 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:36:05.506585 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-875e7fd1-87ef-4fc3-8fba-69c560ce94c9 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:36:05.507300 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-875e7fd1-87ef-4fc3-8fba-69c560ce94c9 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:36:05.507771 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-875e7fd1-87ef-4fc3-8fba-69c560ce94c9 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:36:05.508189 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-875e7fd1-87ef-4fc3-8fba-69c560ce94c9 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:36:05.650227 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-875e7fd1-87ef-4fc3-8fba-69c560ce94c9 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:36:05.661495 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-875e7fd1-87ef-4fc3-8fba-69c560ce94c9 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:36:05.663088 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-875e7fd1-87ef-4fc3-8fba-69c560ce94c9 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:36:05.664282 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-875e7fd1-87ef-4fc3-8fba-69c560ce94c9 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] 10.222.0.15 "GET /compute/v2.1/servers/852e8870-b3ec-4a21-a9b5-e31a423ddd3d" status: 200 len: 1722 microversion: 2.20 time: 0.170365 Oct 31 12:36:05.664867 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 248/483] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Oct 31 12:36:05 2022] GET /compute/v2.1/servers/852e8870-b3ec-4a21-a9b5-e31a423ddd3d => generated 1722 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 12:36:06.690450 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-1a6fe134-4fe6-460a-8e90-1fe9fcda91bb tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:36:06.691283 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-1a6fe134-4fe6-460a-8e90-1fe9fcda91bb tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] [instance: 852e8870-b3ec-4a21-a9b5-e31a423ddd3d] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:36:06.698403 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-1a6fe134-4fe6-460a-8e90-1fe9fcda91bb tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:36:06.698880 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-1a6fe134-4fe6-460a-8e90-1fe9fcda91bb tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:36:06.699344 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-1a6fe134-4fe6-460a-8e90-1fe9fcda91bb tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:36:06.700030 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-1a6fe134-4fe6-460a-8e90-1fe9fcda91bb tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:36:06.700481 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-1a6fe134-4fe6-460a-8e90-1fe9fcda91bb tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:36:06.700893 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-1a6fe134-4fe6-460a-8e90-1fe9fcda91bb tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:36:06.833686 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-1a6fe134-4fe6-460a-8e90-1fe9fcda91bb tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:36:06.841612 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-1a6fe134-4fe6-460a-8e90-1fe9fcda91bb tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:36:06.843047 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-1a6fe134-4fe6-460a-8e90-1fe9fcda91bb tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:36:06.844921 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-1a6fe134-4fe6-460a-8e90-1fe9fcda91bb tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] 10.222.0.15 "GET /compute/v2.1/servers/852e8870-b3ec-4a21-a9b5-e31a423ddd3d" status: 200 len: 1722 microversion: 2.20 time: 0.158209 Oct 31 12:36:06.845506 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 236/484] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Oct 31 12:36:06 2022] GET /compute/v2.1/servers/852e8870-b3ec-4a21-a9b5-e31a423ddd3d => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 12:36:07.401150 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [req-4a3489eb-6ce4-4ac2-a210-5ad2b50ef152 req-2165996d-d7f1-40ab-8374-067423450787 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "852e8870-b3ec-4a21-a9b5-e31a423ddd3d", "name": "network-vif-unplugged", "status": "completed", "tag": "dffec82d-007b-4838-9898-19da61885395"}]} {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 12:36:07.416322 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [req-4a3489eb-6ce4-4ac2-a210-5ad2b50ef152 req-2165996d-d7f1-40ab-8374-067423450787 service nova] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:36:07.416789 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [req-4a3489eb-6ce4-4ac2-a210-5ad2b50ef152 req-2165996d-d7f1-40ab-8374-067423450787 service nova] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:36:07.417404 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [req-4a3489eb-6ce4-4ac2-a210-5ad2b50ef152 req-2165996d-d7f1-40ab-8374-067423450787 service nova] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:36:07.430483 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.compute.server_external_events [req-4a3489eb-6ce4-4ac2-a210-5ad2b50ef152 req-2165996d-d7f1-40ab-8374-067423450787 service nova] Creating event network-vif-unplugged:dffec82d-007b-4838-9898-19da61885395 for instance 852e8870-b3ec-4a21-a9b5-e31a423ddd3d on hv-cinder-79617 Oct 31 12:36:07.436064 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [req-4a3489eb-6ce4-4ac2-a210-5ad2b50ef152 req-2165996d-d7f1-40ab-8374-067423450787 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.040517 Oct 31 12:36:07.437139 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 249/485] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Oct 31 12:36:07 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 12:36:07.870062 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-7ede5563-52bb-4158-b188-8a54f7b604b6 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:36:07.870728 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-7ede5563-52bb-4158-b188-8a54f7b604b6 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] [instance: 852e8870-b3ec-4a21-a9b5-e31a423ddd3d] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:36:07.878433 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-7ede5563-52bb-4158-b188-8a54f7b604b6 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:36:07.879464 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-7ede5563-52bb-4158-b188-8a54f7b604b6 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:36:07.880247 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-7ede5563-52bb-4158-b188-8a54f7b604b6 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:36:07.881353 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-7ede5563-52bb-4158-b188-8a54f7b604b6 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:36:07.881821 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-7ede5563-52bb-4158-b188-8a54f7b604b6 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:36:07.882332 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-7ede5563-52bb-4158-b188-8a54f7b604b6 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:36:08.023978 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-7ede5563-52bb-4158-b188-8a54f7b604b6 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:36:08.026261 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG dbcounter [-] [125441] Writing DB stats nova_cell1:SELECT=100 {{(pid=125441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:36:08.036268 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-7ede5563-52bb-4158-b188-8a54f7b604b6 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:36:08.037716 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-7ede5563-52bb-4158-b188-8a54f7b604b6 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:36:08.038862 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-7ede5563-52bb-4158-b188-8a54f7b604b6 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] 10.222.0.15 "GET /compute/v2.1/servers/852e8870-b3ec-4a21-a9b5-e31a423ddd3d" status: 200 len: 1665 microversion: 2.20 time: 0.172897 Oct 31 12:36:08.039645 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 237/486] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Oct 31 12:36:07 2022] GET /compute/v2.1/servers/852e8870-b3ec-4a21-a9b5-e31a423ddd3d => generated 1665 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 12:36:08.065407 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-0bc450ae-a371-48e4-9f54-9d4715bcabf9 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "aa1967e3-6d8f-4832-b20b-ed03ce790419"}} {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 12:36:08.067903 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-0bc450ae-a371-48e4-9f54-9d4715bcabf9 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] [instance: 852e8870-b3ec-4a21-a9b5-e31a423ddd3d] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:36:08.074045 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-0bc450ae-a371-48e4-9f54-9d4715bcabf9 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:36:08.074528 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-0bc450ae-a371-48e4-9f54-9d4715bcabf9 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:36:08.074962 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-0bc450ae-a371-48e4-9f54-9d4715bcabf9 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:36:08.075681 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-0bc450ae-a371-48e4-9f54-9d4715bcabf9 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:36:08.076137 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-0bc450ae-a371-48e4-9f54-9d4715bcabf9 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:36:08.076561 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-0bc450ae-a371-48e4-9f54-9d4715bcabf9 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:36:08.364014 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-0bc450ae-a371-48e4-9f54-9d4715bcabf9 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] 10.222.0.15 "POST /compute/v2.1/servers/852e8870-b3ec-4a21-a9b5-e31a423ddd3d/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.303655 Oct 31 12:36:08.364617 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 250/487] 10.222.0.15 () {62 vars in 1364 bytes} [Mon Oct 31 12:36:08 2022] POST /compute/v2.1/servers/852e8870-b3ec-4a21-a9b5-e31a423ddd3d/os-volume_attachments => generated 188 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 12:36:08.493772 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-b1c62690-2be3-4d5f-a4b4-b6ba0ef3e1fc tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 12:36:08.494354 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-b1c62690-2be3-4d5f-a4b4-b6ba0ef3e1fc tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] [instance: 852e8870-b3ec-4a21-a9b5-e31a423ddd3d] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:36:08.501616 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-b1c62690-2be3-4d5f-a4b4-b6ba0ef3e1fc tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:36:08.502178 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-b1c62690-2be3-4d5f-a4b4-b6ba0ef3e1fc tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:36:08.502614 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-b1c62690-2be3-4d5f-a4b4-b6ba0ef3e1fc tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:36:08.503414 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-b1c62690-2be3-4d5f-a4b4-b6ba0ef3e1fc tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:36:08.503982 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-b1c62690-2be3-4d5f-a4b4-b6ba0ef3e1fc tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:36:08.504411 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-b1c62690-2be3-4d5f-a4b4-b6ba0ef3e1fc tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:36:08.547776 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-b1c62690-2be3-4d5f-a4b4-b6ba0ef3e1fc tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] [instance: 852e8870-b3ec-4a21-a9b5-e31a423ddd3d] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=125441) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 31 12:36:08.620196 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-b1c62690-2be3-4d5f-a4b4-b6ba0ef3e1fc tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] 10.222.0.15 "POST /compute/v2.1/servers/852e8870-b3ec-4a21-a9b5-e31a423ddd3d/action" status: 202 len: 0 microversion: 2.20 time: 0.130275 Oct 31 12:36:08.621195 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 238/488] 10.222.0.15 () {62 vars in 1319 bytes} [Mon Oct 31 12:36:08 2022] POST /compute/v2.1/servers/852e8870-b3ec-4a21-a9b5-e31a423ddd3d/action => generated 0 bytes in 132 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 31 12:36:08.631052 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-e9ef9550-3f05-456b-9416-2dd47d355097 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:36:08.634164 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-e9ef9550-3f05-456b-9416-2dd47d355097 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] [instance: 852e8870-b3ec-4a21-a9b5-e31a423ddd3d] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:36:08.649128 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-e9ef9550-3f05-456b-9416-2dd47d355097 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:36:08.649568 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-e9ef9550-3f05-456b-9416-2dd47d355097 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:36:08.650144 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-e9ef9550-3f05-456b-9416-2dd47d355097 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:36:08.651060 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-e9ef9550-3f05-456b-9416-2dd47d355097 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:36:08.651611 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-e9ef9550-3f05-456b-9416-2dd47d355097 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:36:08.652113 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-e9ef9550-3f05-456b-9416-2dd47d355097 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:36:08.790857 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-e9ef9550-3f05-456b-9416-2dd47d355097 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:36:08.802973 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-e9ef9550-3f05-456b-9416-2dd47d355097 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:36:08.804442 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-e9ef9550-3f05-456b-9416-2dd47d355097 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:36:08.805592 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-e9ef9550-3f05-456b-9416-2dd47d355097 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] 10.222.0.15 "GET /compute/v2.1/servers/852e8870-b3ec-4a21-a9b5-e31a423ddd3d" status: 200 len: 1751 microversion: 2.20 time: 0.180293 Oct 31 12:36:08.806149 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 251/489] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Oct 31 12:36:08 2022] GET /compute/v2.1/servers/852e8870-b3ec-4a21-a9b5-e31a423ddd3d => generated 1751 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 12:36:09.832432 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-49375eef-d2b8-4167-befc-40a12ff922a1 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:36:09.833034 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-49375eef-d2b8-4167-befc-40a12ff922a1 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] [instance: 852e8870-b3ec-4a21-a9b5-e31a423ddd3d] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:36:09.838836 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-49375eef-d2b8-4167-befc-40a12ff922a1 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:36:09.839341 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-49375eef-d2b8-4167-befc-40a12ff922a1 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:36:09.839765 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-49375eef-d2b8-4167-befc-40a12ff922a1 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:36:09.840439 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-49375eef-d2b8-4167-befc-40a12ff922a1 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:36:09.840882 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-49375eef-d2b8-4167-befc-40a12ff922a1 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:36:09.841296 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-49375eef-d2b8-4167-befc-40a12ff922a1 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:36:09.976911 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-49375eef-d2b8-4167-befc-40a12ff922a1 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:36:09.985548 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-49375eef-d2b8-4167-befc-40a12ff922a1 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:36:09.986970 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-49375eef-d2b8-4167-befc-40a12ff922a1 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:36:09.988140 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-49375eef-d2b8-4167-befc-40a12ff922a1 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] 10.222.0.15 "GET /compute/v2.1/servers/852e8870-b3ec-4a21-a9b5-e31a423ddd3d" status: 200 len: 1753 microversion: 2.20 time: 0.160325 Oct 31 12:36:09.988693 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 239/490] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Oct 31 12:36:09 2022] GET /compute/v2.1/servers/852e8870-b3ec-4a21-a9b5-e31a423ddd3d => generated 1753 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 12:36:11.012901 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-1fd7a192-3e5f-4761-ab26-86be5b3cfcf4 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:36:11.013522 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-1fd7a192-3e5f-4761-ab26-86be5b3cfcf4 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] [instance: 852e8870-b3ec-4a21-a9b5-e31a423ddd3d] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:36:11.020329 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-1fd7a192-3e5f-4761-ab26-86be5b3cfcf4 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:36:11.020839 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-1fd7a192-3e5f-4761-ab26-86be5b3cfcf4 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:36:11.021268 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-1fd7a192-3e5f-4761-ab26-86be5b3cfcf4 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:36:11.021946 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-1fd7a192-3e5f-4761-ab26-86be5b3cfcf4 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:36:11.022390 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-1fd7a192-3e5f-4761-ab26-86be5b3cfcf4 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:36:11.022801 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-1fd7a192-3e5f-4761-ab26-86be5b3cfcf4 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:36:11.218153 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-1fd7a192-3e5f-4761-ab26-86be5b3cfcf4 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:36:11.227454 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-1fd7a192-3e5f-4761-ab26-86be5b3cfcf4 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:36:11.228897 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-1fd7a192-3e5f-4761-ab26-86be5b3cfcf4 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:36:11.230050 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-1fd7a192-3e5f-4761-ab26-86be5b3cfcf4 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] 10.222.0.15 "GET /compute/v2.1/servers/852e8870-b3ec-4a21-a9b5-e31a423ddd3d" status: 200 len: 1809 microversion: 2.20 time: 0.221111 Oct 31 12:36:11.230613 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 252/491] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Oct 31 12:36:11 2022] GET /compute/v2.1/servers/852e8870-b3ec-4a21-a9b5-e31a423ddd3d => generated 1809 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 12:36:12.256582 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-a0a1e5b9-5696-4811-8164-ecd412fd980c tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:36:12.257193 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-a0a1e5b9-5696-4811-8164-ecd412fd980c tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] [instance: 852e8870-b3ec-4a21-a9b5-e31a423ddd3d] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:36:12.259100 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG dbcounter [-] [125441] Writing DB stats nova_cell0:SELECT=4 {{(pid=125441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:36:12.260257 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG dbcounter [-] [125441] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=125441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:36:12.265763 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-a0a1e5b9-5696-4811-8164-ecd412fd980c tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:36:12.266267 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-a0a1e5b9-5696-4811-8164-ecd412fd980c tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:36:12.267173 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-a0a1e5b9-5696-4811-8164-ecd412fd980c tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:36:12.268116 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-a0a1e5b9-5696-4811-8164-ecd412fd980c tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:36:12.268467 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-a0a1e5b9-5696-4811-8164-ecd412fd980c tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:36:12.268959 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-a0a1e5b9-5696-4811-8164-ecd412fd980c tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:36:12.407746 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-a0a1e5b9-5696-4811-8164-ecd412fd980c tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:36:12.418605 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-a0a1e5b9-5696-4811-8164-ecd412fd980c tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:36:12.420876 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-a0a1e5b9-5696-4811-8164-ecd412fd980c tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:36:12.422531 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-a0a1e5b9-5696-4811-8164-ecd412fd980c tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] 10.222.0.15 "GET /compute/v2.1/servers/852e8870-b3ec-4a21-a9b5-e31a423ddd3d" status: 200 len: 1809 microversion: 2.20 time: 0.169941 Oct 31 12:36:12.423792 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 240/492] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Oct 31 12:36:12 2022] GET /compute/v2.1/servers/852e8870-b3ec-4a21-a9b5-e31a423ddd3d => generated 1809 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 12:36:13.452302 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-86952f90-5b67-4099-a7f2-ea8f4116014e tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:36:13.453058 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-86952f90-5b67-4099-a7f2-ea8f4116014e tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] [instance: 852e8870-b3ec-4a21-a9b5-e31a423ddd3d] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:36:13.460214 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-86952f90-5b67-4099-a7f2-ea8f4116014e tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:36:13.460950 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-86952f90-5b67-4099-a7f2-ea8f4116014e tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:36:13.461388 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-86952f90-5b67-4099-a7f2-ea8f4116014e tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:36:13.462095 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-86952f90-5b67-4099-a7f2-ea8f4116014e tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:36:13.462549 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-86952f90-5b67-4099-a7f2-ea8f4116014e tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:36:13.462968 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-86952f90-5b67-4099-a7f2-ea8f4116014e tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:36:13.467333 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG dbcounter [-] [125440] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=125440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:36:13.607094 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-86952f90-5b67-4099-a7f2-ea8f4116014e tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:36:13.616472 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-86952f90-5b67-4099-a7f2-ea8f4116014e tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:36:13.618072 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-86952f90-5b67-4099-a7f2-ea8f4116014e tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:36:13.619585 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-86952f90-5b67-4099-a7f2-ea8f4116014e tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] 10.222.0.15 "GET /compute/v2.1/servers/852e8870-b3ec-4a21-a9b5-e31a423ddd3d" status: 200 len: 1809 microversion: 2.20 time: 0.171178 Oct 31 12:36:13.626736 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 253/493] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Oct 31 12:36:13 2022] GET /compute/v2.1/servers/852e8870-b3ec-4a21-a9b5-e31a423ddd3d => generated 1809 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 12:36:14.646247 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-535030a8-5deb-4c28-af9f-f14cb2db70e8 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:36:14.646847 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-535030a8-5deb-4c28-af9f-f14cb2db70e8 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] [instance: 852e8870-b3ec-4a21-a9b5-e31a423ddd3d] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:36:14.653584 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-535030a8-5deb-4c28-af9f-f14cb2db70e8 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:36:14.654062 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-535030a8-5deb-4c28-af9f-f14cb2db70e8 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:36:14.654576 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-535030a8-5deb-4c28-af9f-f14cb2db70e8 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:36:14.655541 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-535030a8-5deb-4c28-af9f-f14cb2db70e8 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:36:14.656081 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-535030a8-5deb-4c28-af9f-f14cb2db70e8 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:36:14.656495 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-535030a8-5deb-4c28-af9f-f14cb2db70e8 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:36:14.797357 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-535030a8-5deb-4c28-af9f-f14cb2db70e8 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:36:14.807199 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-535030a8-5deb-4c28-af9f-f14cb2db70e8 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:36:14.808680 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-535030a8-5deb-4c28-af9f-f14cb2db70e8 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:36:14.809844 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-535030a8-5deb-4c28-af9f-f14cb2db70e8 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] 10.222.0.15 "GET /compute/v2.1/servers/852e8870-b3ec-4a21-a9b5-e31a423ddd3d" status: 200 len: 1809 microversion: 2.20 time: 0.167881 Oct 31 12:36:14.810505 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 241/494] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Oct 31 12:36:14 2022] GET /compute/v2.1/servers/852e8870-b3ec-4a21-a9b5-e31a423ddd3d => generated 1809 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 12:36:15.836260 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-c5c25366-307c-43e5-b248-44e6c8e0719e tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:36:15.836932 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-c5c25366-307c-43e5-b248-44e6c8e0719e tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] [instance: 852e8870-b3ec-4a21-a9b5-e31a423ddd3d] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:36:15.843398 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-c5c25366-307c-43e5-b248-44e6c8e0719e tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:36:15.844197 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-c5c25366-307c-43e5-b248-44e6c8e0719e tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:36:15.845300 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-c5c25366-307c-43e5-b248-44e6c8e0719e tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:36:15.846348 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-c5c25366-307c-43e5-b248-44e6c8e0719e tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:36:15.846862 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-c5c25366-307c-43e5-b248-44e6c8e0719e tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:36:15.847478 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-c5c25366-307c-43e5-b248-44e6c8e0719e tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:36:15.984266 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-c5c25366-307c-43e5-b248-44e6c8e0719e tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:36:15.994352 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-c5c25366-307c-43e5-b248-44e6c8e0719e tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:36:15.995883 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-c5c25366-307c-43e5-b248-44e6c8e0719e tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:36:15.997170 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-c5c25366-307c-43e5-b248-44e6c8e0719e tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] 10.222.0.15 "GET /compute/v2.1/servers/852e8870-b3ec-4a21-a9b5-e31a423ddd3d" status: 200 len: 1809 microversion: 2.20 time: 0.164832 Oct 31 12:36:15.998063 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 254/495] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Oct 31 12:36:15 2022] GET /compute/v2.1/servers/852e8870-b3ec-4a21-a9b5-e31a423ddd3d => generated 1809 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 12:36:17.024535 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-62205293-b49c-44a1-93aa-966c122780f3 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:36:17.025177 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-62205293-b49c-44a1-93aa-966c122780f3 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] [instance: 852e8870-b3ec-4a21-a9b5-e31a423ddd3d] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:36:17.033770 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-62205293-b49c-44a1-93aa-966c122780f3 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:36:17.034273 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-62205293-b49c-44a1-93aa-966c122780f3 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:36:17.034731 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-62205293-b49c-44a1-93aa-966c122780f3 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:36:17.035468 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-62205293-b49c-44a1-93aa-966c122780f3 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:36:17.035925 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-62205293-b49c-44a1-93aa-966c122780f3 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:36:17.036350 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-62205293-b49c-44a1-93aa-966c122780f3 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:36:17.189318 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-62205293-b49c-44a1-93aa-966c122780f3 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:36:17.198034 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-62205293-b49c-44a1-93aa-966c122780f3 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:36:17.199494 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-62205293-b49c-44a1-93aa-966c122780f3 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:36:17.200650 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-62205293-b49c-44a1-93aa-966c122780f3 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] 10.222.0.15 "GET /compute/v2.1/servers/852e8870-b3ec-4a21-a9b5-e31a423ddd3d" status: 200 len: 1809 microversion: 2.20 time: 0.180792 Oct 31 12:36:17.209471 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 242/496] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Oct 31 12:36:17 2022] GET /compute/v2.1/servers/852e8870-b3ec-4a21-a9b5-e31a423ddd3d => generated 1809 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 12:36:18.228771 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-218c8809-50ed-4082-873d-5e11cbae3f04 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:36:18.229361 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-218c8809-50ed-4082-873d-5e11cbae3f04 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] [instance: 852e8870-b3ec-4a21-a9b5-e31a423ddd3d] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:36:18.231732 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG dbcounter [-] [125440] Writing DB stats nova_api:SELECT=44 {{(pid=125440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:36:18.237404 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-218c8809-50ed-4082-873d-5e11cbae3f04 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:36:18.237947 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-218c8809-50ed-4082-873d-5e11cbae3f04 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:36:18.238381 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-218c8809-50ed-4082-873d-5e11cbae3f04 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:36:18.239080 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-218c8809-50ed-4082-873d-5e11cbae3f04 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:36:18.239551 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-218c8809-50ed-4082-873d-5e11cbae3f04 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:36:18.239964 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-218c8809-50ed-4082-873d-5e11cbae3f04 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:36:18.376679 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-218c8809-50ed-4082-873d-5e11cbae3f04 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:36:18.385410 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-218c8809-50ed-4082-873d-5e11cbae3f04 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:36:18.386832 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-218c8809-50ed-4082-873d-5e11cbae3f04 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:36:18.387998 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-218c8809-50ed-4082-873d-5e11cbae3f04 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] 10.222.0.15 "GET /compute/v2.1/servers/852e8870-b3ec-4a21-a9b5-e31a423ddd3d" status: 200 len: 1809 microversion: 2.20 time: 0.163154 Oct 31 12:36:18.388551 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 255/497] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Oct 31 12:36:18 2022] GET /compute/v2.1/servers/852e8870-b3ec-4a21-a9b5-e31a423ddd3d => generated 1809 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 12:36:19.414399 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-91ff0975-42b1-4d93-ab55-24ec91698cb5 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:36:19.415023 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-91ff0975-42b1-4d93-ab55-24ec91698cb5 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] [instance: 852e8870-b3ec-4a21-a9b5-e31a423ddd3d] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:36:19.421638 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-91ff0975-42b1-4d93-ab55-24ec91698cb5 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:36:19.422126 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-91ff0975-42b1-4d93-ab55-24ec91698cb5 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:36:19.422622 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-91ff0975-42b1-4d93-ab55-24ec91698cb5 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:36:19.423410 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-91ff0975-42b1-4d93-ab55-24ec91698cb5 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:36:19.423846 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-91ff0975-42b1-4d93-ab55-24ec91698cb5 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:36:19.424270 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-91ff0975-42b1-4d93-ab55-24ec91698cb5 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:36:19.567092 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-91ff0975-42b1-4d93-ab55-24ec91698cb5 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:36:19.576436 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-91ff0975-42b1-4d93-ab55-24ec91698cb5 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:36:19.577884 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-91ff0975-42b1-4d93-ab55-24ec91698cb5 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:36:19.579892 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-91ff0975-42b1-4d93-ab55-24ec91698cb5 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] 10.222.0.15 "GET /compute/v2.1/servers/852e8870-b3ec-4a21-a9b5-e31a423ddd3d" status: 200 len: 1809 microversion: 2.20 time: 0.169556 Oct 31 12:36:19.582748 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 243/498] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Oct 31 12:36:19 2022] GET /compute/v2.1/servers/852e8870-b3ec-4a21-a9b5-e31a423ddd3d => generated 1809 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 12:36:20.450924 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-ca691fbb-8606-4ded-81f6-a29b8591c077 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1516788606", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-899997443", "security_groups": [{"name": "tempest-secgroup-smoke-1289635870"}], "block_device_mapping_v2": [{"uuid": "c167739f-31b8-4d1c-beb2-639f5c4d7a0f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "77732bf9-8ee2-480e-8cb2-0d5455add01d"}]}} {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 12:36:20.575059 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.network.neutron [None req-ca691fbb-8606-4ded-81f6-a29b8591c077 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] validate_networks() for [('77732bf9-8ee2-480e-8cb2-0d5455add01d', None, None, None, None, None)] {{(pid=125440) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 12:36:20.606717 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-d5669b04-5fba-427d-b6fa-df4a26c1a2c8 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:36:20.608246 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-d5669b04-5fba-427d-b6fa-df4a26c1a2c8 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] [instance: 852e8870-b3ec-4a21-a9b5-e31a423ddd3d] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:36:20.614909 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-d5669b04-5fba-427d-b6fa-df4a26c1a2c8 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:36:20.615638 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-d5669b04-5fba-427d-b6fa-df4a26c1a2c8 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:36:20.616301 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-d5669b04-5fba-427d-b6fa-df4a26c1a2c8 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:36:20.617060 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-d5669b04-5fba-427d-b6fa-df4a26c1a2c8 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:36:20.617577 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-d5669b04-5fba-427d-b6fa-df4a26c1a2c8 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:36:20.618061 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-d5669b04-5fba-427d-b6fa-df4a26c1a2c8 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:36:20.757735 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-d5669b04-5fba-427d-b6fa-df4a26c1a2c8 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:36:20.767553 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-d5669b04-5fba-427d-b6fa-df4a26c1a2c8 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:36:20.769896 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-d5669b04-5fba-427d-b6fa-df4a26c1a2c8 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:36:20.771620 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-d5669b04-5fba-427d-b6fa-df4a26c1a2c8 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] 10.222.0.15 "GET /compute/v2.1/servers/852e8870-b3ec-4a21-a9b5-e31a423ddd3d" status: 200 len: 1809 microversion: 2.20 time: 0.168871 Oct 31 12:36:20.783687 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 244/499] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Oct 31 12:36:20 2022] GET /compute/v2.1/servers/852e8870-b3ec-4a21-a9b5-e31a423ddd3d => generated 1809 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 12:36:20.987233 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.virt.hardware [None req-ca691fbb-8606-4ded-81f6-a29b8591c077 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Flavor limits 0:0:0 {{(pid=125440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 12:36:20.987651 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.virt.hardware [None req-ca691fbb-8606-4ded-81f6-a29b8591c077 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Image limits 0:0:0 {{(pid=125440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 12:36:20.988112 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.virt.hardware [None req-ca691fbb-8606-4ded-81f6-a29b8591c077 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Flavor pref 0:0:0 {{(pid=125440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 12:36:20.988512 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.virt.hardware [None req-ca691fbb-8606-4ded-81f6-a29b8591c077 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Image pref 0:0:0 {{(pid=125440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 12:36:20.988944 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.virt.hardware [None req-ca691fbb-8606-4ded-81f6-a29b8591c077 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 12:36:20.997948 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-ca691fbb-8606-4ded-81f6-a29b8591c077 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:36:20.998419 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-ca691fbb-8606-4ded-81f6-a29b8591c077 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:36:20.999026 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-ca691fbb-8606-4ded-81f6-a29b8591c077 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:36:20.999776 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-ca691fbb-8606-4ded-81f6-a29b8591c077 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:36:21.000224 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-ca691fbb-8606-4ded-81f6-a29b8591c077 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:36:21.000680 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-ca691fbb-8606-4ded-81f6-a29b8591c077 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:36:21.018561 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.quota [None req-ca691fbb-8606-4ded-81f6-a29b8591c077 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Getting quotas for project 8ae8c589d0b84ce096451a10717fc601. Resources: {'instances', 'cores', 'ram'} {{(pid=125440) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 12:36:21.022978 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.quota [None req-ca691fbb-8606-4ded-81f6-a29b8591c077 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Getting quotas for user 49b76d81ee9446cf9014a2e695ef03e7 and project 8ae8c589d0b84ce096451a10717fc601. Resources: {'instances', 'cores', 'ram'} {{(pid=125440) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 12:36:21.085764 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-ca691fbb-8606-4ded-81f6-a29b8591c077 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Going to run 1 instances... {{(pid=125440) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 12:36:21.087960 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-ca691fbb-8606-4ded-81f6-a29b8591c077 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] [instance: d7643c7c-0218-427f-876a-cf89c932dd11] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c167739f-31b8-4d1c-beb2-639f5c4d7a0f',volume_size=None,volume_type=None)] {{(pid=125440) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 12:36:21.232207 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-ca691fbb-8606-4ded-81f6-a29b8591c077 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.785044 Oct 31 12:36:21.233026 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 256/500] 10.222.0.15 () {60 vars in 1147 bytes} [Mon Oct 31 12:36:20 2022] POST /compute/v2.1/servers => generated 406 bytes in 786 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 31 12:36:21.243982 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-79d2ad1e-ae4e-4366-bbad-0a3a99660f56 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:36:21.244592 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-79d2ad1e-ae4e-4366-bbad-0a3a99660f56 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] [instance: d7643c7c-0218-427f-876a-cf89c932dd11] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:36:21.305678 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-79d2ad1e-ae4e-4366-bbad-0a3a99660f56 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b76d81ee9446cf9014a2e695ef03e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae8c589d0b84ce096451a10717fc601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:36:21.312971 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-79d2ad1e-ae4e-4366-bbad-0a3a99660f56 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] 10.222.0.15 "GET /compute/v2.1/servers/d7643c7c-0218-427f-876a-cf89c932dd11" status: 200 len: 1094 microversion: 2.1 time: 0.072614 Oct 31 12:36:21.330791 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 245/501] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:36:21 2022] GET /compute/v2.1/servers/d7643c7c-0218-427f-876a-cf89c932dd11 => generated 1094 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:36:21.489580 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-24b68fdd-f797-466d-aa3b-07b2cc063cf8 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:36:21.490172 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-24b68fdd-f797-466d-aa3b-07b2cc063cf8 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] [instance: ff125cf8-e8a5-4f00-ade9-045b18ee33f4] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:36:21.497131 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-24b68fdd-f797-466d-aa3b-07b2cc063cf8 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:36:21.497691 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-24b68fdd-f797-466d-aa3b-07b2cc063cf8 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:36:21.498107 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-24b68fdd-f797-466d-aa3b-07b2cc063cf8 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:36:21.499037 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-24b68fdd-f797-466d-aa3b-07b2cc063cf8 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:36:21.499522 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-24b68fdd-f797-466d-aa3b-07b2cc063cf8 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:36:21.499946 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-24b68fdd-f797-466d-aa3b-07b2cc063cf8 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:36:21.639282 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.objects.instance [None req-24b68fdd-f797-466d-aa3b-07b2cc063cf8 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lazy-loading 'services' on Instance uuid ff125cf8-e8a5-4f00-ade9-045b18ee33f4 {{(pid=125440) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 12:36:21.773596 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-24b68fdd-f797-466d-aa3b-07b2cc063cf8 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] 10.222.0.15 "DELETE /compute/v2.1/servers/ff125cf8-e8a5-4f00-ade9-045b18ee33f4/os-volume_attachments/b801eb89-6de1-49ea-91a0-f33ec1b7401f" status: 202 len: 0 microversion: 2.1 time: 0.291937 Oct 31 12:36:21.774197 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 257/502] 10.222.0.15 () {58 vars in 1416 bytes} [Mon Oct 31 12:36:21 2022] DELETE /compute/v2.1/servers/ff125cf8-e8a5-4f00-ade9-045b18ee33f4/os-volume_attachments/b801eb89-6de1-49ea-91a0-f33ec1b7401f => generated 0 bytes in 294 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 12:36:21.798440 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-44b3598a-9529-42e3-801c-f63638d8d2bc tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:36:21.799247 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-44b3598a-9529-42e3-801c-f63638d8d2bc tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] [instance: 852e8870-b3ec-4a21-a9b5-e31a423ddd3d] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:36:21.806551 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-44b3598a-9529-42e3-801c-f63638d8d2bc tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:36:21.807056 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-44b3598a-9529-42e3-801c-f63638d8d2bc tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:36:21.807599 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-44b3598a-9529-42e3-801c-f63638d8d2bc tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:36:21.808364 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-44b3598a-9529-42e3-801c-f63638d8d2bc tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:36:21.808879 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-44b3598a-9529-42e3-801c-f63638d8d2bc tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:36:21.809365 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-44b3598a-9529-42e3-801c-f63638d8d2bc tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:36:21.955745 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-44b3598a-9529-42e3-801c-f63638d8d2bc tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:36:21.966147 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-44b3598a-9529-42e3-801c-f63638d8d2bc tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:36:21.967647 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-44b3598a-9529-42e3-801c-f63638d8d2bc tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:36:21.968847 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-44b3598a-9529-42e3-801c-f63638d8d2bc tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] 10.222.0.15 "GET /compute/v2.1/servers/852e8870-b3ec-4a21-a9b5-e31a423ddd3d" status: 200 len: 1809 microversion: 2.20 time: 0.174930 Oct 31 12:36:21.970051 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 246/503] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Oct 31 12:36:21 2022] GET /compute/v2.1/servers/852e8870-b3ec-4a21-a9b5-e31a423ddd3d => generated 1809 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 12:36:22.338914 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-887fad44-68ea-4f9b-8de6-7c8c234ef7ac tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:36:22.339761 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-887fad44-68ea-4f9b-8de6-7c8c234ef7ac tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] [instance: d7643c7c-0218-427f-876a-cf89c932dd11] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:36:22.347546 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-887fad44-68ea-4f9b-8de6-7c8c234ef7ac tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:36:22.348024 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-887fad44-68ea-4f9b-8de6-7c8c234ef7ac tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:36:22.348711 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-887fad44-68ea-4f9b-8de6-7c8c234ef7ac tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:36:22.349246 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-887fad44-68ea-4f9b-8de6-7c8c234ef7ac tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:36:22.349695 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-887fad44-68ea-4f9b-8de6-7c8c234ef7ac tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:36:22.350104 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-887fad44-68ea-4f9b-8de6-7c8c234ef7ac tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:36:22.415889 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-887fad44-68ea-4f9b-8de6-7c8c234ef7ac tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b76d81ee9446cf9014a2e695ef03e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae8c589d0b84ce096451a10717fc601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:36:22.424577 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-887fad44-68ea-4f9b-8de6-7c8c234ef7ac tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] 10.222.0.15 "GET /compute/v2.1/servers/d7643c7c-0218-427f-876a-cf89c932dd11" status: 200 len: 1144 microversion: 2.1 time: 0.090044 Oct 31 12:36:22.425140 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 258/504] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:36:22 2022] GET /compute/v2.1/servers/d7643c7c-0218-427f-876a-cf89c932dd11 => generated 1144 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:36:22.996031 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-8634c518-4aa4-4456-a707-74f5605dc9c5 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:36:22.997237 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-8634c518-4aa4-4456-a707-74f5605dc9c5 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] [instance: 852e8870-b3ec-4a21-a9b5-e31a423ddd3d] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:36:23.004335 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-8634c518-4aa4-4456-a707-74f5605dc9c5 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:36:23.005053 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-8634c518-4aa4-4456-a707-74f5605dc9c5 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:36:23.005481 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-8634c518-4aa4-4456-a707-74f5605dc9c5 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:36:23.006176 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-8634c518-4aa4-4456-a707-74f5605dc9c5 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:36:23.006622 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-8634c518-4aa4-4456-a707-74f5605dc9c5 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:36:23.007043 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-8634c518-4aa4-4456-a707-74f5605dc9c5 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:36:23.140119 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-8634c518-4aa4-4456-a707-74f5605dc9c5 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:36:23.150478 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-8634c518-4aa4-4456-a707-74f5605dc9c5 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:36:23.151961 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-8634c518-4aa4-4456-a707-74f5605dc9c5 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:36:23.153124 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-8634c518-4aa4-4456-a707-74f5605dc9c5 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] 10.222.0.15 "GET /compute/v2.1/servers/852e8870-b3ec-4a21-a9b5-e31a423ddd3d" status: 200 len: 1809 microversion: 2.20 time: 0.161101 Oct 31 12:36:23.153693 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 247/505] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Oct 31 12:36:22 2022] GET /compute/v2.1/servers/852e8870-b3ec-4a21-a9b5-e31a423ddd3d => generated 1809 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 12:36:23.448188 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-a6e69bc3-3822-4a69-81e7-b5ae5cec09f7 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:36:23.448844 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-a6e69bc3-3822-4a69-81e7-b5ae5cec09f7 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] [instance: d7643c7c-0218-427f-876a-cf89c932dd11] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:36:23.456227 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-a6e69bc3-3822-4a69-81e7-b5ae5cec09f7 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:36:23.456724 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-a6e69bc3-3822-4a69-81e7-b5ae5cec09f7 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:36:23.457152 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-a6e69bc3-3822-4a69-81e7-b5ae5cec09f7 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:36:23.457832 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-a6e69bc3-3822-4a69-81e7-b5ae5cec09f7 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:36:23.458279 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-a6e69bc3-3822-4a69-81e7-b5ae5cec09f7 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:36:23.459553 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-a6e69bc3-3822-4a69-81e7-b5ae5cec09f7 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:36:23.525195 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-a6e69bc3-3822-4a69-81e7-b5ae5cec09f7 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b76d81ee9446cf9014a2e695ef03e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae8c589d0b84ce096451a10717fc601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:36:23.533479 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-a6e69bc3-3822-4a69-81e7-b5ae5cec09f7 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] 10.222.0.15 "GET /compute/v2.1/servers/d7643c7c-0218-427f-876a-cf89c932dd11" status: 200 len: 1144 microversion: 2.1 time: 0.088650 Oct 31 12:36:23.534107 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 259/506] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:36:23 2022] GET /compute/v2.1/servers/d7643c7c-0218-427f-876a-cf89c932dd11 => generated 1144 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:36:24.179474 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-ae24e27f-0f3f-4b32-9d51-09337fa26771 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:36:24.180009 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-ae24e27f-0f3f-4b32-9d51-09337fa26771 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] [instance: 852e8870-b3ec-4a21-a9b5-e31a423ddd3d] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:36:24.186288 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-ae24e27f-0f3f-4b32-9d51-09337fa26771 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:36:24.186764 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-ae24e27f-0f3f-4b32-9d51-09337fa26771 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:36:24.187214 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-ae24e27f-0f3f-4b32-9d51-09337fa26771 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:36:24.187901 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-ae24e27f-0f3f-4b32-9d51-09337fa26771 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:36:24.188345 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-ae24e27f-0f3f-4b32-9d51-09337fa26771 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:36:24.188788 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-ae24e27f-0f3f-4b32-9d51-09337fa26771 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:36:24.330000 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-ae24e27f-0f3f-4b32-9d51-09337fa26771 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:36:24.339105 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-ae24e27f-0f3f-4b32-9d51-09337fa26771 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:36:24.340590 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-ae24e27f-0f3f-4b32-9d51-09337fa26771 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:36:24.341751 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-ae24e27f-0f3f-4b32-9d51-09337fa26771 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] 10.222.0.15 "GET /compute/v2.1/servers/852e8870-b3ec-4a21-a9b5-e31a423ddd3d" status: 200 len: 1809 microversion: 2.20 time: 0.166324 Oct 31 12:36:24.342323 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 248/507] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Oct 31 12:36:24 2022] GET /compute/v2.1/servers/852e8870-b3ec-4a21-a9b5-e31a423ddd3d => generated 1809 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 12:36:24.555854 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-1f79c65b-a462-4d37-9369-7587ef898ccd tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:36:24.556491 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-1f79c65b-a462-4d37-9369-7587ef898ccd tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] [instance: d7643c7c-0218-427f-876a-cf89c932dd11] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:36:24.562374 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-1f79c65b-a462-4d37-9369-7587ef898ccd tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:36:24.562851 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-1f79c65b-a462-4d37-9369-7587ef898ccd tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:36:24.563314 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-1f79c65b-a462-4d37-9369-7587ef898ccd tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:36:24.564041 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-1f79c65b-a462-4d37-9369-7587ef898ccd tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:36:24.564514 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-1f79c65b-a462-4d37-9369-7587ef898ccd tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:36:24.564931 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-1f79c65b-a462-4d37-9369-7587ef898ccd tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:36:24.628065 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-1f79c65b-a462-4d37-9369-7587ef898ccd tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b76d81ee9446cf9014a2e695ef03e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae8c589d0b84ce096451a10717fc601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:36:24.635865 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-1f79c65b-a462-4d37-9369-7587ef898ccd tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] 10.222.0.15 "GET /compute/v2.1/servers/d7643c7c-0218-427f-876a-cf89c932dd11" status: 200 len: 1136 microversion: 2.1 time: 0.084039 Oct 31 12:36:24.636427 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 260/508] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:36:24 2022] GET /compute/v2.1/servers/d7643c7c-0218-427f-876a-cf89c932dd11 => generated 1136 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:36:25.369918 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-c7864fc4-1074-456d-ab60-63fdea7bb42d tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:36:25.370521 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-c7864fc4-1074-456d-ab60-63fdea7bb42d tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] [instance: 852e8870-b3ec-4a21-a9b5-e31a423ddd3d] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:36:25.378060 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-c7864fc4-1074-456d-ab60-63fdea7bb42d tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:36:25.378555 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-c7864fc4-1074-456d-ab60-63fdea7bb42d tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:36:25.379015 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-c7864fc4-1074-456d-ab60-63fdea7bb42d tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:36:25.379866 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-c7864fc4-1074-456d-ab60-63fdea7bb42d tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:36:25.380317 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-c7864fc4-1074-456d-ab60-63fdea7bb42d tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:36:25.380815 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-c7864fc4-1074-456d-ab60-63fdea7bb42d tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:36:25.518257 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-c7864fc4-1074-456d-ab60-63fdea7bb42d tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:36:25.527211 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-c7864fc4-1074-456d-ab60-63fdea7bb42d tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:36:25.528686 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-c7864fc4-1074-456d-ab60-63fdea7bb42d tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:36:25.529850 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-c7864fc4-1074-456d-ab60-63fdea7bb42d tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] 10.222.0.15 "GET /compute/v2.1/servers/852e8870-b3ec-4a21-a9b5-e31a423ddd3d" status: 200 len: 1809 microversion: 2.20 time: 0.164217 Oct 31 12:36:25.530409 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 249/509] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Oct 31 12:36:25 2022] GET /compute/v2.1/servers/852e8870-b3ec-4a21-a9b5-e31a423ddd3d => generated 1809 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 12:36:25.659137 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-8066ffaf-5423-4513-aa23-8a9ddd9e43e7 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:36:25.659774 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-8066ffaf-5423-4513-aa23-8a9ddd9e43e7 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] [instance: d7643c7c-0218-427f-876a-cf89c932dd11] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:36:25.667505 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-8066ffaf-5423-4513-aa23-8a9ddd9e43e7 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:36:25.667995 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-8066ffaf-5423-4513-aa23-8a9ddd9e43e7 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:36:25.668450 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-8066ffaf-5423-4513-aa23-8a9ddd9e43e7 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:36:25.669145 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-8066ffaf-5423-4513-aa23-8a9ddd9e43e7 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:36:25.669621 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-8066ffaf-5423-4513-aa23-8a9ddd9e43e7 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:36:25.670040 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-8066ffaf-5423-4513-aa23-8a9ddd9e43e7 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:36:25.734954 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-8066ffaf-5423-4513-aa23-8a9ddd9e43e7 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b76d81ee9446cf9014a2e695ef03e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae8c589d0b84ce096451a10717fc601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:36:25.743065 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-8066ffaf-5423-4513-aa23-8a9ddd9e43e7 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] 10.222.0.15 "GET /compute/v2.1/servers/d7643c7c-0218-427f-876a-cf89c932dd11" status: 200 len: 1192 microversion: 2.1 time: 0.087970 Oct 31 12:36:25.743656 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 261/510] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:36:25 2022] GET /compute/v2.1/servers/d7643c7c-0218-427f-876a-cf89c932dd11 => generated 1192 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:36:26.089243 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-7e28821e-231b-4a1d-9275-4f62f52da168 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 12:36:26.096718 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-7e28821e-231b-4a1d-9275-4f62f52da168 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:36:26.097305 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-7e28821e-231b-4a1d-9275-4f62f52da168 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:36:26.098561 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-7e28821e-231b-4a1d-9275-4f62f52da168 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:36:26.125235 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-7e28821e-231b-4a1d-9275-4f62f52da168 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] [instance: ff125cf8-e8a5-4f00-ade9-045b18ee33f4] Going to try to stop instance {{(pid=125441) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 31 12:36:26.172728 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-7e28821e-231b-4a1d-9275-4f62f52da168 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] 10.222.0.15 "POST /compute/v2.1/servers/ff125cf8-e8a5-4f00-ade9-045b18ee33f4/action" status: 202 len: 0 microversion: 2.1 time: 0.087081 Oct 31 12:36:26.173708 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 250/511] 10.222.0.15 () {60 vars in 1278 bytes} [Mon Oct 31 12:36:26 2022] POST /compute/v2.1/servers/ff125cf8-e8a5-4f00-ade9-045b18ee33f4/action => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 12:36:26.181899 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-ec782262-02f7-42e7-a7ff-9751012d338f tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:36:26.182512 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-ec782262-02f7-42e7-a7ff-9751012d338f tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] [instance: ff125cf8-e8a5-4f00-ade9-045b18ee33f4] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:36:26.189633 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-ec782262-02f7-42e7-a7ff-9751012d338f tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:36:26.191436 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-ec782262-02f7-42e7-a7ff-9751012d338f tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:36:26.191945 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-ec782262-02f7-42e7-a7ff-9751012d338f tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:36:26.192675 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-ec782262-02f7-42e7-a7ff-9751012d338f tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:36:26.193095 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-ec782262-02f7-42e7-a7ff-9751012d338f tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:36:26.193711 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-ec782262-02f7-42e7-a7ff-9751012d338f tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:36:26.409397 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-ec782262-02f7-42e7-a7ff-9751012d338f tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c1beb321e44908ab987b17f7b74484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a2bf9a5a484523a700e4e6c568d4de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:36:26.417053 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-ec782262-02f7-42e7-a7ff-9751012d338f tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] 10.222.0.15 "GET /compute/v2.1/servers/ff125cf8-e8a5-4f00-ade9-045b18ee33f4" status: 200 len: 1678 microversion: 2.1 time: 0.239494 Oct 31 12:36:26.417622 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 262/512] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:36:26 2022] GET /compute/v2.1/servers/ff125cf8-e8a5-4f00-ade9-045b18ee33f4 => generated 1678 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 12:36:26.556636 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-1cf77073-7cab-40d7-afe8-0c27d8a1850e tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:36:26.557239 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-1cf77073-7cab-40d7-afe8-0c27d8a1850e tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] [instance: 852e8870-b3ec-4a21-a9b5-e31a423ddd3d] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:36:26.563329 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-1cf77073-7cab-40d7-afe8-0c27d8a1850e tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:36:26.563935 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-1cf77073-7cab-40d7-afe8-0c27d8a1850e tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:36:26.564860 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-1cf77073-7cab-40d7-afe8-0c27d8a1850e tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:36:26.565728 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-1cf77073-7cab-40d7-afe8-0c27d8a1850e tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:36:26.566434 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-1cf77073-7cab-40d7-afe8-0c27d8a1850e tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:36:26.567031 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-1cf77073-7cab-40d7-afe8-0c27d8a1850e tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:36:26.712749 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-1cf77073-7cab-40d7-afe8-0c27d8a1850e tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:36:26.722496 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-1cf77073-7cab-40d7-afe8-0c27d8a1850e tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:36:26.724504 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-1cf77073-7cab-40d7-afe8-0c27d8a1850e tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:36:26.726051 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-1cf77073-7cab-40d7-afe8-0c27d8a1850e tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] 10.222.0.15 "GET /compute/v2.1/servers/852e8870-b3ec-4a21-a9b5-e31a423ddd3d" status: 200 len: 1809 microversion: 2.20 time: 0.174249 Oct 31 12:36:26.726919 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 251/513] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Oct 31 12:36:26 2022] GET /compute/v2.1/servers/852e8870-b3ec-4a21-a9b5-e31a423ddd3d => generated 1809 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 12:36:26.766217 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-1fda7b55-5895-49f1-b23d-9c3bafcb9337 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:36:26.766911 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-1fda7b55-5895-49f1-b23d-9c3bafcb9337 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] [instance: d7643c7c-0218-427f-876a-cf89c932dd11] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:36:26.774747 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-1fda7b55-5895-49f1-b23d-9c3bafcb9337 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:36:26.775680 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-1fda7b55-5895-49f1-b23d-9c3bafcb9337 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:36:26.776376 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-1fda7b55-5895-49f1-b23d-9c3bafcb9337 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:36:26.777289 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-1fda7b55-5895-49f1-b23d-9c3bafcb9337 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:36:26.777945 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-1fda7b55-5895-49f1-b23d-9c3bafcb9337 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:36:26.778593 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-1fda7b55-5895-49f1-b23d-9c3bafcb9337 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:36:27.007803 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-1fda7b55-5895-49f1-b23d-9c3bafcb9337 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b76d81ee9446cf9014a2e695ef03e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae8c589d0b84ce096451a10717fc601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:36:27.016749 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-1fda7b55-5895-49f1-b23d-9c3bafcb9337 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] 10.222.0.15 "GET /compute/v2.1/servers/d7643c7c-0218-427f-876a-cf89c932dd11" status: 200 len: 1266 microversion: 2.1 time: 0.254478 Oct 31 12:36:27.017475 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 263/514] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:36:26 2022] GET /compute/v2.1/servers/d7643c7c-0218-427f-876a-cf89c932dd11 => generated 1266 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:36:27.441129 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-2692536e-27c3-4ede-a104-3d0213ecdcc3 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:36:27.441740 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-2692536e-27c3-4ede-a104-3d0213ecdcc3 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] [instance: ff125cf8-e8a5-4f00-ade9-045b18ee33f4] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:36:27.447604 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-2692536e-27c3-4ede-a104-3d0213ecdcc3 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:36:27.448085 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-2692536e-27c3-4ede-a104-3d0213ecdcc3 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:36:27.448516 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-2692536e-27c3-4ede-a104-3d0213ecdcc3 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:36:27.449198 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-2692536e-27c3-4ede-a104-3d0213ecdcc3 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:36:27.449647 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-2692536e-27c3-4ede-a104-3d0213ecdcc3 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:36:27.450096 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-2692536e-27c3-4ede-a104-3d0213ecdcc3 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:36:27.561548 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [req-bae96013-b90a-4acc-9bbc-308830daa4f7 req-9902d811-c809-4ad2-9499-c919c1dc0f37 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7643c7c-0218-427f-876a-cf89c932dd11", "tag": "76712093-6a65-4766-8171-79fff21ef102"}]} {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 12:36:27.584234 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [req-bae96013-b90a-4acc-9bbc-308830daa4f7 req-9902d811-c809-4ad2-9499-c919c1dc0f37 service nova] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:36:27.585665 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [req-bae96013-b90a-4acc-9bbc-308830daa4f7 req-9902d811-c809-4ad2-9499-c919c1dc0f37 service nova] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:36:27.586274 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [req-bae96013-b90a-4acc-9bbc-308830daa4f7 req-9902d811-c809-4ad2-9499-c919c1dc0f37 service nova] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:36:27.590198 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-2692536e-27c3-4ede-a104-3d0213ecdcc3 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c1beb321e44908ab987b17f7b74484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a2bf9a5a484523a700e4e6c568d4de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:36:27.598706 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.compute.server_external_events [req-bae96013-b90a-4acc-9bbc-308830daa4f7 req-9902d811-c809-4ad2-9499-c919c1dc0f37 service nova] Creating event network-changed:76712093-6a65-4766-8171-79fff21ef102 for instance d7643c7c-0218-427f-876a-cf89c932dd11 on hv-cinder-79617 Oct 31 12:36:27.599592 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-2692536e-27c3-4ede-a104-3d0213ecdcc3 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] 10.222.0.15 "GET /compute/v2.1/servers/ff125cf8-e8a5-4f00-ade9-045b18ee33f4" status: 200 len: 1678 microversion: 2.1 time: 0.162223 Oct 31 12:36:27.600281 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 252/515] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:36:27 2022] GET /compute/v2.1/servers/ff125cf8-e8a5-4f00-ade9-045b18ee33f4 => generated 1678 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:36:27.618306 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [req-bae96013-b90a-4acc-9bbc-308830daa4f7 req-9902d811-c809-4ad2-9499-c919c1dc0f37 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060977 Oct 31 12:36:27.618902 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 264/516] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Oct 31 12:36:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 12:36:27.754539 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-5d699955-1246-4769-bcb3-258cde9e8fe1 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:36:27.755142 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-5d699955-1246-4769-bcb3-258cde9e8fe1 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] [instance: 852e8870-b3ec-4a21-a9b5-e31a423ddd3d] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:36:27.761362 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-5d699955-1246-4769-bcb3-258cde9e8fe1 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:36:27.761841 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-5d699955-1246-4769-bcb3-258cde9e8fe1 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:36:27.762271 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-5d699955-1246-4769-bcb3-258cde9e8fe1 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:36:27.762958 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-5d699955-1246-4769-bcb3-258cde9e8fe1 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:36:27.763431 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-5d699955-1246-4769-bcb3-258cde9e8fe1 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:36:27.763849 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-5d699955-1246-4769-bcb3-258cde9e8fe1 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:36:27.780556 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG dbcounter [-] [125441] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=125441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:36:27.899017 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-5d699955-1246-4769-bcb3-258cde9e8fe1 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:36:27.907805 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-5d699955-1246-4769-bcb3-258cde9e8fe1 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:36:27.909294 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-5d699955-1246-4769-bcb3-258cde9e8fe1 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:36:27.910443 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-5d699955-1246-4769-bcb3-258cde9e8fe1 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] 10.222.0.15 "GET /compute/v2.1/servers/852e8870-b3ec-4a21-a9b5-e31a423ddd3d" status: 200 len: 1809 microversion: 2.20 time: 0.160403 Oct 31 12:36:27.911007 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 253/517] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Oct 31 12:36:27 2022] GET /compute/v2.1/servers/852e8870-b3ec-4a21-a9b5-e31a423ddd3d => generated 1809 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 12:36:28.042270 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-5854890a-ab7d-4b5e-a23c-673b43578ddb tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:36:28.043012 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-5854890a-ab7d-4b5e-a23c-673b43578ddb tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] [instance: d7643c7c-0218-427f-876a-cf89c932dd11] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:36:28.049679 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-5854890a-ab7d-4b5e-a23c-673b43578ddb tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:36:28.050152 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-5854890a-ab7d-4b5e-a23c-673b43578ddb tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:36:28.050579 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-5854890a-ab7d-4b5e-a23c-673b43578ddb tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:36:28.051287 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-5854890a-ab7d-4b5e-a23c-673b43578ddb tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:36:28.051737 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-5854890a-ab7d-4b5e-a23c-673b43578ddb tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:36:28.052153 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-5854890a-ab7d-4b5e-a23c-673b43578ddb tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:36:28.179741 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-5854890a-ab7d-4b5e-a23c-673b43578ddb tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b76d81ee9446cf9014a2e695ef03e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae8c589d0b84ce096451a10717fc601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:36:28.187515 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-5854890a-ab7d-4b5e-a23c-673b43578ddb tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] 10.222.0.15 "GET /compute/v2.1/servers/d7643c7c-0218-427f-876a-cf89c932dd11" status: 200 len: 1266 microversion: 2.1 time: 0.149899 Oct 31 12:36:28.188087 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 265/518] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:36:28 2022] GET /compute/v2.1/servers/d7643c7c-0218-427f-876a-cf89c932dd11 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:36:28.623228 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-f73f2f30-bd93-4a18-be3d-464b6f2b456d tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:36:28.623741 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-f73f2f30-bd93-4a18-be3d-464b6f2b456d tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] [instance: ff125cf8-e8a5-4f00-ade9-045b18ee33f4] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:36:28.630976 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-f73f2f30-bd93-4a18-be3d-464b6f2b456d tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:36:28.631579 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-f73f2f30-bd93-4a18-be3d-464b6f2b456d tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:36:28.632012 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-f73f2f30-bd93-4a18-be3d-464b6f2b456d tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:36:28.632702 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-f73f2f30-bd93-4a18-be3d-464b6f2b456d tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:36:28.633156 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-f73f2f30-bd93-4a18-be3d-464b6f2b456d tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:36:28.633575 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-f73f2f30-bd93-4a18-be3d-464b6f2b456d tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:36:28.765938 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-f73f2f30-bd93-4a18-be3d-464b6f2b456d tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c1beb321e44908ab987b17f7b74484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a2bf9a5a484523a700e4e6c568d4de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:36:28.774557 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-f73f2f30-bd93-4a18-be3d-464b6f2b456d tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] 10.222.0.15 "GET /compute/v2.1/servers/ff125cf8-e8a5-4f00-ade9-045b18ee33f4" status: 200 len: 1678 microversion: 2.1 time: 0.155219 Oct 31 12:36:28.775129 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 254/519] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:36:28 2022] GET /compute/v2.1/servers/ff125cf8-e8a5-4f00-ade9-045b18ee33f4 => generated 1678 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:36:28.936073 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-2730b7df-b346-42dd-8101-607d5a5c6f4c tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:36:28.936599 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-2730b7df-b346-42dd-8101-607d5a5c6f4c tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] [instance: 852e8870-b3ec-4a21-a9b5-e31a423ddd3d] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:36:28.943063 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-2730b7df-b346-42dd-8101-607d5a5c6f4c tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:36:28.943574 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-2730b7df-b346-42dd-8101-607d5a5c6f4c tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:36:28.944011 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-2730b7df-b346-42dd-8101-607d5a5c6f4c tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:36:28.944692 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-2730b7df-b346-42dd-8101-607d5a5c6f4c tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:36:28.945145 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-2730b7df-b346-42dd-8101-607d5a5c6f4c tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:36:28.945566 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-2730b7df-b346-42dd-8101-607d5a5c6f4c tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:36:29.072519 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-2730b7df-b346-42dd-8101-607d5a5c6f4c tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:36:29.081060 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-2730b7df-b346-42dd-8101-607d5a5c6f4c tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:36:29.082501 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-2730b7df-b346-42dd-8101-607d5a5c6f4c tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:36:29.083675 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-2730b7df-b346-42dd-8101-607d5a5c6f4c tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] 10.222.0.15 "GET /compute/v2.1/servers/852e8870-b3ec-4a21-a9b5-e31a423ddd3d" status: 200 len: 1809 microversion: 2.20 time: 0.151548 Oct 31 12:36:29.084234 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 266/520] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Oct 31 12:36:28 2022] GET /compute/v2.1/servers/852e8870-b3ec-4a21-a9b5-e31a423ddd3d => generated 1809 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 12:36:29.210058 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-c817efa0-0a7f-4a52-af8c-ee1e787a245a tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:36:29.210593 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-c817efa0-0a7f-4a52-af8c-ee1e787a245a tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] [instance: d7643c7c-0218-427f-876a-cf89c932dd11] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:36:29.216475 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-c817efa0-0a7f-4a52-af8c-ee1e787a245a tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:36:29.216952 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-c817efa0-0a7f-4a52-af8c-ee1e787a245a tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:36:29.217378 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-c817efa0-0a7f-4a52-af8c-ee1e787a245a tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:36:29.218057 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-c817efa0-0a7f-4a52-af8c-ee1e787a245a tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:36:29.218507 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-c817efa0-0a7f-4a52-af8c-ee1e787a245a tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:36:29.218925 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-c817efa0-0a7f-4a52-af8c-ee1e787a245a tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:36:29.350370 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-c817efa0-0a7f-4a52-af8c-ee1e787a245a tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b76d81ee9446cf9014a2e695ef03e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae8c589d0b84ce096451a10717fc601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:36:29.357933 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-c817efa0-0a7f-4a52-af8c-ee1e787a245a tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] 10.222.0.15 "GET /compute/v2.1/servers/d7643c7c-0218-427f-876a-cf89c932dd11" status: 200 len: 1266 microversion: 2.1 time: 0.151865 Oct 31 12:36:29.358491 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 255/521] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:36:29 2022] GET /compute/v2.1/servers/d7643c7c-0218-427f-876a-cf89c932dd11 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:36:29.797498 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-32f4f556-bbd3-4a12-a000-84723d3d536d tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:36:29.798090 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-32f4f556-bbd3-4a12-a000-84723d3d536d tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] [instance: ff125cf8-e8a5-4f00-ade9-045b18ee33f4] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:36:29.804115 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-32f4f556-bbd3-4a12-a000-84723d3d536d tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:36:29.804584 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-32f4f556-bbd3-4a12-a000-84723d3d536d tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:36:29.805008 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-32f4f556-bbd3-4a12-a000-84723d3d536d tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:36:29.805674 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-32f4f556-bbd3-4a12-a000-84723d3d536d tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:36:29.806116 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-32f4f556-bbd3-4a12-a000-84723d3d536d tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:36:29.806525 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-32f4f556-bbd3-4a12-a000-84723d3d536d tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:36:29.938091 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-32f4f556-bbd3-4a12-a000-84723d3d536d tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c1beb321e44908ab987b17f7b74484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a2bf9a5a484523a700e4e6c568d4de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:36:29.946090 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-32f4f556-bbd3-4a12-a000-84723d3d536d tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] 10.222.0.15 "GET /compute/v2.1/servers/ff125cf8-e8a5-4f00-ade9-045b18ee33f4" status: 200 len: 1678 microversion: 2.1 time: 0.152371 Oct 31 12:36:29.946671 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 267/522] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:36:29 2022] GET /compute/v2.1/servers/ff125cf8-e8a5-4f00-ade9-045b18ee33f4 => generated 1678 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:36:30.109464 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-74939ed4-5fab-420c-bef5-2b7fe78bf23c tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:36:30.110005 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-74939ed4-5fab-420c-bef5-2b7fe78bf23c tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] [instance: 852e8870-b3ec-4a21-a9b5-e31a423ddd3d] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:36:30.116920 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-74939ed4-5fab-420c-bef5-2b7fe78bf23c tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:36:30.117404 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-74939ed4-5fab-420c-bef5-2b7fe78bf23c tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:36:30.117832 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-74939ed4-5fab-420c-bef5-2b7fe78bf23c tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:36:30.118514 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-74939ed4-5fab-420c-bef5-2b7fe78bf23c tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:36:30.118962 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-74939ed4-5fab-420c-bef5-2b7fe78bf23c tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:36:30.119409 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-74939ed4-5fab-420c-bef5-2b7fe78bf23c tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:36:30.251216 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-74939ed4-5fab-420c-bef5-2b7fe78bf23c tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:36:30.260230 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-74939ed4-5fab-420c-bef5-2b7fe78bf23c tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:36:30.261668 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-74939ed4-5fab-420c-bef5-2b7fe78bf23c tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:36:30.262808 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-74939ed4-5fab-420c-bef5-2b7fe78bf23c tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] 10.222.0.15 "GET /compute/v2.1/servers/852e8870-b3ec-4a21-a9b5-e31a423ddd3d" status: 200 len: 1809 microversion: 2.20 time: 0.157371 Oct 31 12:36:30.263394 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 256/523] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Oct 31 12:36:30 2022] GET /compute/v2.1/servers/852e8870-b3ec-4a21-a9b5-e31a423ddd3d => generated 1809 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 12:36:30.380687 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-72dff9c6-1271-4b76-adc5-1681625c5633 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:36:30.381210 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-72dff9c6-1271-4b76-adc5-1681625c5633 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] [instance: d7643c7c-0218-427f-876a-cf89c932dd11] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:36:30.387683 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-72dff9c6-1271-4b76-adc5-1681625c5633 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:36:30.388188 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-72dff9c6-1271-4b76-adc5-1681625c5633 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:36:30.388615 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-72dff9c6-1271-4b76-adc5-1681625c5633 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:36:30.389330 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-72dff9c6-1271-4b76-adc5-1681625c5633 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:36:30.389774 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-72dff9c6-1271-4b76-adc5-1681625c5633 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:36:30.390187 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-72dff9c6-1271-4b76-adc5-1681625c5633 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:36:30.519668 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-72dff9c6-1271-4b76-adc5-1681625c5633 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b76d81ee9446cf9014a2e695ef03e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae8c589d0b84ce096451a10717fc601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:36:30.527456 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-72dff9c6-1271-4b76-adc5-1681625c5633 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] 10.222.0.15 "GET /compute/v2.1/servers/d7643c7c-0218-427f-876a-cf89c932dd11" status: 200 len: 1266 microversion: 2.1 time: 0.150878 Oct 31 12:36:30.528020 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 268/524] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:36:30 2022] GET /compute/v2.1/servers/d7643c7c-0218-427f-876a-cf89c932dd11 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:36:30.969608 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-a020d633-3ac5-4a43-9203-7f2c3c6d7fcc tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:36:30.970261 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-a020d633-3ac5-4a43-9203-7f2c3c6d7fcc tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] [instance: ff125cf8-e8a5-4f00-ade9-045b18ee33f4] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:36:30.976221 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-a020d633-3ac5-4a43-9203-7f2c3c6d7fcc tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:36:30.976690 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-a020d633-3ac5-4a43-9203-7f2c3c6d7fcc tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:36:30.977115 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-a020d633-3ac5-4a43-9203-7f2c3c6d7fcc tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:36:30.977788 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-a020d633-3ac5-4a43-9203-7f2c3c6d7fcc tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:36:30.978240 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-a020d633-3ac5-4a43-9203-7f2c3c6d7fcc tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:36:30.978654 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-a020d633-3ac5-4a43-9203-7f2c3c6d7fcc tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:36:31.104946 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-a020d633-3ac5-4a43-9203-7f2c3c6d7fcc tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c1beb321e44908ab987b17f7b74484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a2bf9a5a484523a700e4e6c568d4de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:36:31.113232 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-a020d633-3ac5-4a43-9203-7f2c3c6d7fcc tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] 10.222.0.15 "GET /compute/v2.1/servers/ff125cf8-e8a5-4f00-ade9-045b18ee33f4" status: 200 len: 1678 microversion: 2.1 time: 0.147497 Oct 31 12:36:31.113804 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 257/525] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:36:30 2022] GET /compute/v2.1/servers/ff125cf8-e8a5-4f00-ade9-045b18ee33f4 => generated 1678 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:36:31.289711 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-28c24d57-4da5-4b89-81b6-67649eb058c6 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:36:31.290312 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-28c24d57-4da5-4b89-81b6-67649eb058c6 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] [instance: 852e8870-b3ec-4a21-a9b5-e31a423ddd3d] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:36:31.292288 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG dbcounter [-] [125440] Writing DB stats nova_cell0:SELECT=2 {{(pid=125440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:36:31.293098 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG dbcounter [-] [125440] Writing DB stats nova_cell0:SELECT=6 {{(pid=125440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:36:31.299915 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-28c24d57-4da5-4b89-81b6-67649eb058c6 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:36:31.300416 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-28c24d57-4da5-4b89-81b6-67649eb058c6 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:36:31.300844 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-28c24d57-4da5-4b89-81b6-67649eb058c6 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:36:31.301523 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-28c24d57-4da5-4b89-81b6-67649eb058c6 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:36:31.301970 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-28c24d57-4da5-4b89-81b6-67649eb058c6 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:36:31.302385 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-28c24d57-4da5-4b89-81b6-67649eb058c6 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:36:31.435037 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-28c24d57-4da5-4b89-81b6-67649eb058c6 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:36:31.443858 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-28c24d57-4da5-4b89-81b6-67649eb058c6 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:36:31.445282 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-28c24d57-4da5-4b89-81b6-67649eb058c6 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:36:31.446412 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-28c24d57-4da5-4b89-81b6-67649eb058c6 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] 10.222.0.15 "GET /compute/v2.1/servers/852e8870-b3ec-4a21-a9b5-e31a423ddd3d" status: 200 len: 1809 microversion: 2.20 time: 0.160601 Oct 31 12:36:31.446972 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 269/526] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Oct 31 12:36:31 2022] GET /compute/v2.1/servers/852e8870-b3ec-4a21-a9b5-e31a423ddd3d => generated 1809 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 12:36:31.550710 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-16dd5bc8-c18b-4398-afa0-e103c89c0552 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:36:31.551355 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-16dd5bc8-c18b-4398-afa0-e103c89c0552 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] [instance: d7643c7c-0218-427f-876a-cf89c932dd11] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:36:31.553640 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG dbcounter [-] [125441] Writing DB stats nova_cell0:SELECT=2 {{(pid=125441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:36:31.558770 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-16dd5bc8-c18b-4398-afa0-e103c89c0552 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:36:31.559277 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-16dd5bc8-c18b-4398-afa0-e103c89c0552 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:36:31.559705 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-16dd5bc8-c18b-4398-afa0-e103c89c0552 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:36:31.560390 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-16dd5bc8-c18b-4398-afa0-e103c89c0552 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:36:31.560857 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-16dd5bc8-c18b-4398-afa0-e103c89c0552 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:36:31.561252 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-16dd5bc8-c18b-4398-afa0-e103c89c0552 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:36:31.696379 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-16dd5bc8-c18b-4398-afa0-e103c89c0552 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b76d81ee9446cf9014a2e695ef03e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae8c589d0b84ce096451a10717fc601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:36:31.704034 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-16dd5bc8-c18b-4398-afa0-e103c89c0552 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] 10.222.0.15 "GET /compute/v2.1/servers/d7643c7c-0218-427f-876a-cf89c932dd11" status: 200 len: 1266 microversion: 2.1 time: 0.158031 Oct 31 12:36:31.704621 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 258/527] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:36:31 2022] GET /compute/v2.1/servers/d7643c7c-0218-427f-876a-cf89c932dd11 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:36:32.137058 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-d124442c-3627-496d-a6c6-0a4c55e4c3a9 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:36:32.137681 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-d124442c-3627-496d-a6c6-0a4c55e4c3a9 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] [instance: ff125cf8-e8a5-4f00-ade9-045b18ee33f4] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:36:32.144022 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-d124442c-3627-496d-a6c6-0a4c55e4c3a9 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:36:32.144510 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-d124442c-3627-496d-a6c6-0a4c55e4c3a9 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:36:32.145190 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-d124442c-3627-496d-a6c6-0a4c55e4c3a9 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:36:32.145885 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-d124442c-3627-496d-a6c6-0a4c55e4c3a9 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:36:32.146331 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-d124442c-3627-496d-a6c6-0a4c55e4c3a9 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:36:32.146745 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-d124442c-3627-496d-a6c6-0a4c55e4c3a9 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:36:32.167897 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG dbcounter [-] [125440] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=125440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:36:32.290933 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-d124442c-3627-496d-a6c6-0a4c55e4c3a9 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c1beb321e44908ab987b17f7b74484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a2bf9a5a484523a700e4e6c568d4de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:36:32.299499 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-d124442c-3627-496d-a6c6-0a4c55e4c3a9 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] 10.222.0.15 "GET /compute/v2.1/servers/ff125cf8-e8a5-4f00-ade9-045b18ee33f4" status: 200 len: 1678 microversion: 2.1 time: 0.166180 Oct 31 12:36:32.300074 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 270/528] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:36:32 2022] GET /compute/v2.1/servers/ff125cf8-e8a5-4f00-ade9-045b18ee33f4 => generated 1678 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:36:32.471669 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-7e6bafc5-1acf-4e1a-8f41-cd4032bc5140 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:36:32.472276 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-7e6bafc5-1acf-4e1a-8f41-cd4032bc5140 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] [instance: 852e8870-b3ec-4a21-a9b5-e31a423ddd3d] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:36:32.478070 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-7e6bafc5-1acf-4e1a-8f41-cd4032bc5140 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:36:32.478546 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-7e6bafc5-1acf-4e1a-8f41-cd4032bc5140 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:36:32.478972 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-7e6bafc5-1acf-4e1a-8f41-cd4032bc5140 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:36:32.479680 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-7e6bafc5-1acf-4e1a-8f41-cd4032bc5140 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:36:32.480130 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-7e6bafc5-1acf-4e1a-8f41-cd4032bc5140 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:36:32.480545 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-7e6bafc5-1acf-4e1a-8f41-cd4032bc5140 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:36:32.612153 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-7e6bafc5-1acf-4e1a-8f41-cd4032bc5140 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:36:32.620531 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-7e6bafc5-1acf-4e1a-8f41-cd4032bc5140 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:36:32.621973 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-7e6bafc5-1acf-4e1a-8f41-cd4032bc5140 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:36:32.623124 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-7e6bafc5-1acf-4e1a-8f41-cd4032bc5140 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] 10.222.0.15 "GET /compute/v2.1/servers/852e8870-b3ec-4a21-a9b5-e31a423ddd3d" status: 200 len: 1809 microversion: 2.20 time: 0.155617 Oct 31 12:36:32.623705 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 259/529] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Oct 31 12:36:32 2022] GET /compute/v2.1/servers/852e8870-b3ec-4a21-a9b5-e31a423ddd3d => generated 1809 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 12:36:32.726833 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-acbb351e-91bb-423a-b011-cf554d682042 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:36:32.727473 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-acbb351e-91bb-423a-b011-cf554d682042 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] [instance: d7643c7c-0218-427f-876a-cf89c932dd11] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:36:32.733831 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-acbb351e-91bb-423a-b011-cf554d682042 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:36:32.734307 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-acbb351e-91bb-423a-b011-cf554d682042 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:36:32.734732 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-acbb351e-91bb-423a-b011-cf554d682042 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:36:32.735435 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-acbb351e-91bb-423a-b011-cf554d682042 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:36:32.735919 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-acbb351e-91bb-423a-b011-cf554d682042 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:36:32.736336 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-acbb351e-91bb-423a-b011-cf554d682042 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:36:32.864485 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-acbb351e-91bb-423a-b011-cf554d682042 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b76d81ee9446cf9014a2e695ef03e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae8c589d0b84ce096451a10717fc601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:36:32.871981 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-acbb351e-91bb-423a-b011-cf554d682042 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] 10.222.0.15 "GET /compute/v2.1/servers/d7643c7c-0218-427f-876a-cf89c932dd11" status: 200 len: 1266 microversion: 2.1 time: 0.148969 Oct 31 12:36:32.872536 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 271/530] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:36:32 2022] GET /compute/v2.1/servers/d7643c7c-0218-427f-876a-cf89c932dd11 => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:36:33.323125 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-43ca0b2f-942e-4fea-9a0b-18fe108e8431 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:36:33.323770 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-43ca0b2f-942e-4fea-9a0b-18fe108e8431 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] [instance: ff125cf8-e8a5-4f00-ade9-045b18ee33f4] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:36:33.330360 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-43ca0b2f-942e-4fea-9a0b-18fe108e8431 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:36:33.330838 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-43ca0b2f-942e-4fea-9a0b-18fe108e8431 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:36:33.331368 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-43ca0b2f-942e-4fea-9a0b-18fe108e8431 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:36:33.332054 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-43ca0b2f-942e-4fea-9a0b-18fe108e8431 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:36:33.332506 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-43ca0b2f-942e-4fea-9a0b-18fe108e8431 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:36:33.332925 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-43ca0b2f-942e-4fea-9a0b-18fe108e8431 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:36:33.462944 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-43ca0b2f-942e-4fea-9a0b-18fe108e8431 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c1beb321e44908ab987b17f7b74484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a2bf9a5a484523a700e4e6c568d4de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:36:33.471510 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-43ca0b2f-942e-4fea-9a0b-18fe108e8431 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] 10.222.0.15 "GET /compute/v2.1/servers/ff125cf8-e8a5-4f00-ade9-045b18ee33f4" status: 200 len: 1678 microversion: 2.1 time: 0.152172 Oct 31 12:36:33.472175 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 260/531] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:36:33 2022] GET /compute/v2.1/servers/ff125cf8-e8a5-4f00-ade9-045b18ee33f4 => generated 1678 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:36:33.563153 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [req-ba6fe9f3-bb2e-4e12-9321-94cd52ec6eb0 req-4e702b0e-fb7d-4956-a13b-3f892aa15a6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "852e8870-b3ec-4a21-a9b5-e31a423ddd3d", "name": "network-vif-plugged", "status": "completed", "tag": "dffec82d-007b-4838-9898-19da61885395"}]} {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 12:36:33.573573 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [req-ba6fe9f3-bb2e-4e12-9321-94cd52ec6eb0 req-4e702b0e-fb7d-4956-a13b-3f892aa15a6f service nova] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:36:33.574124 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [req-ba6fe9f3-bb2e-4e12-9321-94cd52ec6eb0 req-4e702b0e-fb7d-4956-a13b-3f892aa15a6f service nova] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:36:33.574543 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [req-ba6fe9f3-bb2e-4e12-9321-94cd52ec6eb0 req-4e702b0e-fb7d-4956-a13b-3f892aa15a6f service nova] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:36:33.586298 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.compute.server_external_events [req-ba6fe9f3-bb2e-4e12-9321-94cd52ec6eb0 req-4e702b0e-fb7d-4956-a13b-3f892aa15a6f service nova] Creating event network-vif-plugged:dffec82d-007b-4838-9898-19da61885395 for instance 852e8870-b3ec-4a21-a9b5-e31a423ddd3d on hv-cinder-79617 Oct 31 12:36:33.591301 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [req-ba6fe9f3-bb2e-4e12-9321-94cd52ec6eb0 req-4e702b0e-fb7d-4956-a13b-3f892aa15a6f service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031728 Oct 31 12:36:33.592055 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 272/532] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Oct 31 12:36:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 12:36:33.649022 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-a4653ae1-afed-48f0-be7b-266ee81fa872 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:36:33.649629 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-a4653ae1-afed-48f0-be7b-266ee81fa872 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] [instance: 852e8870-b3ec-4a21-a9b5-e31a423ddd3d] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:36:33.656001 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-a4653ae1-afed-48f0-be7b-266ee81fa872 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:36:33.656478 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-a4653ae1-afed-48f0-be7b-266ee81fa872 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:36:33.656902 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-a4653ae1-afed-48f0-be7b-266ee81fa872 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:36:33.658157 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-a4653ae1-afed-48f0-be7b-266ee81fa872 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:36:33.658599 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-a4653ae1-afed-48f0-be7b-266ee81fa872 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:36:33.659011 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-a4653ae1-afed-48f0-be7b-266ee81fa872 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:36:33.791097 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-a4653ae1-afed-48f0-be7b-266ee81fa872 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:36:33.800451 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-a4653ae1-afed-48f0-be7b-266ee81fa872 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:36:33.801876 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-a4653ae1-afed-48f0-be7b-266ee81fa872 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:36:33.803043 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-a4653ae1-afed-48f0-be7b-266ee81fa872 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] 10.222.0.15 "GET /compute/v2.1/servers/852e8870-b3ec-4a21-a9b5-e31a423ddd3d" status: 200 len: 1809 microversion: 2.20 time: 0.158214 Oct 31 12:36:33.803642 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 261/533] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Oct 31 12:36:33 2022] GET /compute/v2.1/servers/852e8870-b3ec-4a21-a9b5-e31a423ddd3d => generated 1809 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 12:36:33.896774 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-395fb1cd-dd13-4374-b0a2-273fd8918087 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:36:33.897384 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-395fb1cd-dd13-4374-b0a2-273fd8918087 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] [instance: d7643c7c-0218-427f-876a-cf89c932dd11] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:36:33.903498 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-395fb1cd-dd13-4374-b0a2-273fd8918087 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:36:33.903974 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-395fb1cd-dd13-4374-b0a2-273fd8918087 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:36:33.904401 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-395fb1cd-dd13-4374-b0a2-273fd8918087 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:36:33.905080 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-395fb1cd-dd13-4374-b0a2-273fd8918087 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:36:33.905527 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-395fb1cd-dd13-4374-b0a2-273fd8918087 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:36:33.905945 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-395fb1cd-dd13-4374-b0a2-273fd8918087 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:36:34.041622 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-395fb1cd-dd13-4374-b0a2-273fd8918087 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b76d81ee9446cf9014a2e695ef03e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae8c589d0b84ce096451a10717fc601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:36:34.049165 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-395fb1cd-dd13-4374-b0a2-273fd8918087 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] 10.222.0.15 "GET /compute/v2.1/servers/d7643c7c-0218-427f-876a-cf89c932dd11" status: 200 len: 1266 microversion: 2.1 time: 0.157861 Oct 31 12:36:34.049727 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 273/534] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:36:33 2022] GET /compute/v2.1/servers/d7643c7c-0218-427f-876a-cf89c932dd11 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:36:34.493792 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-3868ec02-563e-4668-bb01-3e82ff172a6b tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:36:34.494398 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-3868ec02-563e-4668-bb01-3e82ff172a6b tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] [instance: ff125cf8-e8a5-4f00-ade9-045b18ee33f4] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:36:34.500267 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-3868ec02-563e-4668-bb01-3e82ff172a6b tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:36:34.500740 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-3868ec02-563e-4668-bb01-3e82ff172a6b tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:36:34.501722 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-3868ec02-563e-4668-bb01-3e82ff172a6b tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:36:34.502453 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-3868ec02-563e-4668-bb01-3e82ff172a6b tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:36:34.502924 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-3868ec02-563e-4668-bb01-3e82ff172a6b tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:36:34.503366 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-3868ec02-563e-4668-bb01-3e82ff172a6b tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:36:34.638833 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-3868ec02-563e-4668-bb01-3e82ff172a6b tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c1beb321e44908ab987b17f7b74484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a2bf9a5a484523a700e4e6c568d4de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:36:34.647725 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-3868ec02-563e-4668-bb01-3e82ff172a6b tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] 10.222.0.15 "GET /compute/v2.1/servers/ff125cf8-e8a5-4f00-ade9-045b18ee33f4" status: 200 len: 1678 microversion: 2.1 time: 0.157757 Oct 31 12:36:34.648505 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 262/535] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:36:34 2022] GET /compute/v2.1/servers/ff125cf8-e8a5-4f00-ade9-045b18ee33f4 => generated 1678 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:36:34.827688 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-0bcd4914-20fb-4d48-bdd6-7624ea89ca2f tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:36:34.828286 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-0bcd4914-20fb-4d48-bdd6-7624ea89ca2f tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] [instance: 852e8870-b3ec-4a21-a9b5-e31a423ddd3d] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:36:34.834509 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-0bcd4914-20fb-4d48-bdd6-7624ea89ca2f tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:36:34.834976 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-0bcd4914-20fb-4d48-bdd6-7624ea89ca2f tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:36:34.835449 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-0bcd4914-20fb-4d48-bdd6-7624ea89ca2f tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:36:34.836118 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-0bcd4914-20fb-4d48-bdd6-7624ea89ca2f tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:36:34.836559 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-0bcd4914-20fb-4d48-bdd6-7624ea89ca2f tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:36:34.836964 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-0bcd4914-20fb-4d48-bdd6-7624ea89ca2f tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:36:34.967322 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-0bcd4914-20fb-4d48-bdd6-7624ea89ca2f tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:36:34.976487 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-0bcd4914-20fb-4d48-bdd6-7624ea89ca2f tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:36:34.977921 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-0bcd4914-20fb-4d48-bdd6-7624ea89ca2f tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:36:34.979123 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-0bcd4914-20fb-4d48-bdd6-7624ea89ca2f tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] 10.222.0.15 "GET /compute/v2.1/servers/852e8870-b3ec-4a21-a9b5-e31a423ddd3d" status: 200 len: 1809 microversion: 2.20 time: 0.155305 Oct 31 12:36:34.979772 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 274/536] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Oct 31 12:36:34 2022] GET /compute/v2.1/servers/852e8870-b3ec-4a21-a9b5-e31a423ddd3d => generated 1809 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 12:36:35.071717 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-fe3bb334-c72b-462b-85a3-e4e3be35098e tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:36:35.072319 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-fe3bb334-c72b-462b-85a3-e4e3be35098e tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] [instance: d7643c7c-0218-427f-876a-cf89c932dd11] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:36:35.078586 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-fe3bb334-c72b-462b-85a3-e4e3be35098e tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:36:35.078996 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-fe3bb334-c72b-462b-85a3-e4e3be35098e tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:36:35.079536 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-fe3bb334-c72b-462b-85a3-e4e3be35098e tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:36:35.080267 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-fe3bb334-c72b-462b-85a3-e4e3be35098e tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:36:35.080713 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-fe3bb334-c72b-462b-85a3-e4e3be35098e tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:36:35.081127 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-fe3bb334-c72b-462b-85a3-e4e3be35098e tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:36:35.209355 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-fe3bb334-c72b-462b-85a3-e4e3be35098e tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b76d81ee9446cf9014a2e695ef03e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae8c589d0b84ce096451a10717fc601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:36:35.216914 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-fe3bb334-c72b-462b-85a3-e4e3be35098e tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] 10.222.0.15 "GET /compute/v2.1/servers/d7643c7c-0218-427f-876a-cf89c932dd11" status: 200 len: 1266 microversion: 2.1 time: 0.149070 Oct 31 12:36:35.217470 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 263/537] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:36:35 2022] GET /compute/v2.1/servers/d7643c7c-0218-427f-876a-cf89c932dd11 => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:36:35.670455 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-5373e481-9a09-4a95-99e3-05d66f82e42a tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:36:35.671052 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-5373e481-9a09-4a95-99e3-05d66f82e42a tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] [instance: ff125cf8-e8a5-4f00-ade9-045b18ee33f4] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:36:35.676973 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-5373e481-9a09-4a95-99e3-05d66f82e42a tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:36:35.677445 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-5373e481-9a09-4a95-99e3-05d66f82e42a tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:36:35.677871 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-5373e481-9a09-4a95-99e3-05d66f82e42a tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:36:35.678549 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-5373e481-9a09-4a95-99e3-05d66f82e42a tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:36:35.678990 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-5373e481-9a09-4a95-99e3-05d66f82e42a tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:36:35.679433 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-5373e481-9a09-4a95-99e3-05d66f82e42a tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:36:35.809333 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-5373e481-9a09-4a95-99e3-05d66f82e42a tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c1beb321e44908ab987b17f7b74484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a2bf9a5a484523a700e4e6c568d4de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:36:35.817461 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-5373e481-9a09-4a95-99e3-05d66f82e42a tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] 10.222.0.15 "GET /compute/v2.1/servers/ff125cf8-e8a5-4f00-ade9-045b18ee33f4" status: 200 len: 1678 microversion: 2.1 time: 0.150804 Oct 31 12:36:35.818025 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 275/538] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:36:35 2022] GET /compute/v2.1/servers/ff125cf8-e8a5-4f00-ade9-045b18ee33f4 => generated 1678 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:36:36.005903 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-e59e76bc-2699-417a-a9c1-4a0c07985293 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:36:36.006636 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-e59e76bc-2699-417a-a9c1-4a0c07985293 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] [instance: 852e8870-b3ec-4a21-a9b5-e31a423ddd3d] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:36:36.014898 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-e59e76bc-2699-417a-a9c1-4a0c07985293 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:36:36.015409 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-e59e76bc-2699-417a-a9c1-4a0c07985293 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:36:36.015840 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-e59e76bc-2699-417a-a9c1-4a0c07985293 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:36:36.016530 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-e59e76bc-2699-417a-a9c1-4a0c07985293 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:36:36.017647 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-e59e76bc-2699-417a-a9c1-4a0c07985293 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:36:36.018065 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-e59e76bc-2699-417a-a9c1-4a0c07985293 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:36:36.150989 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-e59e76bc-2699-417a-a9c1-4a0c07985293 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:36:36.159793 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-e59e76bc-2699-417a-a9c1-4a0c07985293 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:36:36.161242 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-e59e76bc-2699-417a-a9c1-4a0c07985293 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:36:36.162393 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-e59e76bc-2699-417a-a9c1-4a0c07985293 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] 10.222.0.15 "GET /compute/v2.1/servers/852e8870-b3ec-4a21-a9b5-e31a423ddd3d" status: 200 len: 1809 microversion: 2.20 time: 0.161212 Oct 31 12:36:36.162952 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 264/539] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Oct 31 12:36:36 2022] GET /compute/v2.1/servers/852e8870-b3ec-4a21-a9b5-e31a423ddd3d => generated 1809 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 12:36:36.240577 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-f91418d7-b102-4cb9-9d7b-57d9661db8d1 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:36:36.241110 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-f91418d7-b102-4cb9-9d7b-57d9661db8d1 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] [instance: d7643c7c-0218-427f-876a-cf89c932dd11] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:36:36.247510 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-f91418d7-b102-4cb9-9d7b-57d9661db8d1 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:36:36.247989 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-f91418d7-b102-4cb9-9d7b-57d9661db8d1 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:36:36.248421 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-f91418d7-b102-4cb9-9d7b-57d9661db8d1 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:36:36.249109 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-f91418d7-b102-4cb9-9d7b-57d9661db8d1 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:36:36.249562 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-f91418d7-b102-4cb9-9d7b-57d9661db8d1 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:36:36.249982 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-f91418d7-b102-4cb9-9d7b-57d9661db8d1 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:36:36.378824 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-f91418d7-b102-4cb9-9d7b-57d9661db8d1 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b76d81ee9446cf9014a2e695ef03e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae8c589d0b84ce096451a10717fc601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:36:36.386426 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-f91418d7-b102-4cb9-9d7b-57d9661db8d1 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] 10.222.0.15 "GET /compute/v2.1/servers/d7643c7c-0218-427f-876a-cf89c932dd11" status: 200 len: 1266 microversion: 2.1 time: 0.149793 Oct 31 12:36:36.386989 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 276/540] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:36:36 2022] GET /compute/v2.1/servers/d7643c7c-0218-427f-876a-cf89c932dd11 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:36:36.842472 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-323b4094-1d3b-4b38-9131-5b6e64fa0c04 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:36:36.843187 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-323b4094-1d3b-4b38-9131-5b6e64fa0c04 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] [instance: ff125cf8-e8a5-4f00-ade9-045b18ee33f4] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:36:36.849422 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-323b4094-1d3b-4b38-9131-5b6e64fa0c04 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:36:36.849908 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-323b4094-1d3b-4b38-9131-5b6e64fa0c04 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:36:36.850439 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-323b4094-1d3b-4b38-9131-5b6e64fa0c04 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:36:36.851131 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-323b4094-1d3b-4b38-9131-5b6e64fa0c04 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:36:36.851621 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-323b4094-1d3b-4b38-9131-5b6e64fa0c04 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:36:36.852175 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-323b4094-1d3b-4b38-9131-5b6e64fa0c04 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:36:36.983422 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-323b4094-1d3b-4b38-9131-5b6e64fa0c04 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c1beb321e44908ab987b17f7b74484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a2bf9a5a484523a700e4e6c568d4de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:36:36.991301 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-323b4094-1d3b-4b38-9131-5b6e64fa0c04 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] 10.222.0.15 "GET /compute/v2.1/servers/ff125cf8-e8a5-4f00-ade9-045b18ee33f4" status: 200 len: 1655 microversion: 2.1 time: 0.153769 Oct 31 12:36:36.991858 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 265/541] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:36:36 2022] GET /compute/v2.1/servers/ff125cf8-e8a5-4f00-ade9-045b18ee33f4 => generated 1655 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:36:37.013620 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-b0a48fdd-ff6a-49d9-8534-0b786cec8965 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 12:36:37.020461 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-b0a48fdd-ff6a-49d9-8534-0b786cec8965 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:36:37.020952 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-b0a48fdd-ff6a-49d9-8534-0b786cec8965 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:36:37.021385 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-b0a48fdd-ff6a-49d9-8534-0b786cec8965 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:36:37.044321 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-b0a48fdd-ff6a-49d9-8534-0b786cec8965 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] [instance: ff125cf8-e8a5-4f00-ade9-045b18ee33f4] Going to try to start instance {{(pid=125440) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 31 12:36:37.084434 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-b0a48fdd-ff6a-49d9-8534-0b786cec8965 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] 10.222.0.15 "POST /compute/v2.1/servers/ff125cf8-e8a5-4f00-ade9-045b18ee33f4/action" status: 202 len: 0 microversion: 2.1 time: 0.074580 Oct 31 12:36:37.085025 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 277/542] 10.222.0.15 () {60 vars in 1278 bytes} [Mon Oct 31 12:36:37 2022] POST /compute/v2.1/servers/ff125cf8-e8a5-4f00-ade9-045b18ee33f4/action => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 12:36:37.093025 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-bd43cdb2-0348-48d2-bfd2-628a793bb75d tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:36:37.093644 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-bd43cdb2-0348-48d2-bfd2-628a793bb75d tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] [instance: ff125cf8-e8a5-4f00-ade9-045b18ee33f4] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:36:37.100830 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-bd43cdb2-0348-48d2-bfd2-628a793bb75d tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:36:37.101319 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-bd43cdb2-0348-48d2-bfd2-628a793bb75d tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:36:37.101960 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-bd43cdb2-0348-48d2-bfd2-628a793bb75d tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:36:37.102658 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-bd43cdb2-0348-48d2-bfd2-628a793bb75d tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:36:37.103115 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-bd43cdb2-0348-48d2-bfd2-628a793bb75d tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:36:37.103572 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-bd43cdb2-0348-48d2-bfd2-628a793bb75d tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:36:37.189064 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-0b0ac5ab-8495-442a-a6d5-62287f52eaa1 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:36:37.190236 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-0b0ac5ab-8495-442a-a6d5-62287f52eaa1 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] [instance: 852e8870-b3ec-4a21-a9b5-e31a423ddd3d] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:36:37.196533 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-0b0ac5ab-8495-442a-a6d5-62287f52eaa1 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:36:37.197012 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-0b0ac5ab-8495-442a-a6d5-62287f52eaa1 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:36:37.197439 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-0b0ac5ab-8495-442a-a6d5-62287f52eaa1 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:36:37.198135 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-0b0ac5ab-8495-442a-a6d5-62287f52eaa1 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:36:37.198585 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-0b0ac5ab-8495-442a-a6d5-62287f52eaa1 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:36:37.199005 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-0b0ac5ab-8495-442a-a6d5-62287f52eaa1 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:36:37.246309 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-bd43cdb2-0348-48d2-bfd2-628a793bb75d tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c1beb321e44908ab987b17f7b74484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a2bf9a5a484523a700e4e6c568d4de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:36:37.256399 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-bd43cdb2-0348-48d2-bfd2-628a793bb75d tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] 10.222.0.15 "GET /compute/v2.1/servers/ff125cf8-e8a5-4f00-ade9-045b18ee33f4" status: 200 len: 1664 microversion: 2.1 time: 0.167114 Oct 31 12:36:37.257054 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 266/543] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:36:37 2022] GET /compute/v2.1/servers/ff125cf8-e8a5-4f00-ade9-045b18ee33f4 => generated 1664 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:36:37.410556 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-20b645d8-fe0e-4c2f-8217-5cd9eaff452b tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:36:37.411222 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-20b645d8-fe0e-4c2f-8217-5cd9eaff452b tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] [instance: d7643c7c-0218-427f-876a-cf89c932dd11] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:36:37.417155 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-20b645d8-fe0e-4c2f-8217-5cd9eaff452b tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:36:37.417784 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-20b645d8-fe0e-4c2f-8217-5cd9eaff452b tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:36:37.418223 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-20b645d8-fe0e-4c2f-8217-5cd9eaff452b tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:36:37.418951 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-20b645d8-fe0e-4c2f-8217-5cd9eaff452b tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:36:37.419434 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-20b645d8-fe0e-4c2f-8217-5cd9eaff452b tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:36:37.419860 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-20b645d8-fe0e-4c2f-8217-5cd9eaff452b tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:36:37.442271 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-0b0ac5ab-8495-442a-a6d5-62287f52eaa1 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:36:37.455877 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-0b0ac5ab-8495-442a-a6d5-62287f52eaa1 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:36:37.458552 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-0b0ac5ab-8495-442a-a6d5-62287f52eaa1 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:36:37.460274 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-0b0ac5ab-8495-442a-a6d5-62287f52eaa1 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] 10.222.0.15 "GET /compute/v2.1/servers/852e8870-b3ec-4a21-a9b5-e31a423ddd3d" status: 200 len: 1796 microversion: 2.20 time: 0.275592 Oct 31 12:36:37.461342 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 278/544] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Oct 31 12:36:37 2022] GET /compute/v2.1/servers/852e8870-b3ec-4a21-a9b5-e31a423ddd3d => generated 1796 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 12:36:37.565481 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-20b645d8-fe0e-4c2f-8217-5cd9eaff452b tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b76d81ee9446cf9014a2e695ef03e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae8c589d0b84ce096451a10717fc601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:36:37.574467 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-20b645d8-fe0e-4c2f-8217-5cd9eaff452b tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] 10.222.0.15 "GET /compute/v2.1/servers/d7643c7c-0218-427f-876a-cf89c932dd11" status: 200 len: 1266 microversion: 2.1 time: 0.168409 Oct 31 12:36:37.575212 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 267/545] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:36:37 2022] GET /compute/v2.1/servers/d7643c7c-0218-427f-876a-cf89c932dd11 => generated 1266 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 12:36:37.613540 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [req-e7ab2b22-10e4-4663-b110-cc6c31a668ed req-1d0762d5-f832-47c8-9240-e7ff6be5a29b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7643c7c-0218-427f-876a-cf89c932dd11", "name": "network-vif-plugged", "status": "completed", "tag": "76712093-6a65-4766-8171-79fff21ef102"}]} {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 12:36:37.625234 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [req-e7ab2b22-10e4-4663-b110-cc6c31a668ed req-1d0762d5-f832-47c8-9240-e7ff6be5a29b service nova] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:36:37.625833 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [req-e7ab2b22-10e4-4663-b110-cc6c31a668ed req-1d0762d5-f832-47c8-9240-e7ff6be5a29b service nova] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:36:37.628691 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [req-e7ab2b22-10e4-4663-b110-cc6c31a668ed req-1d0762d5-f832-47c8-9240-e7ff6be5a29b service nova] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:36:37.640937 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.compute.server_external_events [req-e7ab2b22-10e4-4663-b110-cc6c31a668ed req-1d0762d5-f832-47c8-9240-e7ff6be5a29b service nova] Creating event network-vif-plugged:76712093-6a65-4766-8171-79fff21ef102 for instance d7643c7c-0218-427f-876a-cf89c932dd11 on hv-cinder-79617 Oct 31 12:36:37.647084 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [req-e7ab2b22-10e4-4663-b110-cc6c31a668ed req-1d0762d5-f832-47c8-9240-e7ff6be5a29b service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038308 Oct 31 12:36:37.647836 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 279/546] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Oct 31 12:36:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 12:36:38.279697 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-5cb2d537-5503-4365-b094-5466479ed3d1 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:36:38.280305 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-5cb2d537-5503-4365-b094-5466479ed3d1 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] [instance: ff125cf8-e8a5-4f00-ade9-045b18ee33f4] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:36:38.287214 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-5cb2d537-5503-4365-b094-5466479ed3d1 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:36:38.287694 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-5cb2d537-5503-4365-b094-5466479ed3d1 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:36:38.288125 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-5cb2d537-5503-4365-b094-5466479ed3d1 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:36:38.288808 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-5cb2d537-5503-4365-b094-5466479ed3d1 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:36:38.289278 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-5cb2d537-5503-4365-b094-5466479ed3d1 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:36:38.289679 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-5cb2d537-5503-4365-b094-5466479ed3d1 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:36:38.423809 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-5cb2d537-5503-4365-b094-5466479ed3d1 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c1beb321e44908ab987b17f7b74484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a2bf9a5a484523a700e4e6c568d4de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:36:38.431625 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-5cb2d537-5503-4365-b094-5466479ed3d1 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] 10.222.0.15 "GET /compute/v2.1/servers/ff125cf8-e8a5-4f00-ade9-045b18ee33f4" status: 200 len: 1664 microversion: 2.1 time: 0.155704 Oct 31 12:36:38.432174 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 268/547] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:36:38 2022] GET /compute/v2.1/servers/ff125cf8-e8a5-4f00-ade9-045b18ee33f4 => generated 1664 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:36:38.599547 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-ca6125eb-e076-4089-9504-aed94ea7a1ad tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:36:38.600210 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-ca6125eb-e076-4089-9504-aed94ea7a1ad tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] [instance: d7643c7c-0218-427f-876a-cf89c932dd11] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:36:38.606304 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-ca6125eb-e076-4089-9504-aed94ea7a1ad tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:36:38.606779 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-ca6125eb-e076-4089-9504-aed94ea7a1ad tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:36:38.607237 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-ca6125eb-e076-4089-9504-aed94ea7a1ad tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:36:38.607913 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-ca6125eb-e076-4089-9504-aed94ea7a1ad tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:36:38.608361 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-ca6125eb-e076-4089-9504-aed94ea7a1ad tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:36:38.608777 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-ca6125eb-e076-4089-9504-aed94ea7a1ad tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:36:38.949848 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-ca6125eb-e076-4089-9504-aed94ea7a1ad tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b76d81ee9446cf9014a2e695ef03e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae8c589d0b84ce096451a10717fc601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:36:38.957655 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-ca6125eb-e076-4089-9504-aed94ea7a1ad tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] 10.222.0.15 "GET /compute/v2.1/servers/d7643c7c-0218-427f-876a-cf89c932dd11" status: 200 len: 1266 microversion: 2.1 time: 0.363086 Oct 31 12:36:38.958216 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 280/548] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:36:38 2022] GET /compute/v2.1/servers/d7643c7c-0218-427f-876a-cf89c932dd11 => generated 1266 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 12:36:39.250829 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-748e7408-a5ef-49c1-b5b3-1845a2690d36 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:36:39.251554 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-748e7408-a5ef-49c1-b5b3-1845a2690d36 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] [instance: d1bb54dd-d9ba-4789-b2a0-c91a292cb466] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:36:39.257445 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-748e7408-a5ef-49c1-b5b3-1845a2690d36 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:36:39.257915 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-748e7408-a5ef-49c1-b5b3-1845a2690d36 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:36:39.258339 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-748e7408-a5ef-49c1-b5b3-1845a2690d36 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:36:39.259044 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-748e7408-a5ef-49c1-b5b3-1845a2690d36 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:36:39.259514 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-748e7408-a5ef-49c1-b5b3-1845a2690d36 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:36:39.259931 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-748e7408-a5ef-49c1-b5b3-1845a2690d36 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:36:39.284386 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-748e7408-a5ef-49c1-b5b3-1845a2690d36 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] 10.222.0.15 "GET /compute/v2.1/servers/d1bb54dd-d9ba-4789-b2a0-c91a292cb466/ips" status: 200 len: 151 microversion: 2.1 time: 0.037737 Oct 31 12:36:39.285014 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 269/549] 10.222.0.15 () {58 vars in 1248 bytes} [Mon Oct 31 12:36:39 2022] GET /compute/v2.1/servers/d1bb54dd-d9ba-4789-b2a0-c91a292cb466/ips => generated 151 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 12:36:39.297340 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-ba632c19-c0d1-456f-a824-3b0ef9267bc9 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "22121858-e3c7-41eb-ac09-1abddd01c0df"}} {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 12:36:39.299744 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-ba632c19-c0d1-456f-a824-3b0ef9267bc9 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] [instance: d1bb54dd-d9ba-4789-b2a0-c91a292cb466] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:36:39.305736 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-ba632c19-c0d1-456f-a824-3b0ef9267bc9 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:36:39.306215 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-ba632c19-c0d1-456f-a824-3b0ef9267bc9 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:36:39.306644 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-ba632c19-c0d1-456f-a824-3b0ef9267bc9 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:36:39.307373 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-ba632c19-c0d1-456f-a824-3b0ef9267bc9 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:36:39.307819 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-ba632c19-c0d1-456f-a824-3b0ef9267bc9 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:36:39.308234 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-ba632c19-c0d1-456f-a824-3b0ef9267bc9 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:36:39.387327 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.wsgi [None req-ba632c19-c0d1-456f-a824-3b0ef9267bc9 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] HTTP exception thrown: Invalid volume: volume 22121858-e3c7-41eb-ac09-1abddd01c0df is already attached to instances: 9906becc-a42b-4b4c-855a-450915f7a3f8 Oct 31 12:36:39.389429 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-ba632c19-c0d1-456f-a824-3b0ef9267bc9 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Request method failure captured: Oct 31 12:36:39.389429 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: request: POST /compute/v2.1/servers/d1bb54dd-d9ba-4789-b2a0-c91a292cb466/os-volume_attachments HTTP/1.1 Oct 31 12:36:39.389429 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: Accept: application/json Oct 31 12:36:39.389429 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: Accept-Encoding: identity Oct 31 12:36:39.389429 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: Connection: close Oct 31 12:36:39.389429 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: Content-Length: 74 Oct 31 12:36:39.389429 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: Content-Type: application/json Oct 31 12:36:39.389429 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: Host: 10.222.0.15 Oct 31 12:36:39.389429 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: Openstack-System-Scope: None Oct 31 12:36:39.389429 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: User-Agent: python-urllib3/1.26.12 Oct 31 12:36:39.389429 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Auth-Token: gAAAAABjX8B3Et2KM1ogPCTGs64pc6xLyfMw6yL0VTQe6oSz3vb_t3Nol1y36tJUXD6PegbQ8pwIEwo4L666w1x-Z79gwUGFQzXyfvvOjyyVZQL72gtR1ISe3h09afCWKpljHfxhI1Y-A2JuAkXEjCcgQXdDq6Gsj4TA71_GeBFeeItX_0KrPQA Oct 31 12:36:39.389429 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Domain-Id: None Oct 31 12:36:39.389429 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Domain-Name: None Oct 31 12:36:39.389429 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Identity-Status: Confirmed Oct 31 12:36:39.389429 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Is-Admin-Project: True Oct 31 12:36:39.389429 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Project-Domain-Id: default Oct 31 12:36:39.389429 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Project-Domain-Name: Default Oct 31 12:36:39.389429 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Project-Id: bfbc3a46f12942299b99cdd20c989e1f Oct 31 12:36:39.389429 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Project-Name: tempest-AttachVolumeNegativeTest-1648165012 Oct 31 12:36:39.389429 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Role: reader,member Oct 31 12:36:39.389429 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Roles: reader,member Oct 31 12:36:39.390936 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/bfbc3a46f12942299b99cdd20c989e1f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_bfbc3a46f12942299b99cdd20c989e1f", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/bfbc3a46f12942299b99cdd20c989e1f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/bfbc3a46f12942299b99cdd20c989e1f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Oct 31 12:36:39.390936 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Tenant: tempest-AttachVolumeNegativeTest-1648165012 Oct 31 12:36:39.390936 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Tenant-Id: bfbc3a46f12942299b99cdd20c989e1f Oct 31 12:36:39.390936 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1648165012 Oct 31 12:36:39.390936 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-User: tempest-AttachVolumeNegativeTest-1648165012-project Oct 31 12:36:39.390936 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-User-Domain-Id: default Oct 31 12:36:39.390936 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-User-Domain-Name: Default Oct 31 12:36:39.390936 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-User-Id: b2c03f0365ee4a26b8c076ae365325b2 Oct 31 12:36:39.390936 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-User-Name: tempest-AttachVolumeNegativeTest-1648165012-project Oct 31 12:36:39.390936 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: Oct 31 12:36:39.390936 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: {"volumeAttachment": {"volumeId": "22121858-e3c7-41eb-ac09-1abddd01c0df"}} Oct 31 12:36:39.390936 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: method: > Oct 31 12:36:39.392405 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: exception: Invalid volume: volume 22121858-e3c7-41eb-ac09-1abddd01c0df is already attached to instances: 9906becc-a42b-4b4c-855a-450915f7a3f8 Oct 31 12:36:39.392405 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: action_args: {'server_id': 'd1bb54dd-d9ba-4789-b2a0-c91a292cb466', 'body': {'volumeAttachment': {'volumeId': '22121858-e3c7-41eb-ac09-1abddd01c0df'}}} Oct 31 12:36:39.392405 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 12:36:39.392405 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 12:36:39.392405 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 31 12:36:39.392405 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 31 12:36:39.392405 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 31 12:36:39.392405 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 31 12:36:39.392405 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 31 12:36:39.392405 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 31 12:36:39.392405 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 31 12:36:39.392405 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 31 12:36:39.392405 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 31 12:36:39.392405 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 31 12:36:39.392405 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 22121858-e3c7-41eb-ac09-1abddd01c0df is already attached to instances: 9906becc-a42b-4b4c-855a-450915f7a3f8 Oct 31 12:36:39.392405 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Oct 31 12:36:39.392405 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 12:36:39.392405 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Oct 31 12:36:39.392405 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 12:36:39.393794 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 12:36:39.393794 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 12:36:39.393794 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 12:36:39.393794 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 12:36:39.393794 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 12:36:39.393794 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 12:36:39.393794 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 12:36:39.393794 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 12:36:39.393794 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 12:36:39.393794 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 12:36:39.393794 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 12:36:39.393794 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 12:36:39.393794 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 31 12:36:39.393794 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 31 12:36:39.393794 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 22121858-e3c7-41eb-ac09-1abddd01c0df is already attached to instances: 9906becc-a42b-4b4c-855a-450915f7a3f8 Oct 31 12:36:39.393794 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Oct 31 12:36:39.393794 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 12:36:39.393794 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Oct 31 12:36:39.393794 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 12:36:39.393794 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 12:36:39.395442 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 12:36:39.395442 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 12:36:39.395442 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 12:36:39.395442 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 22121858-e3c7-41eb-ac09-1abddd01c0df is already attached to instances: 9906becc-a42b-4b4c-855a-450915f7a3f8 Oct 31 12:36:39.395442 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Oct 31 12:36:39.395442 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-ba632c19-c0d1-456f-a824-3b0ef9267bc9 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Returning 400 to user: Invalid volume: volume 22121858-e3c7-41eb-ac09-1abddd01c0df is already attached to instances: 9906becc-a42b-4b4c-855a-450915f7a3f8 {{(pid=125440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 12:36:39.395442 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-ba632c19-c0d1-456f-a824-3b0ef9267bc9 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] 10.222.0.15 "POST /compute/v2.1/servers/d1bb54dd-d9ba-4789-b2a0-c91a292cb466/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.097422 Oct 31 12:36:39.395442 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 281/550] 10.222.0.15 () {60 vars in 1323 bytes} [Mon Oct 31 12:36:39 2022] POST /compute/v2.1/servers/d1bb54dd-d9ba-4789-b2a0-c91a292cb466/os-volume_attachments => generated 174 bytes in 99 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 31 12:36:39.401100 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-8e3015ec-f3da-4602-800c-9b8a0f9e538a tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:36:39.401602 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-8e3015ec-f3da-4602-800c-9b8a0f9e538a tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] [instance: d1bb54dd-d9ba-4789-b2a0-c91a292cb466] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:36:39.408635 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-8e3015ec-f3da-4602-800c-9b8a0f9e538a tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:36:39.409112 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-8e3015ec-f3da-4602-800c-9b8a0f9e538a tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:36:39.409537 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-8e3015ec-f3da-4602-800c-9b8a0f9e538a tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:36:39.410225 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-8e3015ec-f3da-4602-800c-9b8a0f9e538a tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:36:39.410675 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-8e3015ec-f3da-4602-800c-9b8a0f9e538a tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:36:39.411100 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-8e3015ec-f3da-4602-800c-9b8a0f9e538a tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:36:39.425682 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG dbcounter [-] [125441] Writing DB stats nova_cell1:SELECT=100 {{(pid=125441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:36:39.436236 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-8e3015ec-f3da-4602-800c-9b8a0f9e538a tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] [instance: d1bb54dd-d9ba-4789-b2a0-c91a292cb466] Going to try to terminate instance {{(pid=125441) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 12:36:39.455955 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-e5cf402a-aab3-4e2f-a80d-7e3041ed3c79 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:36:39.456552 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-e5cf402a-aab3-4e2f-a80d-7e3041ed3c79 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] [instance: ff125cf8-e8a5-4f00-ade9-045b18ee33f4] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:36:39.463073 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-e5cf402a-aab3-4e2f-a80d-7e3041ed3c79 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:36:39.463576 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-e5cf402a-aab3-4e2f-a80d-7e3041ed3c79 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:36:39.464000 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-e5cf402a-aab3-4e2f-a80d-7e3041ed3c79 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:36:39.464685 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-e5cf402a-aab3-4e2f-a80d-7e3041ed3c79 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:36:39.465127 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-e5cf402a-aab3-4e2f-a80d-7e3041ed3c79 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:36:39.465536 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-e5cf402a-aab3-4e2f-a80d-7e3041ed3c79 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:36:39.513737 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-8e3015ec-f3da-4602-800c-9b8a0f9e538a tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] 10.222.0.15 "DELETE /compute/v2.1/servers/d1bb54dd-d9ba-4789-b2a0-c91a292cb466" status: 204 len: 0 microversion: 2.1 time: 0.116074 Oct 31 12:36:39.514336 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 270/551] 10.222.0.15 () {58 vars in 1239 bytes} [Mon Oct 31 12:36:39 2022] DELETE /compute/v2.1/servers/d1bb54dd-d9ba-4789-b2a0-c91a292cb466 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 12:36:39.523894 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-91b25ff2-3d56-4bcc-976d-76e528a46154 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:36:39.524606 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-91b25ff2-3d56-4bcc-976d-76e528a46154 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] [instance: d1bb54dd-d9ba-4789-b2a0-c91a292cb466] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:36:39.530486 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-91b25ff2-3d56-4bcc-976d-76e528a46154 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:36:39.530969 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-91b25ff2-3d56-4bcc-976d-76e528a46154 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:36:39.531464 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-91b25ff2-3d56-4bcc-976d-76e528a46154 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:36:39.532156 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-91b25ff2-3d56-4bcc-976d-76e528a46154 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:36:39.532662 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-91b25ff2-3d56-4bcc-976d-76e528a46154 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:36:39.533076 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-91b25ff2-3d56-4bcc-976d-76e528a46154 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:36:39.604868 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-e5cf402a-aab3-4e2f-a80d-7e3041ed3c79 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c1beb321e44908ab987b17f7b74484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a2bf9a5a484523a700e4e6c568d4de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:36:39.613109 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-e5cf402a-aab3-4e2f-a80d-7e3041ed3c79 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] 10.222.0.15 "GET /compute/v2.1/servers/ff125cf8-e8a5-4f00-ade9-045b18ee33f4" status: 200 len: 1668 microversion: 2.1 time: 0.161480 Oct 31 12:36:39.613679 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 282/552] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:36:39 2022] GET /compute/v2.1/servers/ff125cf8-e8a5-4f00-ade9-045b18ee33f4 => generated 1668 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 12:36:39.663566 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-91b25ff2-3d56-4bcc-976d-76e528a46154 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c03f0365ee4a26b8c076ae365325b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfbc3a46f12942299b99cdd20c989e1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:36:39.671294 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-91b25ff2-3d56-4bcc-976d-76e528a46154 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] 10.222.0.15 "GET /compute/v2.1/servers/d1bb54dd-d9ba-4789-b2a0-c91a292cb466" status: 200 len: 1681 microversion: 2.1 time: 0.151762 Oct 31 12:36:39.671868 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 271/553] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:36:39 2022] GET /compute/v2.1/servers/d1bb54dd-d9ba-4789-b2a0-c91a292cb466 => generated 1681 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 12:36:39.980938 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-15b32eec-f8cd-4529-82b8-edd7b98205b5 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:36:39.981571 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-15b32eec-f8cd-4529-82b8-edd7b98205b5 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] [instance: d7643c7c-0218-427f-876a-cf89c932dd11] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:36:39.987548 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-15b32eec-f8cd-4529-82b8-edd7b98205b5 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:36:39.988027 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-15b32eec-f8cd-4529-82b8-edd7b98205b5 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:36:39.988451 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-15b32eec-f8cd-4529-82b8-edd7b98205b5 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:36:39.989127 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-15b32eec-f8cd-4529-82b8-edd7b98205b5 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:36:39.989571 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-15b32eec-f8cd-4529-82b8-edd7b98205b5 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:36:39.989985 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-15b32eec-f8cd-4529-82b8-edd7b98205b5 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:36:40.124718 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-15b32eec-f8cd-4529-82b8-edd7b98205b5 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b76d81ee9446cf9014a2e695ef03e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae8c589d0b84ce096451a10717fc601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:36:40.132932 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-15b32eec-f8cd-4529-82b8-edd7b98205b5 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] 10.222.0.15 "GET /compute/v2.1/servers/d7643c7c-0218-427f-876a-cf89c932dd11" status: 200 len: 1266 microversion: 2.1 time: 0.155972 Oct 31 12:36:40.133500 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 283/554] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:36:39 2022] GET /compute/v2.1/servers/d7643c7c-0218-427f-876a-cf89c932dd11 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:36:40.695738 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-ea6d88eb-c9b9-4e9a-ae05-558077035298 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:36:40.696349 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-ea6d88eb-c9b9-4e9a-ae05-558077035298 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] [instance: d1bb54dd-d9ba-4789-b2a0-c91a292cb466] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:36:40.702729 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-ea6d88eb-c9b9-4e9a-ae05-558077035298 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:36:40.703232 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-ea6d88eb-c9b9-4e9a-ae05-558077035298 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:36:40.703666 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-ea6d88eb-c9b9-4e9a-ae05-558077035298 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:36:40.704343 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-ea6d88eb-c9b9-4e9a-ae05-558077035298 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:36:40.704890 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-ea6d88eb-c9b9-4e9a-ae05-558077035298 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:36:40.705311 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-ea6d88eb-c9b9-4e9a-ae05-558077035298 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:36:40.831335 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-ea6d88eb-c9b9-4e9a-ae05-558077035298 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c03f0365ee4a26b8c076ae365325b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfbc3a46f12942299b99cdd20c989e1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:36:40.838964 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-ea6d88eb-c9b9-4e9a-ae05-558077035298 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] 10.222.0.15 "GET /compute/v2.1/servers/d1bb54dd-d9ba-4789-b2a0-c91a292cb466" status: 200 len: 1681 microversion: 2.1 time: 0.147135 Oct 31 12:36:40.839555 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 272/555] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:36:40 2022] GET /compute/v2.1/servers/d1bb54dd-d9ba-4789-b2a0-c91a292cb466 => generated 1681 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:36:41.156222 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-1275b127-2196-48f1-b555-03ec1d94b4e2 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:36:41.156831 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-1275b127-2196-48f1-b555-03ec1d94b4e2 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] [instance: d7643c7c-0218-427f-876a-cf89c932dd11] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:36:41.164713 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-1275b127-2196-48f1-b555-03ec1d94b4e2 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:36:41.165195 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-1275b127-2196-48f1-b555-03ec1d94b4e2 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:36:41.165744 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-1275b127-2196-48f1-b555-03ec1d94b4e2 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:36:41.166437 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-1275b127-2196-48f1-b555-03ec1d94b4e2 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:36:41.166882 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-1275b127-2196-48f1-b555-03ec1d94b4e2 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:36:41.167331 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-1275b127-2196-48f1-b555-03ec1d94b4e2 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:36:41.302036 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-1275b127-2196-48f1-b555-03ec1d94b4e2 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b76d81ee9446cf9014a2e695ef03e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae8c589d0b84ce096451a10717fc601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:36:41.309579 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-1275b127-2196-48f1-b555-03ec1d94b4e2 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] 10.222.0.15 "GET /compute/v2.1/servers/d7643c7c-0218-427f-876a-cf89c932dd11" status: 200 len: 1266 microversion: 2.1 time: 0.157173 Oct 31 12:36:41.310135 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 284/556] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:36:41 2022] GET /compute/v2.1/servers/d7643c7c-0218-427f-876a-cf89c932dd11 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:36:41.862235 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-89be5343-6098-4820-b9b6-19b9d9d512fc tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:36:41.862847 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-89be5343-6098-4820-b9b6-19b9d9d512fc tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] [instance: d1bb54dd-d9ba-4789-b2a0-c91a292cb466] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:36:41.869281 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-89be5343-6098-4820-b9b6-19b9d9d512fc tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:36:41.869766 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-89be5343-6098-4820-b9b6-19b9d9d512fc tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:36:41.870195 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-89be5343-6098-4820-b9b6-19b9d9d512fc tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:36:41.870881 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-89be5343-6098-4820-b9b6-19b9d9d512fc tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:36:41.871386 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-89be5343-6098-4820-b9b6-19b9d9d512fc tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:36:41.871803 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-89be5343-6098-4820-b9b6-19b9d9d512fc tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:36:42.007295 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-89be5343-6098-4820-b9b6-19b9d9d512fc tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c03f0365ee4a26b8c076ae365325b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfbc3a46f12942299b99cdd20c989e1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:36:42.014990 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-89be5343-6098-4820-b9b6-19b9d9d512fc tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] 10.222.0.15 "GET /compute/v2.1/servers/d1bb54dd-d9ba-4789-b2a0-c91a292cb466" status: 200 len: 1681 microversion: 2.1 time: 0.156581 Oct 31 12:36:42.015596 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 273/557] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:36:41 2022] GET /compute/v2.1/servers/d1bb54dd-d9ba-4789-b2a0-c91a292cb466 => generated 1681 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:36:42.332997 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-583433fe-84db-4d67-920e-495377ec22bc tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:36:42.333763 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-583433fe-84db-4d67-920e-495377ec22bc tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] [instance: d7643c7c-0218-427f-876a-cf89c932dd11] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:36:42.340449 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-583433fe-84db-4d67-920e-495377ec22bc tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:36:42.340765 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-583433fe-84db-4d67-920e-495377ec22bc tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:36:42.341193 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-583433fe-84db-4d67-920e-495377ec22bc tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:36:42.341936 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-583433fe-84db-4d67-920e-495377ec22bc tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:36:42.342331 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-583433fe-84db-4d67-920e-495377ec22bc tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:36:42.343145 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-583433fe-84db-4d67-920e-495377ec22bc tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:36:42.477204 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-e9ec52c1-17d7-417b-a6de-38048d785b71 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "88e52680-9a7e-4b34-8457-f009b875caee"}} {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 12:36:42.479927 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-e9ec52c1-17d7-417b-a6de-38048d785b71 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] [instance: ee260508-cdfb-468d-9ff4-df06cc3bdadf] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:36:42.482008 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG dbcounter [-] [125441] Writing DB stats nova_api:SELECT=75,nova_api:UPDATE=1 {{(pid=125441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:36:42.487861 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-e9ec52c1-17d7-417b-a6de-38048d785b71 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:36:42.488375 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-e9ec52c1-17d7-417b-a6de-38048d785b71 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:36:42.488818 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-e9ec52c1-17d7-417b-a6de-38048d785b71 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:36:42.489519 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-e9ec52c1-17d7-417b-a6de-38048d785b71 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:36:42.489960 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-e9ec52c1-17d7-417b-a6de-38048d785b71 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:36:42.490379 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-e9ec52c1-17d7-417b-a6de-38048d785b71 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:36:42.571014 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-583433fe-84db-4d67-920e-495377ec22bc tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b76d81ee9446cf9014a2e695ef03e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae8c589d0b84ce096451a10717fc601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:36:42.579199 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-583433fe-84db-4d67-920e-495377ec22bc tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] 10.222.0.15 "GET /compute/v2.1/servers/d7643c7c-0218-427f-876a-cf89c932dd11" status: 200 len: 1452 microversion: 2.1 time: 0.250344 Oct 31 12:36:42.580411 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 285/558] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:36:42 2022] GET /compute/v2.1/servers/d7643c7c-0218-427f-876a-cf89c932dd11 => generated 1452 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 12:36:42.603538 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-d5bbd26e-41ec-47f1-a61a-2056e5bf3d0b tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:36:42.604379 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-d5bbd26e-41ec-47f1-a61a-2056e5bf3d0b tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] [instance: d7643c7c-0218-427f-876a-cf89c932dd11] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:36:42.610469 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-d5bbd26e-41ec-47f1-a61a-2056e5bf3d0b tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:36:42.611916 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-d5bbd26e-41ec-47f1-a61a-2056e5bf3d0b tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:36:42.612027 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-d5bbd26e-41ec-47f1-a61a-2056e5bf3d0b tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:36:42.612715 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-d5bbd26e-41ec-47f1-a61a-2056e5bf3d0b tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:36:42.613336 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-d5bbd26e-41ec-47f1-a61a-2056e5bf3d0b tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:36:42.613907 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-d5bbd26e-41ec-47f1-a61a-2056e5bf3d0b tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:36:42.774213 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-e9ec52c1-17d7-417b-a6de-38048d785b71 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] 10.222.0.15 "POST /compute/v2.1/servers/ee260508-cdfb-468d-9ff4-df06cc3bdadf/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.300711 Oct 31 12:36:42.775097 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 274/559] 10.222.0.15 () {60 vars in 1323 bytes} [Mon Oct 31 12:36:42 2022] POST /compute/v2.1/servers/ee260508-cdfb-468d-9ff4-df06cc3bdadf/os-volume_attachments => generated 194 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 12:36:42.864293 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-d5bbd26e-41ec-47f1-a61a-2056e5bf3d0b tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b76d81ee9446cf9014a2e695ef03e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae8c589d0b84ce096451a10717fc601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:36:42.873795 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-d5bbd26e-41ec-47f1-a61a-2056e5bf3d0b tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] 10.222.0.15 "GET /compute/v2.1/servers/d7643c7c-0218-427f-876a-cf89c932dd11" status: 200 len: 1452 microversion: 2.1 time: 0.273976 Oct 31 12:36:42.879017 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 286/560] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:36:42 2022] GET /compute/v2.1/servers/d7643c7c-0218-427f-876a-cf89c932dd11 => generated 1452 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 12:36:42.911784 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [req-bdc9f186-5053-4051-b3b3-4c462d203fae req-ef17f277-a381-4fab-90a4-7147eb7d8255 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1bb54dd-d9ba-4789-b2a0-c91a292cb466", "name": "network-vif-deleted", "tag": "2bcb3176-596a-4211-910f-3e00167f2763"}]} {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 12:36:42.938016 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [req-bdc9f186-5053-4051-b3b3-4c462d203fae req-ef17f277-a381-4fab-90a4-7147eb7d8255 service nova] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:36:42.938687 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [req-bdc9f186-5053-4051-b3b3-4c462d203fae req-ef17f277-a381-4fab-90a4-7147eb7d8255 service nova] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:36:42.939720 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [req-bdc9f186-5053-4051-b3b3-4c462d203fae req-ef17f277-a381-4fab-90a4-7147eb7d8255 service nova] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:36:42.952136 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.compute.server_external_events [req-bdc9f186-5053-4051-b3b3-4c462d203fae req-ef17f277-a381-4fab-90a4-7147eb7d8255 service nova] Creating event network-vif-deleted:2bcb3176-596a-4211-910f-3e00167f2763 for instance d1bb54dd-d9ba-4789-b2a0-c91a292cb466 on hv-cinder-79617 Oct 31 12:36:42.959642 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [req-bdc9f186-5053-4051-b3b3-4c462d203fae req-ef17f277-a381-4fab-90a4-7147eb7d8255 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052920 Oct 31 12:36:42.963273 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 275/561] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Oct 31 12:36:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 12:36:43.039735 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-d29a746e-7d14-49ce-97cb-fbedf55ff80a tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:36:43.040348 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-d29a746e-7d14-49ce-97cb-fbedf55ff80a tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] [instance: d1bb54dd-d9ba-4789-b2a0-c91a292cb466] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:36:43.046592 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-d29a746e-7d14-49ce-97cb-fbedf55ff80a tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:36:43.047081 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-d29a746e-7d14-49ce-97cb-fbedf55ff80a tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:36:43.047600 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-d29a746e-7d14-49ce-97cb-fbedf55ff80a tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:36:43.048301 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-d29a746e-7d14-49ce-97cb-fbedf55ff80a tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:36:43.049619 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-d29a746e-7d14-49ce-97cb-fbedf55ff80a tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:36:43.050045 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-d29a746e-7d14-49ce-97cb-fbedf55ff80a tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:36:43.077513 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG dbcounter [-] [125440] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:36:43.092130 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-d29a746e-7d14-49ce-97cb-fbedf55ff80a tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:36:43.092867 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-d29a746e-7d14-49ce-97cb-fbedf55ff80a tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:36:43.093592 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-d29a746e-7d14-49ce-97cb-fbedf55ff80a tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:36:43.093927 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.objects.instance [None req-d29a746e-7d14-49ce-97cb-fbedf55ff80a tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lazy-loading 'fault' on Instance uuid d1bb54dd-d9ba-4789-b2a0-c91a292cb466 {{(pid=125440) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 12:36:43.148715 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-d29a746e-7d14-49ce-97cb-fbedf55ff80a tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c03f0365ee4a26b8c076ae365325b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfbc3a46f12942299b99cdd20c989e1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:36:43.156549 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-d29a746e-7d14-49ce-97cb-fbedf55ff80a tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] 10.222.0.15 "GET /compute/v2.1/servers/d1bb54dd-d9ba-4789-b2a0-c91a292cb466" status: 200 len: 1330 microversion: 2.1 time: 0.120608 Oct 31 12:36:43.157357 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 287/562] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:36:43 2022] GET /compute/v2.1/servers/d1bb54dd-d9ba-4789-b2a0-c91a292cb466 => generated 1330 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:36:44.181222 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-be24afd4-f931-44bd-b439-b5d2f06e904b tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:36:44.181936 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-be24afd4-f931-44bd-b439-b5d2f06e904b tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] [instance: d1bb54dd-d9ba-4789-b2a0-c91a292cb466] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:36:44.194188 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-be24afd4-f931-44bd-b439-b5d2f06e904b tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:36:44.194672 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-be24afd4-f931-44bd-b439-b5d2f06e904b tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:36:44.195114 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-be24afd4-f931-44bd-b439-b5d2f06e904b tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:36:44.200046 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-be24afd4-f931-44bd-b439-b5d2f06e904b tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:36:44.200793 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-be24afd4-f931-44bd-b439-b5d2f06e904b tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:36:44.204074 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-be24afd4-f931-44bd-b439-b5d2f06e904b tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:36:44.223959 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.wsgi [None req-be24afd4-f931-44bd-b439-b5d2f06e904b tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] HTTP exception thrown: Instance d1bb54dd-d9ba-4789-b2a0-c91a292cb466 could not be found. Oct 31 12:36:44.225943 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-be24afd4-f931-44bd-b439-b5d2f06e904b tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Request method failure captured: Oct 31 12:36:44.225943 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: request: GET /compute/v2.1/servers/d1bb54dd-d9ba-4789-b2a0-c91a292cb466 HTTP/1.1 Oct 31 12:36:44.225943 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: Accept: application/json Oct 31 12:36:44.225943 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: Accept-Encoding: identity Oct 31 12:36:44.225943 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: Connection: close Oct 31 12:36:44.225943 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: Content-Length: 0 Oct 31 12:36:44.225943 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: Content-Type: application/json Oct 31 12:36:44.225943 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: Host: 10.222.0.15 Oct 31 12:36:44.225943 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: Openstack-System-Scope: None Oct 31 12:36:44.225943 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: User-Agent: python-urllib3/1.26.12 Oct 31 12:36:44.225943 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Auth-Token: gAAAAABjX8B3Et2KM1ogPCTGs64pc6xLyfMw6yL0VTQe6oSz3vb_t3Nol1y36tJUXD6PegbQ8pwIEwo4L666w1x-Z79gwUGFQzXyfvvOjyyVZQL72gtR1ISe3h09afCWKpljHfxhI1Y-A2JuAkXEjCcgQXdDq6Gsj4TA71_GeBFeeItX_0KrPQA Oct 31 12:36:44.225943 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Domain-Id: None Oct 31 12:36:44.225943 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Domain-Name: None Oct 31 12:36:44.225943 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Identity-Status: Confirmed Oct 31 12:36:44.225943 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Is-Admin-Project: True Oct 31 12:36:44.225943 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Project-Domain-Id: default Oct 31 12:36:44.225943 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Project-Domain-Name: Default Oct 31 12:36:44.225943 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Project-Id: bfbc3a46f12942299b99cdd20c989e1f Oct 31 12:36:44.225943 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Project-Name: tempest-AttachVolumeNegativeTest-1648165012 Oct 31 12:36:44.225943 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Role: reader,member Oct 31 12:36:44.225943 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Roles: reader,member Oct 31 12:36:44.227550 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/bfbc3a46f12942299b99cdd20c989e1f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_bfbc3a46f12942299b99cdd20c989e1f", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/bfbc3a46f12942299b99cdd20c989e1f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/bfbc3a46f12942299b99cdd20c989e1f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Oct 31 12:36:44.227550 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Tenant: tempest-AttachVolumeNegativeTest-1648165012 Oct 31 12:36:44.227550 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Tenant-Id: bfbc3a46f12942299b99cdd20c989e1f Oct 31 12:36:44.227550 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1648165012 Oct 31 12:36:44.227550 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-User: tempest-AttachVolumeNegativeTest-1648165012-project Oct 31 12:36:44.227550 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-User-Domain-Id: default Oct 31 12:36:44.227550 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-User-Domain-Name: Default Oct 31 12:36:44.227550 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-User-Id: b2c03f0365ee4a26b8c076ae365325b2 Oct 31 12:36:44.227550 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-User-Name: tempest-AttachVolumeNegativeTest-1648165012-project Oct 31 12:36:44.227550 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: method: > Oct 31 12:36:44.227550 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: exception: Instance d1bb54dd-d9ba-4789-b2a0-c91a292cb466 could not be found. Oct 31 12:36:44.227550 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: action_args: {'id': 'd1bb54dd-d9ba-4789-b2a0-c91a292cb466'} Oct 31 12:36:44.228426 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 12:36:44.228426 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 12:36:44.228426 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 12:36:44.228426 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 12:36:44.228426 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 12:36:44.228426 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 12:36:44.228426 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 12:36:44.228426 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 12:36:44.228426 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 12:36:44.228426 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 12:36:44.228426 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d1bb54dd-d9ba-4789-b2a0-c91a292cb466 could not be found. Oct 31 12:36:44.228426 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Oct 31 12:36:44.228426 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 12:36:44.228426 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Oct 31 12:36:44.228426 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 12:36:44.228426 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 12:36:44.228426 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 12:36:44.228426 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 12:36:44.228426 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 12:36:44.228426 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 12:36:44.229818 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 12:36:44.229818 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 12:36:44.229818 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 12:36:44.229818 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 12:36:44.229818 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 12:36:44.229818 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 12:36:44.229818 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 12:36:44.229818 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d1bb54dd-d9ba-4789-b2a0-c91a292cb466 could not be found. Oct 31 12:36:44.229818 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Oct 31 12:36:44.229818 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 12:36:44.229818 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Oct 31 12:36:44.229818 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 12:36:44.229818 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 12:36:44.229818 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 12:36:44.229818 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 12:36:44.229818 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 12:36:44.229818 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d1bb54dd-d9ba-4789-b2a0-c91a292cb466 could not be found. Oct 31 12:36:44.229818 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Oct 31 12:36:44.233347 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-be24afd4-f931-44bd-b439-b5d2f06e904b tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Returning 404 to user: Instance d1bb54dd-d9ba-4789-b2a0-c91a292cb466 could not be found. {{(pid=125441) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 12:36:44.234451 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-be24afd4-f931-44bd-b439-b5d2f06e904b tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] 10.222.0.15 "GET /compute/v2.1/servers/d1bb54dd-d9ba-4789-b2a0-c91a292cb466" status: 404 len: 111 microversion: 2.1 time: 0.057562 Oct 31 12:36:44.239082 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 276/563] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:36:44 2022] GET /compute/v2.1/servers/d1bb54dd-d9ba-4789-b2a0-c91a292cb466 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 12:36:44.244040 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-709ea51f-42f2-408e-a2b4-3253692587f1 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Calling method '.version_select at 0x7f2aa518f430>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:36:44.267509 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-709ea51f-42f2-408e-a2b4-3253692587f1 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-913735954" status: 202 len: 0 microversion: 2.1 time: 0.027120 Oct 31 12:36:44.268611 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 288/564] 10.222.0.15 () {58 vars in 1218 bytes} [Mon Oct 31 12:36:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-913735954 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 12:36:45.037103 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [req-aab07000-8725-4529-8d2e-55ab1066e875 req-90a0e40a-5a9a-47c2-b818-998c15cc9635 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7643c7c-0218-427f-876a-cf89c932dd11", "tag": "76712093-6a65-4766-8171-79fff21ef102"}]} {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 12:36:45.051913 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [req-aab07000-8725-4529-8d2e-55ab1066e875 req-90a0e40a-5a9a-47c2-b818-998c15cc9635 service nova] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:36:45.053567 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [req-aab07000-8725-4529-8d2e-55ab1066e875 req-90a0e40a-5a9a-47c2-b818-998c15cc9635 service nova] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:36:45.054206 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [req-aab07000-8725-4529-8d2e-55ab1066e875 req-90a0e40a-5a9a-47c2-b818-998c15cc9635 service nova] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:36:45.065924 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-5f728c40-d341-4215-96f5-1de69ad65ab2 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:36:45.066513 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-5f728c40-d341-4215-96f5-1de69ad65ab2 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] [instance: 9906becc-a42b-4b4c-855a-450915f7a3f8] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:36:45.068256 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.compute.server_external_events [req-aab07000-8725-4529-8d2e-55ab1066e875 req-90a0e40a-5a9a-47c2-b818-998c15cc9635 service nova] Creating event network-changed:76712093-6a65-4766-8171-79fff21ef102 for instance d7643c7c-0218-427f-876a-cf89c932dd11 on hv-cinder-79617 Oct 31 12:36:45.073737 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [req-aab07000-8725-4529-8d2e-55ab1066e875 req-90a0e40a-5a9a-47c2-b818-998c15cc9635 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041587 Oct 31 12:36:45.075046 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 277/565] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Oct 31 12:36:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 12:36:45.079011 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-5f728c40-d341-4215-96f5-1de69ad65ab2 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:36:45.079568 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-5f728c40-d341-4215-96f5-1de69ad65ab2 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:36:45.080143 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-5f728c40-d341-4215-96f5-1de69ad65ab2 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:36:45.080728 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-5f728c40-d341-4215-96f5-1de69ad65ab2 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:36:45.081274 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-5f728c40-d341-4215-96f5-1de69ad65ab2 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:36:45.081592 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-5f728c40-d341-4215-96f5-1de69ad65ab2 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:36:45.197519 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.objects.instance [None req-5f728c40-d341-4215-96f5-1de69ad65ab2 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lazy-loading 'services' on Instance uuid 9906becc-a42b-4b4c-855a-450915f7a3f8 {{(pid=125440) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 12:36:45.276587 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-5f728c40-d341-4215-96f5-1de69ad65ab2 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] 10.222.0.15 "DELETE /compute/v2.1/servers/9906becc-a42b-4b4c-855a-450915f7a3f8/os-volume_attachments/22121858-e3c7-41eb-ac09-1abddd01c0df" status: 202 len: 0 microversion: 2.1 time: 0.215226 Oct 31 12:36:45.277340 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 289/566] 10.222.0.15 () {58 vars in 1416 bytes} [Mon Oct 31 12:36:45 2022] DELETE /compute/v2.1/servers/9906becc-a42b-4b4c-855a-450915f7a3f8/os-volume_attachments/22121858-e3c7-41eb-ac09-1abddd01c0df => generated 0 bytes in 217 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 12:36:45.286888 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-c7903343-dfb7-4629-a7a3-9b60db5b85dd tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:36:45.289390 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-c7903343-dfb7-4629-a7a3-9b60db5b85dd tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] [instance: 9906becc-a42b-4b4c-855a-450915f7a3f8] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:36:45.301848 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-c7903343-dfb7-4629-a7a3-9b60db5b85dd tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:36:45.303052 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-c7903343-dfb7-4629-a7a3-9b60db5b85dd tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:36:45.303581 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-c7903343-dfb7-4629-a7a3-9b60db5b85dd tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:36:45.304879 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-c7903343-dfb7-4629-a7a3-9b60db5b85dd tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:36:45.305572 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-c7903343-dfb7-4629-a7a3-9b60db5b85dd tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:36:45.307317 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-c7903343-dfb7-4629-a7a3-9b60db5b85dd tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:36:45.350991 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-c7903343-dfb7-4629-a7a3-9b60db5b85dd tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] 10.222.0.15 "GET /compute/v2.1/servers/9906becc-a42b-4b4c-855a-450915f7a3f8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.069091 Oct 31 12:36:45.353877 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 278/567] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Oct 31 12:36:45 2022] GET /compute/v2.1/servers/9906becc-a42b-4b4c-855a-450915f7a3f8/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 12:36:46.366523 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-bf0500de-1154-4222-ba07-9d79720e8821 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:36:46.368879 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-bf0500de-1154-4222-ba07-9d79720e8821 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] [instance: 9906becc-a42b-4b4c-855a-450915f7a3f8] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:36:46.374974 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-bf0500de-1154-4222-ba07-9d79720e8821 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:36:46.375487 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-bf0500de-1154-4222-ba07-9d79720e8821 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:36:46.375920 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-bf0500de-1154-4222-ba07-9d79720e8821 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:36:46.376603 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-bf0500de-1154-4222-ba07-9d79720e8821 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:36:46.377050 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-bf0500de-1154-4222-ba07-9d79720e8821 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:36:46.377469 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-bf0500de-1154-4222-ba07-9d79720e8821 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:36:46.409037 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-bf0500de-1154-4222-ba07-9d79720e8821 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] 10.222.0.15 "GET /compute/v2.1/servers/9906becc-a42b-4b4c-855a-450915f7a3f8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048171 Oct 31 12:36:46.409590 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 290/568] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Oct 31 12:36:46 2022] GET /compute/v2.1/servers/9906becc-a42b-4b4c-855a-450915f7a3f8/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 12:36:47.421612 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-ce60ca99-1a7b-4c65-a401-8d73cd68ae59 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:36:47.424828 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-ce60ca99-1a7b-4c65-a401-8d73cd68ae59 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] [instance: 9906becc-a42b-4b4c-855a-450915f7a3f8] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:36:47.431349 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-ce60ca99-1a7b-4c65-a401-8d73cd68ae59 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:36:47.431831 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-ce60ca99-1a7b-4c65-a401-8d73cd68ae59 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:36:47.432264 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-ce60ca99-1a7b-4c65-a401-8d73cd68ae59 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:36:47.432952 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-ce60ca99-1a7b-4c65-a401-8d73cd68ae59 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:36:47.433407 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-ce60ca99-1a7b-4c65-a401-8d73cd68ae59 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:36:47.433831 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-ce60ca99-1a7b-4c65-a401-8d73cd68ae59 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:36:47.463773 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-ce60ca99-1a7b-4c65-a401-8d73cd68ae59 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] 10.222.0.15 "GET /compute/v2.1/servers/9906becc-a42b-4b4c-855a-450915f7a3f8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046193 Oct 31 12:36:47.464328 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 279/569] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Oct 31 12:36:47 2022] GET /compute/v2.1/servers/9906becc-a42b-4b4c-855a-450915f7a3f8/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 12:36:48.477317 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-a75549e2-6992-4252-a9fc-e8c9f6a7e2ea tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:36:48.479394 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-a75549e2-6992-4252-a9fc-e8c9f6a7e2ea tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] [instance: 9906becc-a42b-4b4c-855a-450915f7a3f8] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:36:48.481951 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG dbcounter [-] [125440] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=125440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:36:48.487137 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-a75549e2-6992-4252-a9fc-e8c9f6a7e2ea tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:36:48.487649 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-a75549e2-6992-4252-a9fc-e8c9f6a7e2ea tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:36:48.488072 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-a75549e2-6992-4252-a9fc-e8c9f6a7e2ea tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:36:48.488753 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-a75549e2-6992-4252-a9fc-e8c9f6a7e2ea tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:36:48.489201 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-a75549e2-6992-4252-a9fc-e8c9f6a7e2ea tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:36:48.489614 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-a75549e2-6992-4252-a9fc-e8c9f6a7e2ea tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:36:48.520758 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-a75549e2-6992-4252-a9fc-e8c9f6a7e2ea tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] 10.222.0.15 "GET /compute/v2.1/servers/9906becc-a42b-4b4c-855a-450915f7a3f8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047477 Oct 31 12:36:48.521303 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 291/570] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Oct 31 12:36:48 2022] GET /compute/v2.1/servers/9906becc-a42b-4b4c-855a-450915f7a3f8/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 12:36:49.533803 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-3510557a-f1c2-4b16-9e8a-5b5b296295ac tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:36:49.535986 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-3510557a-f1c2-4b16-9e8a-5b5b296295ac tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] [instance: 9906becc-a42b-4b4c-855a-450915f7a3f8] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:36:49.542313 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-3510557a-f1c2-4b16-9e8a-5b5b296295ac tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:36:49.542783 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-3510557a-f1c2-4b16-9e8a-5b5b296295ac tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:36:49.543229 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-3510557a-f1c2-4b16-9e8a-5b5b296295ac tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:36:49.543902 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-3510557a-f1c2-4b16-9e8a-5b5b296295ac tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:36:49.544346 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-3510557a-f1c2-4b16-9e8a-5b5b296295ac tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:36:49.544759 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-3510557a-f1c2-4b16-9e8a-5b5b296295ac tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:36:49.574100 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-3510557a-f1c2-4b16-9e8a-5b5b296295ac tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] 10.222.0.15 "GET /compute/v2.1/servers/9906becc-a42b-4b4c-855a-450915f7a3f8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044743 Oct 31 12:36:49.574572 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 280/571] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Oct 31 12:36:49 2022] GET /compute/v2.1/servers/9906becc-a42b-4b4c-855a-450915f7a3f8/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 12:36:50.399036 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-7945caeb-f46e-4df9-bbf7-19b521e8e2ab tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 12:36:50.401242 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-7945caeb-f46e-4df9-bbf7-19b521e8e2ab tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] [instance: ee260508-cdfb-468d-9ff4-df06cc3bdadf] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:36:50.407717 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-7945caeb-f46e-4df9-bbf7-19b521e8e2ab tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:36:50.408289 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-7945caeb-f46e-4df9-bbf7-19b521e8e2ab tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:36:50.408719 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-7945caeb-f46e-4df9-bbf7-19b521e8e2ab tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:36:50.409411 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-7945caeb-f46e-4df9-bbf7-19b521e8e2ab tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:36:50.409877 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-7945caeb-f46e-4df9-bbf7-19b521e8e2ab tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:36:50.410273 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-7945caeb-f46e-4df9-bbf7-19b521e8e2ab tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:36:50.435144 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.objects.instance [None req-7945caeb-f46e-4df9-bbf7-19b521e8e2ab tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lazy-loading 'flavor' on Instance uuid ee260508-cdfb-468d-9ff4-df06cc3bdadf {{(pid=125440) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 12:36:50.586745 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-e8ca92e0-8a9b-44c4-bea6-ada8f9a1f13c tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:36:50.589066 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-e8ca92e0-8a9b-44c4-bea6-ada8f9a1f13c tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] [instance: 9906becc-a42b-4b4c-855a-450915f7a3f8] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:36:50.596122 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-e8ca92e0-8a9b-44c4-bea6-ada8f9a1f13c tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:36:50.596678 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-e8ca92e0-8a9b-44c4-bea6-ada8f9a1f13c tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:36:50.597109 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-e8ca92e0-8a9b-44c4-bea6-ada8f9a1f13c tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:36:50.598009 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-e8ca92e0-8a9b-44c4-bea6-ada8f9a1f13c tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:36:50.598464 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-e8ca92e0-8a9b-44c4-bea6-ada8f9a1f13c tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:36:50.598908 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-e8ca92e0-8a9b-44c4-bea6-ada8f9a1f13c tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:36:50.599913 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-7945caeb-f46e-4df9-bbf7-19b521e8e2ab tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] 10.222.0.15 "POST /compute/v2.1/servers/ee260508-cdfb-468d-9ff4-df06cc3bdadf/action" status: 200 len: 32 microversion: 2.1 time: 0.203868 Oct 31 12:36:50.600813 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 292/572] 10.222.0.15 () {60 vars in 1278 bytes} [Mon Oct 31 12:36:50 2022] POST /compute/v2.1/servers/ee260508-cdfb-468d-9ff4-df06cc3bdadf/action => generated 32 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 12:36:50.614181 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-51136c0a-b52b-4423-b649-792a85234451 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:36:50.615044 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-51136c0a-b52b-4423-b649-792a85234451 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] [instance: ee260508-cdfb-468d-9ff4-df06cc3bdadf] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:36:50.621917 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-51136c0a-b52b-4423-b649-792a85234451 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:36:50.622545 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-51136c0a-b52b-4423-b649-792a85234451 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:36:50.622976 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-51136c0a-b52b-4423-b649-792a85234451 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:36:50.624648 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-51136c0a-b52b-4423-b649-792a85234451 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:36:50.625103 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-51136c0a-b52b-4423-b649-792a85234451 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:36:50.625521 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-51136c0a-b52b-4423-b649-792a85234451 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:36:50.633428 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-e8ca92e0-8a9b-44c4-bea6-ada8f9a1f13c tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] 10.222.0.15 "GET /compute/v2.1/servers/9906becc-a42b-4b4c-855a-450915f7a3f8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050620 Oct 31 12:36:50.634180 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 281/573] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Oct 31 12:36:50 2022] GET /compute/v2.1/servers/9906becc-a42b-4b4c-855a-450915f7a3f8/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 12:36:50.851070 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-51136c0a-b52b-4423-b649-792a85234451 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2e978bcb824a5e9d593b861c9e3bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7573cb9c503243ab90b1649591d550e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:36:50.859195 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-51136c0a-b52b-4423-b649-792a85234451 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] 10.222.0.15 "GET /compute/v2.1/servers/ee260508-cdfb-468d-9ff4-df06cc3bdadf" status: 200 len: 1737 microversion: 2.1 time: 0.251167 Oct 31 12:36:50.859755 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 293/574] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:36:50 2022] GET /compute/v2.1/servers/ee260508-cdfb-468d-9ff4-df06cc3bdadf => generated 1737 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:36:51.646764 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-1207cef1-d239-4a65-a730-e5b4b5ea5df7 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:36:51.648889 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-1207cef1-d239-4a65-a730-e5b4b5ea5df7 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] [instance: 9906becc-a42b-4b4c-855a-450915f7a3f8] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:36:51.655253 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-1207cef1-d239-4a65-a730-e5b4b5ea5df7 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:36:51.655735 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-1207cef1-d239-4a65-a730-e5b4b5ea5df7 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:36:51.656166 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-1207cef1-d239-4a65-a730-e5b4b5ea5df7 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:36:51.656853 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-1207cef1-d239-4a65-a730-e5b4b5ea5df7 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:36:51.657308 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-1207cef1-d239-4a65-a730-e5b4b5ea5df7 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:36:51.657728 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-1207cef1-d239-4a65-a730-e5b4b5ea5df7 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:36:51.686340 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-1207cef1-d239-4a65-a730-e5b4b5ea5df7 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] 10.222.0.15 "GET /compute/v2.1/servers/9906becc-a42b-4b4c-855a-450915f7a3f8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044415 Oct 31 12:36:51.686884 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 282/575] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Oct 31 12:36:51 2022] GET /compute/v2.1/servers/9906becc-a42b-4b4c-855a-450915f7a3f8/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 12:36:51.750443 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-69aba9ac-0dbd-4e83-8df9-9054ed964b5c tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:36:51.750980 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-69aba9ac-0dbd-4e83-8df9-9054ed964b5c tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] [instance: 9906becc-a42b-4b4c-855a-450915f7a3f8] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:36:51.757460 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-69aba9ac-0dbd-4e83-8df9-9054ed964b5c tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:36:51.758418 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-69aba9ac-0dbd-4e83-8df9-9054ed964b5c tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:36:51.758844 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-69aba9ac-0dbd-4e83-8df9-9054ed964b5c tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:36:51.759625 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-69aba9ac-0dbd-4e83-8df9-9054ed964b5c tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:36:51.760071 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-69aba9ac-0dbd-4e83-8df9-9054ed964b5c tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:36:51.760482 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-69aba9ac-0dbd-4e83-8df9-9054ed964b5c tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:36:51.785985 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-69aba9ac-0dbd-4e83-8df9-9054ed964b5c tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] [instance: 9906becc-a42b-4b4c-855a-450915f7a3f8] Going to try to terminate instance {{(pid=125440) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 12:36:51.864531 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-69aba9ac-0dbd-4e83-8df9-9054ed964b5c tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] 10.222.0.15 "DELETE /compute/v2.1/servers/9906becc-a42b-4b4c-855a-450915f7a3f8" status: 204 len: 0 microversion: 2.1 time: 0.117585 Oct 31 12:36:51.865389 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 294/576] 10.222.0.15 () {58 vars in 1239 bytes} [Mon Oct 31 12:36:51 2022] DELETE /compute/v2.1/servers/9906becc-a42b-4b4c-855a-450915f7a3f8 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 12:36:51.873349 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-c81e2af2-2c1a-49fa-acda-7675bf07381f tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:36:51.873958 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-c81e2af2-2c1a-49fa-acda-7675bf07381f tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] [instance: 9906becc-a42b-4b4c-855a-450915f7a3f8] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:36:51.880343 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-c81e2af2-2c1a-49fa-acda-7675bf07381f tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:36:51.880822 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-c81e2af2-2c1a-49fa-acda-7675bf07381f tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:36:51.881251 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-c81e2af2-2c1a-49fa-acda-7675bf07381f tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:36:51.881934 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-c81e2af2-2c1a-49fa-acda-7675bf07381f tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:36:51.882384 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-c81e2af2-2c1a-49fa-acda-7675bf07381f tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:36:51.883202 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-36399877-306c-43eb-b353-f4d43ccd411f tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:36:51.883472 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-c81e2af2-2c1a-49fa-acda-7675bf07381f tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:36:51.883919 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-36399877-306c-43eb-b353-f4d43ccd411f tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] [instance: ee260508-cdfb-468d-9ff4-df06cc3bdadf] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:36:51.889781 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-36399877-306c-43eb-b353-f4d43ccd411f tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:36:51.890250 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-36399877-306c-43eb-b353-f4d43ccd411f tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:36:51.890664 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-36399877-306c-43eb-b353-f4d43ccd411f tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:36:51.891365 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-36399877-306c-43eb-b353-f4d43ccd411f tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:36:51.891813 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-36399877-306c-43eb-b353-f4d43ccd411f tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:36:51.892228 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-36399877-306c-43eb-b353-f4d43ccd411f tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:36:52.017668 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-c81e2af2-2c1a-49fa-acda-7675bf07381f tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c03f0365ee4a26b8c076ae365325b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfbc3a46f12942299b99cdd20c989e1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:36:52.023101 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-36399877-306c-43eb-b353-f4d43ccd411f tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2e978bcb824a5e9d593b861c9e3bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7573cb9c503243ab90b1649591d550e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:36:52.031711 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-36399877-306c-43eb-b353-f4d43ccd411f tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] 10.222.0.15 "GET /compute/v2.1/servers/ee260508-cdfb-468d-9ff4-df06cc3bdadf" status: 200 len: 1737 microversion: 2.1 time: 0.153039 Oct 31 12:36:52.032268 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-c81e2af2-2c1a-49fa-acda-7675bf07381f tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] 10.222.0.15 "GET /compute/v2.1/servers/9906becc-a42b-4b4c-855a-450915f7a3f8" status: 200 len: 1682 microversion: 2.1 time: 0.162779 Oct 31 12:36:52.032417 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 295/577] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:36:51 2022] GET /compute/v2.1/servers/ee260508-cdfb-468d-9ff4-df06cc3bdadf => generated 1737 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 12:36:52.033492 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 283/578] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:36:51 2022] GET /compute/v2.1/servers/9906becc-a42b-4b4c-855a-450915f7a3f8 => generated 1682 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:36:53.055573 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-8c760d9a-7f0d-410f-97e2-529d9ed8b67d tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:36:53.056181 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-8c760d9a-7f0d-410f-97e2-529d9ed8b67d tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] [instance: ee260508-cdfb-468d-9ff4-df06cc3bdadf] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:36:53.057201 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-0a5000a6-98da-4ced-b952-8a3cc5ccfee1 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:36:53.057810 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-0a5000a6-98da-4ced-b952-8a3cc5ccfee1 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] [instance: 9906becc-a42b-4b4c-855a-450915f7a3f8] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:36:53.062544 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-8c760d9a-7f0d-410f-97e2-529d9ed8b67d tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:36:53.063024 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-8c760d9a-7f0d-410f-97e2-529d9ed8b67d tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:36:53.063488 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-8c760d9a-7f0d-410f-97e2-529d9ed8b67d tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:36:53.064130 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-0a5000a6-98da-4ced-b952-8a3cc5ccfee1 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:36:53.064241 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-8c760d9a-7f0d-410f-97e2-529d9ed8b67d tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:36:53.064602 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-8c760d9a-7f0d-410f-97e2-529d9ed8b67d tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:36:53.064730 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-0a5000a6-98da-4ced-b952-8a3cc5ccfee1 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:36:53.065027 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-0a5000a6-98da-4ced-b952-8a3cc5ccfee1 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:36:53.065122 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-8c760d9a-7f0d-410f-97e2-529d9ed8b67d tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:36:53.065823 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-0a5000a6-98da-4ced-b952-8a3cc5ccfee1 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:36:53.066275 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-0a5000a6-98da-4ced-b952-8a3cc5ccfee1 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:36:53.066695 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-0a5000a6-98da-4ced-b952-8a3cc5ccfee1 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:36:53.193640 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-8c760d9a-7f0d-410f-97e2-529d9ed8b67d tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2e978bcb824a5e9d593b861c9e3bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7573cb9c503243ab90b1649591d550e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:36:53.198794 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-0a5000a6-98da-4ced-b952-8a3cc5ccfee1 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c03f0365ee4a26b8c076ae365325b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfbc3a46f12942299b99cdd20c989e1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:36:53.202688 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-8c760d9a-7f0d-410f-97e2-529d9ed8b67d tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] 10.222.0.15 "GET /compute/v2.1/servers/ee260508-cdfb-468d-9ff4-df06cc3bdadf" status: 200 len: 1737 microversion: 2.1 time: 0.151433 Oct 31 12:36:53.203272 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 296/579] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:36:53 2022] GET /compute/v2.1/servers/ee260508-cdfb-468d-9ff4-df06cc3bdadf => generated 1737 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:36:53.206450 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-0a5000a6-98da-4ced-b952-8a3cc5ccfee1 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] 10.222.0.15 "GET /compute/v2.1/servers/9906becc-a42b-4b4c-855a-450915f7a3f8" status: 200 len: 1682 microversion: 2.1 time: 0.154027 Oct 31 12:36:53.207014 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 284/580] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:36:53 2022] GET /compute/v2.1/servers/9906becc-a42b-4b4c-855a-450915f7a3f8 => generated 1682 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 12:36:54.225951 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-3f68945c-fafb-4366-9d60-482f32668db3 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:36:54.226699 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-3f68945c-fafb-4366-9d60-482f32668db3 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] [instance: ee260508-cdfb-468d-9ff4-df06cc3bdadf] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:36:54.229584 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-3cdbb25b-2724-4510-af80-a0b9eeb8263f tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:36:54.230976 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-3cdbb25b-2724-4510-af80-a0b9eeb8263f tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] [instance: 9906becc-a42b-4b4c-855a-450915f7a3f8] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:36:54.233320 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-3f68945c-fafb-4366-9d60-482f32668db3 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:36:54.233803 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-3f68945c-fafb-4366-9d60-482f32668db3 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:36:54.234228 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-3f68945c-fafb-4366-9d60-482f32668db3 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:36:54.235028 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-3f68945c-fafb-4366-9d60-482f32668db3 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:36:54.235387 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-3f68945c-fafb-4366-9d60-482f32668db3 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:36:54.235799 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-3f68945c-fafb-4366-9d60-482f32668db3 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:36:54.238823 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-3cdbb25b-2724-4510-af80-a0b9eeb8263f tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:36:54.239391 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-3cdbb25b-2724-4510-af80-a0b9eeb8263f tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:36:54.239825 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-3cdbb25b-2724-4510-af80-a0b9eeb8263f tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:36:54.240641 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-3cdbb25b-2724-4510-af80-a0b9eeb8263f tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:36:54.241092 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-3cdbb25b-2724-4510-af80-a0b9eeb8263f tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:36:54.241509 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-3cdbb25b-2724-4510-af80-a0b9eeb8263f tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:36:54.377208 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-3cdbb25b-2724-4510-af80-a0b9eeb8263f tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c03f0365ee4a26b8c076ae365325b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfbc3a46f12942299b99cdd20c989e1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:36:54.385667 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-3cdbb25b-2724-4510-af80-a0b9eeb8263f tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] 10.222.0.15 "GET /compute/v2.1/servers/9906becc-a42b-4b4c-855a-450915f7a3f8" status: 200 len: 1682 microversion: 2.1 time: 0.160290 Oct 31 12:36:54.386247 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 285/581] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:36:54 2022] GET /compute/v2.1/servers/9906becc-a42b-4b4c-855a-450915f7a3f8 => generated 1682 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 12:36:54.450713 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-3f68945c-fafb-4366-9d60-482f32668db3 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2e978bcb824a5e9d593b861c9e3bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7573cb9c503243ab90b1649591d550e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:36:54.458996 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-3f68945c-fafb-4366-9d60-482f32668db3 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] 10.222.0.15 "GET /compute/v2.1/servers/ee260508-cdfb-468d-9ff4-df06cc3bdadf" status: 200 len: 1737 microversion: 2.1 time: 0.236984 Oct 31 12:36:54.464894 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 297/582] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:36:54 2022] GET /compute/v2.1/servers/ee260508-cdfb-468d-9ff4-df06cc3bdadf => generated 1737 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:36:54.744770 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [req-71f5d7ef-0ab6-41f6-9b79-31a260a4e2d0 req-cc863512-0b47-43f1-9fd5-1354d5a8fa1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9906becc-a42b-4b4c-855a-450915f7a3f8", "name": "network-vif-deleted", "tag": "ffe46aaf-72a4-4c15-9506-ca33161dddf3"}]} {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 12:36:54.754764 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [req-71f5d7ef-0ab6-41f6-9b79-31a260a4e2d0 req-cc863512-0b47-43f1-9fd5-1354d5a8fa1f service nova] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:36:54.755378 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [req-71f5d7ef-0ab6-41f6-9b79-31a260a4e2d0 req-cc863512-0b47-43f1-9fd5-1354d5a8fa1f service nova] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:36:54.756048 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [req-71f5d7ef-0ab6-41f6-9b79-31a260a4e2d0 req-cc863512-0b47-43f1-9fd5-1354d5a8fa1f service nova] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:36:54.758881 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG dbcounter [-] [125441] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=125441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:36:54.770506 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.compute.server_external_events [req-71f5d7ef-0ab6-41f6-9b79-31a260a4e2d0 req-cc863512-0b47-43f1-9fd5-1354d5a8fa1f service nova] Creating event network-vif-deleted:ffe46aaf-72a4-4c15-9506-ca33161dddf3 for instance 9906becc-a42b-4b4c-855a-450915f7a3f8 on hv-cinder-79617 Oct 31 12:36:54.776120 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [req-71f5d7ef-0ab6-41f6-9b79-31a260a4e2d0 req-cc863512-0b47-43f1-9fd5-1354d5a8fa1f service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035607 Oct 31 12:36:54.776735 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 286/583] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Oct 31 12:36:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 12:36:55.410364 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-ad0ee6e1-8036-4849-b645-ba471e49acfe tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:36:55.410967 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-ad0ee6e1-8036-4849-b645-ba471e49acfe tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] [instance: 9906becc-a42b-4b4c-855a-450915f7a3f8] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:36:55.416972 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-ad0ee6e1-8036-4849-b645-ba471e49acfe tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:36:55.417447 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-ad0ee6e1-8036-4849-b645-ba471e49acfe tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:36:55.417874 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-ad0ee6e1-8036-4849-b645-ba471e49acfe tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:36:55.418556 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-ad0ee6e1-8036-4849-b645-ba471e49acfe tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:36:55.419011 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-ad0ee6e1-8036-4849-b645-ba471e49acfe tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:36:55.419442 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-ad0ee6e1-8036-4849-b645-ba471e49acfe tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:36:55.451963 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-ad0ee6e1-8036-4849-b645-ba471e49acfe tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:36:55.452440 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-ad0ee6e1-8036-4849-b645-ba471e49acfe tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:36:55.452861 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-ad0ee6e1-8036-4849-b645-ba471e49acfe tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:36:55.453318 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.objects.instance [None req-ad0ee6e1-8036-4849-b645-ba471e49acfe tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lazy-loading 'fault' on Instance uuid 9906becc-a42b-4b4c-855a-450915f7a3f8 {{(pid=125440) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 12:36:55.485340 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-3fb97a31-fc89-41f1-bafb-74c8a6acbb33 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:36:55.486070 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-3fb97a31-fc89-41f1-bafb-74c8a6acbb33 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] [instance: ee260508-cdfb-468d-9ff4-df06cc3bdadf] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:36:55.494357 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-3fb97a31-fc89-41f1-bafb-74c8a6acbb33 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:36:55.495532 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-3fb97a31-fc89-41f1-bafb-74c8a6acbb33 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:36:55.496211 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-3fb97a31-fc89-41f1-bafb-74c8a6acbb33 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:36:55.497134 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-3fb97a31-fc89-41f1-bafb-74c8a6acbb33 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:36:55.497660 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-3fb97a31-fc89-41f1-bafb-74c8a6acbb33 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:36:55.498125 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-3fb97a31-fc89-41f1-bafb-74c8a6acbb33 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:36:55.502221 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-ad0ee6e1-8036-4849-b645-ba471e49acfe tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c03f0365ee4a26b8c076ae365325b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfbc3a46f12942299b99cdd20c989e1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:36:55.512444 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-ad0ee6e1-8036-4849-b645-ba471e49acfe tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] 10.222.0.15 "GET /compute/v2.1/servers/9906becc-a42b-4b4c-855a-450915f7a3f8" status: 200 len: 1330 microversion: 2.1 time: 0.106268 Oct 31 12:36:55.513081 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 298/584] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:36:55 2022] GET /compute/v2.1/servers/9906becc-a42b-4b4c-855a-450915f7a3f8 => generated 1330 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:36:55.669881 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-3fb97a31-fc89-41f1-bafb-74c8a6acbb33 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2e978bcb824a5e9d593b861c9e3bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7573cb9c503243ab90b1649591d550e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:36:55.678197 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-3fb97a31-fc89-41f1-bafb-74c8a6acbb33 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] 10.222.0.15 "GET /compute/v2.1/servers/ee260508-cdfb-468d-9ff4-df06cc3bdadf" status: 200 len: 1737 microversion: 2.1 time: 0.197610 Oct 31 12:36:55.678779 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 287/585] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:36:55 2022] GET /compute/v2.1/servers/ee260508-cdfb-468d-9ff4-df06cc3bdadf => generated 1737 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 12:36:56.535604 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-fa145299-e92d-43d7-b47b-be66a89f607b tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:36:56.536201 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-fa145299-e92d-43d7-b47b-be66a89f607b tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] [instance: 9906becc-a42b-4b4c-855a-450915f7a3f8] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:36:56.542523 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-fa145299-e92d-43d7-b47b-be66a89f607b tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:36:56.542986 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-fa145299-e92d-43d7-b47b-be66a89f607b tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:36:56.543440 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-fa145299-e92d-43d7-b47b-be66a89f607b tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:36:56.544109 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-fa145299-e92d-43d7-b47b-be66a89f607b tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:36:56.544547 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-fa145299-e92d-43d7-b47b-be66a89f607b tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:36:56.544953 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-fa145299-e92d-43d7-b47b-be66a89f607b tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:36:56.558539 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.wsgi [None req-fa145299-e92d-43d7-b47b-be66a89f607b tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] HTTP exception thrown: Instance 9906becc-a42b-4b4c-855a-450915f7a3f8 could not be found. Oct 31 12:36:56.560175 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-fa145299-e92d-43d7-b47b-be66a89f607b tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Request method failure captured: Oct 31 12:36:56.560175 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: request: GET /compute/v2.1/servers/9906becc-a42b-4b4c-855a-450915f7a3f8 HTTP/1.1 Oct 31 12:36:56.560175 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: Accept: application/json Oct 31 12:36:56.560175 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: Accept-Encoding: identity Oct 31 12:36:56.560175 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: Connection: close Oct 31 12:36:56.560175 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: Content-Length: 0 Oct 31 12:36:56.560175 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: Content-Type: application/json Oct 31 12:36:56.560175 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: Host: 10.222.0.15 Oct 31 12:36:56.560175 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: Openstack-System-Scope: None Oct 31 12:36:56.560175 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: User-Agent: python-urllib3/1.26.12 Oct 31 12:36:56.560175 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Auth-Token: gAAAAABjX8B3Et2KM1ogPCTGs64pc6xLyfMw6yL0VTQe6oSz3vb_t3Nol1y36tJUXD6PegbQ8pwIEwo4L666w1x-Z79gwUGFQzXyfvvOjyyVZQL72gtR1ISe3h09afCWKpljHfxhI1Y-A2JuAkXEjCcgQXdDq6Gsj4TA71_GeBFeeItX_0KrPQA Oct 31 12:36:56.560175 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Domain-Id: None Oct 31 12:36:56.560175 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Domain-Name: None Oct 31 12:36:56.560175 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Identity-Status: Confirmed Oct 31 12:36:56.560175 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Is-Admin-Project: True Oct 31 12:36:56.560175 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Project-Domain-Id: default Oct 31 12:36:56.560175 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Project-Domain-Name: Default Oct 31 12:36:56.560175 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Project-Id: bfbc3a46f12942299b99cdd20c989e1f Oct 31 12:36:56.560175 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Project-Name: tempest-AttachVolumeNegativeTest-1648165012 Oct 31 12:36:56.560175 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Role: reader,member Oct 31 12:36:56.560175 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Roles: reader,member Oct 31 12:36:56.561846 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/bfbc3a46f12942299b99cdd20c989e1f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_bfbc3a46f12942299b99cdd20c989e1f", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/bfbc3a46f12942299b99cdd20c989e1f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/bfbc3a46f12942299b99cdd20c989e1f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Oct 31 12:36:56.561846 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Tenant: tempest-AttachVolumeNegativeTest-1648165012 Oct 31 12:36:56.561846 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Tenant-Id: bfbc3a46f12942299b99cdd20c989e1f Oct 31 12:36:56.561846 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1648165012 Oct 31 12:36:56.561846 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-User: tempest-AttachVolumeNegativeTest-1648165012-project Oct 31 12:36:56.561846 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-User-Domain-Id: default Oct 31 12:36:56.561846 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-User-Domain-Name: Default Oct 31 12:36:56.561846 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-User-Id: b2c03f0365ee4a26b8c076ae365325b2 Oct 31 12:36:56.561846 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-User-Name: tempest-AttachVolumeNegativeTest-1648165012-project Oct 31 12:36:56.561846 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: method: > Oct 31 12:36:56.561846 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: exception: Instance 9906becc-a42b-4b4c-855a-450915f7a3f8 could not be found. Oct 31 12:36:56.561846 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: action_args: {'id': '9906becc-a42b-4b4c-855a-450915f7a3f8'} Oct 31 12:36:56.562752 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 12:36:56.562752 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 12:36:56.562752 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 12:36:56.562752 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 12:36:56.562752 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 12:36:56.562752 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 12:36:56.562752 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 12:36:56.562752 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 12:36:56.562752 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 12:36:56.562752 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 12:36:56.562752 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9906becc-a42b-4b4c-855a-450915f7a3f8 could not be found. Oct 31 12:36:56.562752 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Oct 31 12:36:56.562752 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 12:36:56.562752 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Oct 31 12:36:56.562752 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 12:36:56.562752 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 12:36:56.562752 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 12:36:56.562752 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 12:36:56.562752 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 12:36:56.562752 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 12:36:56.564264 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 12:36:56.564264 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 12:36:56.564264 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 12:36:56.564264 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 12:36:56.564264 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 12:36:56.564264 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 12:36:56.564264 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 12:36:56.564264 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9906becc-a42b-4b4c-855a-450915f7a3f8 could not be found. Oct 31 12:36:56.564264 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Oct 31 12:36:56.564264 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 12:36:56.564264 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Oct 31 12:36:56.564264 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 12:36:56.564264 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 12:36:56.564264 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 12:36:56.564264 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 12:36:56.564264 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 12:36:56.564264 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9906becc-a42b-4b4c-855a-450915f7a3f8 could not be found. Oct 31 12:36:56.564264 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Oct 31 12:36:56.565611 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-fa145299-e92d-43d7-b47b-be66a89f607b tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Returning 404 to user: Instance 9906becc-a42b-4b4c-855a-450915f7a3f8 could not be found. {{(pid=125440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 12:36:56.565611 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-fa145299-e92d-43d7-b47b-be66a89f607b tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] 10.222.0.15 "GET /compute/v2.1/servers/9906becc-a42b-4b4c-855a-450915f7a3f8" status: 404 len: 111 microversion: 2.1 time: 0.029710 Oct 31 12:36:56.565611 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 299/586] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:36:56 2022] GET /compute/v2.1/servers/9906becc-a42b-4b4c-855a-450915f7a3f8 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 12:36:56.570888 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-f9fe0bf6-a731-4edf-92bc-9317162e4448 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Calling method '.version_select at 0x7f2aa50aed30>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:36:56.591453 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-f9fe0bf6-a731-4edf-92bc-9317162e4448 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-360295023" status: 202 len: 0 microversion: 2.1 time: 0.024894 Oct 31 12:36:56.592006 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 288/587] 10.222.0.15 () {58 vars in 1218 bytes} [Mon Oct 31 12:36:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-360295023 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 12:36:56.702457 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-70a6c270-f422-419e-99ea-c185baabe5e0 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:36:56.703284 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-70a6c270-f422-419e-99ea-c185baabe5e0 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] [instance: ee260508-cdfb-468d-9ff4-df06cc3bdadf] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:36:56.710173 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-70a6c270-f422-419e-99ea-c185baabe5e0 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:36:56.711252 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-70a6c270-f422-419e-99ea-c185baabe5e0 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:36:56.711742 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-70a6c270-f422-419e-99ea-c185baabe5e0 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:36:56.712464 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-70a6c270-f422-419e-99ea-c185baabe5e0 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:36:56.712904 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-70a6c270-f422-419e-99ea-c185baabe5e0 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:36:56.713316 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-70a6c270-f422-419e-99ea-c185baabe5e0 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:36:56.861830 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-70a6c270-f422-419e-99ea-c185baabe5e0 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2e978bcb824a5e9d593b861c9e3bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7573cb9c503243ab90b1649591d550e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:36:56.866218 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG dbcounter [-] [125440] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=125440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:36:56.874473 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-70a6c270-f422-419e-99ea-c185baabe5e0 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] 10.222.0.15 "GET /compute/v2.1/servers/ee260508-cdfb-468d-9ff4-df06cc3bdadf" status: 200 len: 1737 microversion: 2.1 time: 0.176005 Oct 31 12:36:56.875042 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 300/588] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:36:56 2022] GET /compute/v2.1/servers/ee260508-cdfb-468d-9ff4-df06cc3bdadf => generated 1737 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:36:57.247305 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-043a2de1-bbb9-4a90-a0ae-9366e502cf82 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Action: 'create', calling method: .version_select at 0x7f2aa5073550>, body: {"keypair": {"name": "tempest-keypair-1094411431", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE5tQHokiQzpGHCMXgoVXNz6KG0/otkNJkT1PCk7gs6S74IwvzLLDuIm2enfPetpXwBhbsJv1eD2APUvzs6omyv634B/EN8vCqhjy/p9qHRFkk+cPEw1g6JHpfCsO1nrCw=="}} {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 12:36:57.264803 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.quota [None req-043a2de1-bbb9-4a90-a0ae-9366e502cf82 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Getting quotas for project bfbc3a46f12942299b99cdd20c989e1f. Resources: {'key_pairs'} {{(pid=125441) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 12:36:57.268697 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.quota [None req-043a2de1-bbb9-4a90-a0ae-9366e502cf82 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Getting quotas for user b2c03f0365ee4a26b8c076ae365325b2 and project bfbc3a46f12942299b99cdd20c989e1f. Resources: {'key_pairs'} {{(pid=125441) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 12:36:57.297155 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-043a2de1-bbb9-4a90-a0ae-9366e502cf82 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.053725 Oct 31 12:36:57.297759 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 289/589] 10.222.0.15 () {60 vars in 1159 bytes} [Mon Oct 31 12:36:57 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 12:36:57.899001 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-c43523d6-79df-473a-ab76-b93635b48c21 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:36:57.899682 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-c43523d6-79df-473a-ab76-b93635b48c21 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] [instance: ee260508-cdfb-468d-9ff4-df06cc3bdadf] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:36:57.906104 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-c43523d6-79df-473a-ab76-b93635b48c21 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:36:57.906579 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-c43523d6-79df-473a-ab76-b93635b48c21 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:36:57.906996 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-c43523d6-79df-473a-ab76-b93635b48c21 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:36:57.907696 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-c43523d6-79df-473a-ab76-b93635b48c21 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:36:57.908138 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-c43523d6-79df-473a-ab76-b93635b48c21 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:36:57.908543 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-c43523d6-79df-473a-ab76-b93635b48c21 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:36:58.098601 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-c43523d6-79df-473a-ab76-b93635b48c21 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2e978bcb824a5e9d593b861c9e3bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7573cb9c503243ab90b1649591d550e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:36:58.107698 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-c43523d6-79df-473a-ab76-b93635b48c21 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] 10.222.0.15 "GET /compute/v2.1/servers/ee260508-cdfb-468d-9ff4-df06cc3bdadf" status: 200 len: 1737 microversion: 2.1 time: 0.213531 Oct 31 12:36:58.109729 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 301/590] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:36:57 2022] GET /compute/v2.1/servers/ee260508-cdfb-468d-9ff4-df06cc3bdadf => generated 1737 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:36:58.539726 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-c0e43ee7-ee45-4ee0-a93e-a57091fbccad tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-213913429", "imageRef": "fbbea321-8f0d-4092-b070-b67a6931d610", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6630ddc4-dc53-4e5a-8b9d-7632c3075289"}], "security_groups": [{"name": "tempest-securitygroup--1044332168"}], "key_name": "tempest-keypair-1094411431", "user_data": "}} {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 12:36:58.639221 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.network.neutron [None req-c0e43ee7-ee45-4ee0-a93e-a57091fbccad tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] validate_networks() for [('6630ddc4-dc53-4e5a-8b9d-7632c3075289', None, None, None, None, None)] {{(pid=125441) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 12:36:59.134836 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-c2c20eb5-b7a6-4dbc-92d1-6aa39121c8d5 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:36:59.135462 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-c2c20eb5-b7a6-4dbc-92d1-6aa39121c8d5 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] [instance: ee260508-cdfb-468d-9ff4-df06cc3bdadf] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:36:59.142055 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-c2c20eb5-b7a6-4dbc-92d1-6aa39121c8d5 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:36:59.142538 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-c2c20eb5-b7a6-4dbc-92d1-6aa39121c8d5 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:36:59.142964 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-c2c20eb5-b7a6-4dbc-92d1-6aa39121c8d5 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:36:59.143679 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-c2c20eb5-b7a6-4dbc-92d1-6aa39121c8d5 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:36:59.144129 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-c2c20eb5-b7a6-4dbc-92d1-6aa39121c8d5 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:36:59.144546 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-c2c20eb5-b7a6-4dbc-92d1-6aa39121c8d5 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:36:59.226039 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.virt.hardware [None req-c0e43ee7-ee45-4ee0-a93e-a57091fbccad tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Flavor limits 0:0:0 {{(pid=125441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 12:36:59.227056 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.virt.hardware [None req-c0e43ee7-ee45-4ee0-a93e-a57091fbccad tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Image limits 0:0:0 {{(pid=125441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 12:36:59.227687 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.virt.hardware [None req-c0e43ee7-ee45-4ee0-a93e-a57091fbccad tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Flavor pref 0:0:0 {{(pid=125441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 12:36:59.228187 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.virt.hardware [None req-c0e43ee7-ee45-4ee0-a93e-a57091fbccad tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Image pref 0:0:0 {{(pid=125441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 12:36:59.228668 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.virt.hardware [None req-c0e43ee7-ee45-4ee0-a93e-a57091fbccad tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 12:36:59.237951 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-c0e43ee7-ee45-4ee0-a93e-a57091fbccad tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:36:59.238538 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-c0e43ee7-ee45-4ee0-a93e-a57091fbccad tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:36:59.239045 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-c0e43ee7-ee45-4ee0-a93e-a57091fbccad tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:36:59.239869 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-c0e43ee7-ee45-4ee0-a93e-a57091fbccad tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:36:59.240397 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-c0e43ee7-ee45-4ee0-a93e-a57091fbccad tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:36:59.240915 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-c0e43ee7-ee45-4ee0-a93e-a57091fbccad tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:36:59.259303 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.quota [None req-c0e43ee7-ee45-4ee0-a93e-a57091fbccad tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Getting quotas for project bfbc3a46f12942299b99cdd20c989e1f. Resources: {'instances', 'cores', 'ram'} {{(pid=125441) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 12:36:59.263630 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.quota [None req-c0e43ee7-ee45-4ee0-a93e-a57091fbccad tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Getting quotas for user b2c03f0365ee4a26b8c076ae365325b2 and project bfbc3a46f12942299b99cdd20c989e1f. Resources: {'instances', 'cores', 'ram'} {{(pid=125441) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 12:36:59.275890 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-c0e43ee7-ee45-4ee0-a93e-a57091fbccad tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Going to run 1 instances... {{(pid=125441) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 12:36:59.278343 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-c0e43ee7-ee45-4ee0-a93e-a57091fbccad tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] [instance: 46cae3a9-45e8-401c-b201-2ed4402e9e97] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fbbea321-8f0d-4092-b070-b67a6931d610',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125441) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 12:36:59.328187 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-c0e43ee7-ee45-4ee0-a93e-a57091fbccad tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.793932 Oct 31 12:36:59.335230 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 290/591] 10.222.0.15 () {60 vars in 1147 bytes} [Mon Oct 31 12:36:58 2022] POST /compute/v2.1/servers => generated 402 bytes in 801 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 12:36:59.340517 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-4873a0dc-78f5-40e2-976a-72a5808900e2 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:36:59.341142 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-4873a0dc-78f5-40e2-976a-72a5808900e2 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] [instance: 46cae3a9-45e8-401c-b201-2ed4402e9e97] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:36:59.403916 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-4873a0dc-78f5-40e2-976a-72a5808900e2 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c03f0365ee4a26b8c076ae365325b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfbc3a46f12942299b99cdd20c989e1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:36:59.411886 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-4873a0dc-78f5-40e2-976a-72a5808900e2 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] 10.222.0.15 "GET /compute/v2.1/servers/46cae3a9-45e8-401c-b201-2ed4402e9e97" status: 200 len: 1241 microversion: 2.1 time: 0.075164 Oct 31 12:36:59.412989 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 291/592] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:36:59 2022] GET /compute/v2.1/servers/46cae3a9-45e8-401c-b201-2ed4402e9e97 => generated 1241 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:36:59.502062 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-c2c20eb5-b7a6-4dbc-92d1-6aa39121c8d5 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2e978bcb824a5e9d593b861c9e3bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7573cb9c503243ab90b1649591d550e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:36:59.511292 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-c2c20eb5-b7a6-4dbc-92d1-6aa39121c8d5 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] 10.222.0.15 "GET /compute/v2.1/servers/ee260508-cdfb-468d-9ff4-df06cc3bdadf" status: 200 len: 1737 microversion: 2.1 time: 0.381205 Oct 31 12:36:59.511859 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 302/593] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:36:59 2022] GET /compute/v2.1/servers/ee260508-cdfb-468d-9ff4-df06cc3bdadf => generated 1737 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 12:37:00.435760 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-1fe80db7-1c63-498f-ada9-67bfe353ebd9 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:37:00.436295 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-1fe80db7-1c63-498f-ada9-67bfe353ebd9 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] [instance: 46cae3a9-45e8-401c-b201-2ed4402e9e97] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:37:00.442668 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-1fe80db7-1c63-498f-ada9-67bfe353ebd9 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:37:00.443144 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-1fe80db7-1c63-498f-ada9-67bfe353ebd9 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:37:00.443593 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-1fe80db7-1c63-498f-ada9-67bfe353ebd9 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:37:00.444266 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-1fe80db7-1c63-498f-ada9-67bfe353ebd9 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:37:00.444711 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-1fe80db7-1c63-498f-ada9-67bfe353ebd9 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:37:00.445191 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-1fe80db7-1c63-498f-ada9-67bfe353ebd9 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:37:00.512391 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-1fe80db7-1c63-498f-ada9-67bfe353ebd9 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c03f0365ee4a26b8c076ae365325b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfbc3a46f12942299b99cdd20c989e1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:37:00.520243 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-1fe80db7-1c63-498f-ada9-67bfe353ebd9 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] 10.222.0.15 "GET /compute/v2.1/servers/46cae3a9-45e8-401c-b201-2ed4402e9e97" status: 200 len: 1293 microversion: 2.1 time: 0.088171 Oct 31 12:37:00.527765 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 292/594] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:37:00 2022] GET /compute/v2.1/servers/46cae3a9-45e8-401c-b201-2ed4402e9e97 => generated 1293 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:37:00.536234 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-5a491dcd-ce74-4791-ab45-5be1f261042a tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:37:00.537132 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-5a491dcd-ce74-4791-ab45-5be1f261042a tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] [instance: ee260508-cdfb-468d-9ff4-df06cc3bdadf] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:37:00.545039 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-5a491dcd-ce74-4791-ab45-5be1f261042a tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:37:00.545519 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-5a491dcd-ce74-4791-ab45-5be1f261042a tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:37:00.546279 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-5a491dcd-ce74-4791-ab45-5be1f261042a tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:37:00.546989 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-5a491dcd-ce74-4791-ab45-5be1f261042a tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:37:00.547464 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-5a491dcd-ce74-4791-ab45-5be1f261042a tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:37:00.547877 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-5a491dcd-ce74-4791-ab45-5be1f261042a tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:37:00.754275 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-5a491dcd-ce74-4791-ab45-5be1f261042a tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2e978bcb824a5e9d593b861c9e3bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7573cb9c503243ab90b1649591d550e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:37:00.762736 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-5a491dcd-ce74-4791-ab45-5be1f261042a tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] 10.222.0.15 "GET /compute/v2.1/servers/ee260508-cdfb-468d-9ff4-df06cc3bdadf" status: 200 len: 1737 microversion: 2.1 time: 0.230809 Oct 31 12:37:00.763446 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 303/595] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:37:00 2022] GET /compute/v2.1/servers/ee260508-cdfb-468d-9ff4-df06cc3bdadf => generated 1737 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:37:01.544626 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-9d5c9c5d-b028-465b-9ef7-1be6e90e720d tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:37:01.545225 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-9d5c9c5d-b028-465b-9ef7-1be6e90e720d tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] [instance: 46cae3a9-45e8-401c-b201-2ed4402e9e97] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:37:01.551476 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-9d5c9c5d-b028-465b-9ef7-1be6e90e720d tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:37:01.551948 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-9d5c9c5d-b028-465b-9ef7-1be6e90e720d tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:37:01.552372 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-9d5c9c5d-b028-465b-9ef7-1be6e90e720d tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:37:01.553050 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-9d5c9c5d-b028-465b-9ef7-1be6e90e720d tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:37:01.553494 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-9d5c9c5d-b028-465b-9ef7-1be6e90e720d tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:37:01.553906 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-9d5c9c5d-b028-465b-9ef7-1be6e90e720d tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:37:01.685671 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-9d5c9c5d-b028-465b-9ef7-1be6e90e720d tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c03f0365ee4a26b8c076ae365325b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfbc3a46f12942299b99cdd20c989e1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:37:01.693142 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-9d5c9c5d-b028-465b-9ef7-1be6e90e720d tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] 10.222.0.15 "GET /compute/v2.1/servers/46cae3a9-45e8-401c-b201-2ed4402e9e97" status: 200 len: 1367 microversion: 2.1 time: 0.152442 Oct 31 12:37:01.693729 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 293/596] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:37:01 2022] GET /compute/v2.1/servers/46cae3a9-45e8-401c-b201-2ed4402e9e97 => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:37:01.785871 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-a2324fd9-52da-4901-b51e-e9b0cf83c6f0 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:37:01.786543 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-a2324fd9-52da-4901-b51e-e9b0cf83c6f0 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] [instance: ee260508-cdfb-468d-9ff4-df06cc3bdadf] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:37:01.793659 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-a2324fd9-52da-4901-b51e-e9b0cf83c6f0 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:37:01.794262 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-a2324fd9-52da-4901-b51e-e9b0cf83c6f0 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:37:01.794689 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-a2324fd9-52da-4901-b51e-e9b0cf83c6f0 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:37:01.795408 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-a2324fd9-52da-4901-b51e-e9b0cf83c6f0 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:37:01.795858 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-a2324fd9-52da-4901-b51e-e9b0cf83c6f0 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:37:01.796273 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-a2324fd9-52da-4901-b51e-e9b0cf83c6f0 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:37:02.029767 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-a2324fd9-52da-4901-b51e-e9b0cf83c6f0 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2e978bcb824a5e9d593b861c9e3bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7573cb9c503243ab90b1649591d550e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:37:02.038501 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-a2324fd9-52da-4901-b51e-e9b0cf83c6f0 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] 10.222.0.15 "GET /compute/v2.1/servers/ee260508-cdfb-468d-9ff4-df06cc3bdadf" status: 200 len: 1737 microversion: 2.1 time: 0.256407 Oct 31 12:37:02.054525 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 304/597] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:37:01 2022] GET /compute/v2.1/servers/ee260508-cdfb-468d-9ff4-df06cc3bdadf => generated 1737 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:37:02.170261 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [req-1feb9688-bd23-4172-aa7f-8ba7a290ace0 req-60b10166-6560-44c3-940f-6a4be4a4f6df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "46cae3a9-45e8-401c-b201-2ed4402e9e97", "tag": "81273f70-32ad-4271-bbb8-913808f06f34"}]} {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 12:37:02.196430 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [req-1feb9688-bd23-4172-aa7f-8ba7a290ace0 req-60b10166-6560-44c3-940f-6a4be4a4f6df service nova] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:37:02.197033 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [req-1feb9688-bd23-4172-aa7f-8ba7a290ace0 req-60b10166-6560-44c3-940f-6a4be4a4f6df service nova] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:37:02.197533 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [req-1feb9688-bd23-4172-aa7f-8ba7a290ace0 req-60b10166-6560-44c3-940f-6a4be4a4f6df service nova] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:37:02.217735 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.compute.server_external_events [req-1feb9688-bd23-4172-aa7f-8ba7a290ace0 req-60b10166-6560-44c3-940f-6a4be4a4f6df service nova] Creating event network-changed:81273f70-32ad-4271-bbb8-913808f06f34 for instance 46cae3a9-45e8-401c-b201-2ed4402e9e97 on hv-cinder-79617 Oct 31 12:37:02.222435 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [req-1feb9688-bd23-4172-aa7f-8ba7a290ace0 req-60b10166-6560-44c3-940f-6a4be4a4f6df service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061216 Oct 31 12:37:02.223031 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 294/598] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Oct 31 12:37:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 12:37:02.717033 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-9a311516-47f9-40e1-903c-bc357c787439 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:37:02.717663 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-9a311516-47f9-40e1-903c-bc357c787439 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] [instance: 46cae3a9-45e8-401c-b201-2ed4402e9e97] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:37:02.723489 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-9a311516-47f9-40e1-903c-bc357c787439 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:37:02.723964 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-9a311516-47f9-40e1-903c-bc357c787439 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:37:02.724391 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-9a311516-47f9-40e1-903c-bc357c787439 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:37:02.725066 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-9a311516-47f9-40e1-903c-bc357c787439 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:37:02.725514 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-9a311516-47f9-40e1-903c-bc357c787439 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:37:02.725923 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-9a311516-47f9-40e1-903c-bc357c787439 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:37:02.852573 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-9a311516-47f9-40e1-903c-bc357c787439 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c03f0365ee4a26b8c076ae365325b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfbc3a46f12942299b99cdd20c989e1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:37:02.860146 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-9a311516-47f9-40e1-903c-bc357c787439 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] 10.222.0.15 "GET /compute/v2.1/servers/46cae3a9-45e8-401c-b201-2ed4402e9e97" status: 200 len: 1367 microversion: 2.1 time: 0.147039 Oct 31 12:37:02.860906 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 305/599] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:37:02 2022] GET /compute/v2.1/servers/46cae3a9-45e8-401c-b201-2ed4402e9e97 => generated 1367 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:37:03.063349 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-1308d9d2-db2a-4d3f-a0a5-d8a4e0e233e6 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:37:03.064106 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-1308d9d2-db2a-4d3f-a0a5-d8a4e0e233e6 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] [instance: ee260508-cdfb-468d-9ff4-df06cc3bdadf] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:37:03.070647 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-1308d9d2-db2a-4d3f-a0a5-d8a4e0e233e6 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:37:03.071137 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-1308d9d2-db2a-4d3f-a0a5-d8a4e0e233e6 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:37:03.071596 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-1308d9d2-db2a-4d3f-a0a5-d8a4e0e233e6 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:37:03.072291 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-1308d9d2-db2a-4d3f-a0a5-d8a4e0e233e6 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:37:03.072743 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-1308d9d2-db2a-4d3f-a0a5-d8a4e0e233e6 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:37:03.073164 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-1308d9d2-db2a-4d3f-a0a5-d8a4e0e233e6 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:37:03.204630 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-1308d9d2-db2a-4d3f-a0a5-d8a4e0e233e6 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2e978bcb824a5e9d593b861c9e3bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7573cb9c503243ab90b1649591d550e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:37:03.214149 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-1308d9d2-db2a-4d3f-a0a5-d8a4e0e233e6 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] 10.222.0.15 "GET /compute/v2.1/servers/ee260508-cdfb-468d-9ff4-df06cc3bdadf" status: 200 len: 1737 microversion: 2.1 time: 0.155581 Oct 31 12:37:03.214897 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 295/600] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:37:03 2022] GET /compute/v2.1/servers/ee260508-cdfb-468d-9ff4-df06cc3bdadf => generated 1737 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 12:37:03.883498 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-f3093cfd-5504-4796-82fb-4150cd7859af tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:37:03.884095 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-f3093cfd-5504-4796-82fb-4150cd7859af tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] [instance: 46cae3a9-45e8-401c-b201-2ed4402e9e97] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:37:03.890309 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-f3093cfd-5504-4796-82fb-4150cd7859af tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:37:03.890778 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-f3093cfd-5504-4796-82fb-4150cd7859af tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:37:03.891226 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-f3093cfd-5504-4796-82fb-4150cd7859af tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:37:03.891904 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-f3093cfd-5504-4796-82fb-4150cd7859af tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:37:03.892345 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-f3093cfd-5504-4796-82fb-4150cd7859af tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:37:03.892756 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-f3093cfd-5504-4796-82fb-4150cd7859af tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:37:04.125711 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-f3093cfd-5504-4796-82fb-4150cd7859af tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c03f0365ee4a26b8c076ae365325b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfbc3a46f12942299b99cdd20c989e1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:37:04.134219 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-f3093cfd-5504-4796-82fb-4150cd7859af tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] 10.222.0.15 "GET /compute/v2.1/servers/46cae3a9-45e8-401c-b201-2ed4402e9e97" status: 200 len: 1367 microversion: 2.1 time: 0.254568 Oct 31 12:37:04.134788 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 306/601] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:37:03 2022] GET /compute/v2.1/servers/46cae3a9-45e8-401c-b201-2ed4402e9e97 => generated 1367 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:37:04.238847 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-aea8aadc-1ebc-43ae-bed3-edb2367492e4 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:37:04.239422 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-aea8aadc-1ebc-43ae-bed3-edb2367492e4 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] [instance: ee260508-cdfb-468d-9ff4-df06cc3bdadf] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:37:04.246702 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-aea8aadc-1ebc-43ae-bed3-edb2367492e4 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:37:04.248997 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-aea8aadc-1ebc-43ae-bed3-edb2367492e4 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:37:04.248997 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-aea8aadc-1ebc-43ae-bed3-edb2367492e4 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:37:04.248997 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-aea8aadc-1ebc-43ae-bed3-edb2367492e4 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:37:04.248997 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-aea8aadc-1ebc-43ae-bed3-edb2367492e4 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:37:04.249689 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-aea8aadc-1ebc-43ae-bed3-edb2367492e4 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:37:04.379619 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-aea8aadc-1ebc-43ae-bed3-edb2367492e4 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2e978bcb824a5e9d593b861c9e3bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7573cb9c503243ab90b1649591d550e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:37:04.388372 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-aea8aadc-1ebc-43ae-bed3-edb2367492e4 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] 10.222.0.15 "GET /compute/v2.1/servers/ee260508-cdfb-468d-9ff4-df06cc3bdadf" status: 200 len: 1737 microversion: 2.1 time: 0.154383 Oct 31 12:37:04.388936 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 296/602] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:37:04 2022] GET /compute/v2.1/servers/ee260508-cdfb-468d-9ff4-df06cc3bdadf => generated 1737 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:37:05.158917 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-1b789b19-2426-4eeb-8ee7-7955d6645f3f tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:37:05.159549 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-1b789b19-2426-4eeb-8ee7-7955d6645f3f tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] [instance: 46cae3a9-45e8-401c-b201-2ed4402e9e97] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:37:05.166624 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-1b789b19-2426-4eeb-8ee7-7955d6645f3f tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:37:05.167105 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-1b789b19-2426-4eeb-8ee7-7955d6645f3f tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:37:05.167555 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-1b789b19-2426-4eeb-8ee7-7955d6645f3f tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:37:05.168244 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-1b789b19-2426-4eeb-8ee7-7955d6645f3f tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:37:05.168691 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-1b789b19-2426-4eeb-8ee7-7955d6645f3f tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:37:05.169107 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-1b789b19-2426-4eeb-8ee7-7955d6645f3f tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:37:05.312087 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-1b789b19-2426-4eeb-8ee7-7955d6645f3f tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c03f0365ee4a26b8c076ae365325b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfbc3a46f12942299b99cdd20c989e1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:37:05.320860 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-1b789b19-2426-4eeb-8ee7-7955d6645f3f tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] 10.222.0.15 "GET /compute/v2.1/servers/46cae3a9-45e8-401c-b201-2ed4402e9e97" status: 200 len: 1367 microversion: 2.1 time: 0.165616 Oct 31 12:37:05.321594 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 307/603] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:37:05 2022] GET /compute/v2.1/servers/46cae3a9-45e8-401c-b201-2ed4402e9e97 => generated 1367 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:37:05.411095 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-3c774129-57bb-4ea1-8fc2-206fc57f7379 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:37:05.411747 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-3c774129-57bb-4ea1-8fc2-206fc57f7379 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] [instance: ee260508-cdfb-468d-9ff4-df06cc3bdadf] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:37:05.418662 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-3c774129-57bb-4ea1-8fc2-206fc57f7379 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:37:05.419135 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-3c774129-57bb-4ea1-8fc2-206fc57f7379 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:37:05.419586 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-3c774129-57bb-4ea1-8fc2-206fc57f7379 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:37:05.420264 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-3c774129-57bb-4ea1-8fc2-206fc57f7379 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:37:05.420706 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-3c774129-57bb-4ea1-8fc2-206fc57f7379 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:37:05.421120 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-3c774129-57bb-4ea1-8fc2-206fc57f7379 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:37:05.549720 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-3c774129-57bb-4ea1-8fc2-206fc57f7379 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2e978bcb824a5e9d593b861c9e3bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7573cb9c503243ab90b1649591d550e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:37:05.558519 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-3c774129-57bb-4ea1-8fc2-206fc57f7379 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] 10.222.0.15 "GET /compute/v2.1/servers/ee260508-cdfb-468d-9ff4-df06cc3bdadf" status: 200 len: 1737 microversion: 2.1 time: 0.151207 Oct 31 12:37:05.559290 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 297/604] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:37:05 2022] GET /compute/v2.1/servers/ee260508-cdfb-468d-9ff4-df06cc3bdadf => generated 1737 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:37:06.344988 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-24a15f12-f0b6-4598-b5d2-165f1578ebcf tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:37:06.345539 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-24a15f12-f0b6-4598-b5d2-165f1578ebcf tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] [instance: 46cae3a9-45e8-401c-b201-2ed4402e9e97] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:37:06.351974 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-24a15f12-f0b6-4598-b5d2-165f1578ebcf tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:37:06.352451 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-24a15f12-f0b6-4598-b5d2-165f1578ebcf tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:37:06.352871 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-24a15f12-f0b6-4598-b5d2-165f1578ebcf tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:37:06.353541 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-24a15f12-f0b6-4598-b5d2-165f1578ebcf tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:37:06.353987 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-24a15f12-f0b6-4598-b5d2-165f1578ebcf tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:37:06.354398 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-24a15f12-f0b6-4598-b5d2-165f1578ebcf tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:37:06.484392 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-24a15f12-f0b6-4598-b5d2-165f1578ebcf tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c03f0365ee4a26b8c076ae365325b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfbc3a46f12942299b99cdd20c989e1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:37:06.493645 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-24a15f12-f0b6-4598-b5d2-165f1578ebcf tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] 10.222.0.15 "GET /compute/v2.1/servers/46cae3a9-45e8-401c-b201-2ed4402e9e97" status: 200 len: 1367 microversion: 2.1 time: 0.152008 Oct 31 12:37:06.497102 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 308/605] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:37:06 2022] GET /compute/v2.1/servers/46cae3a9-45e8-401c-b201-2ed4402e9e97 => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:37:06.581757 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-46caf7fd-ee5f-4d16-9e98-2f3390f2a6af tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:37:06.582357 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-46caf7fd-ee5f-4d16-9e98-2f3390f2a6af tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] [instance: ee260508-cdfb-468d-9ff4-df06cc3bdadf] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:37:06.588798 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-46caf7fd-ee5f-4d16-9e98-2f3390f2a6af tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:37:06.589266 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-46caf7fd-ee5f-4d16-9e98-2f3390f2a6af tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:37:06.589688 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-46caf7fd-ee5f-4d16-9e98-2f3390f2a6af tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:37:06.590359 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-46caf7fd-ee5f-4d16-9e98-2f3390f2a6af tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:37:06.590803 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-46caf7fd-ee5f-4d16-9e98-2f3390f2a6af tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:37:06.591239 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-46caf7fd-ee5f-4d16-9e98-2f3390f2a6af tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:37:06.718820 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-46caf7fd-ee5f-4d16-9e98-2f3390f2a6af tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2e978bcb824a5e9d593b861c9e3bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7573cb9c503243ab90b1649591d550e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:37:06.727579 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-46caf7fd-ee5f-4d16-9e98-2f3390f2a6af tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] 10.222.0.15 "GET /compute/v2.1/servers/ee260508-cdfb-468d-9ff4-df06cc3bdadf" status: 200 len: 1737 microversion: 2.1 time: 0.149691 Oct 31 12:37:06.728141 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 298/606] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:37:06 2022] GET /compute/v2.1/servers/ee260508-cdfb-468d-9ff4-df06cc3bdadf => generated 1737 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:37:07.517694 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-70e7c15d-00ca-4989-9820-4527f087ae3c tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:37:07.518077 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-70e7c15d-00ca-4989-9820-4527f087ae3c tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] [instance: 46cae3a9-45e8-401c-b201-2ed4402e9e97] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:37:07.525090 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-70e7c15d-00ca-4989-9820-4527f087ae3c tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:37:07.525564 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-70e7c15d-00ca-4989-9820-4527f087ae3c tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:37:07.525991 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-70e7c15d-00ca-4989-9820-4527f087ae3c tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:37:07.526678 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-70e7c15d-00ca-4989-9820-4527f087ae3c tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:37:07.527122 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-70e7c15d-00ca-4989-9820-4527f087ae3c tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:37:07.527562 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-70e7c15d-00ca-4989-9820-4527f087ae3c tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:37:07.660166 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-70e7c15d-00ca-4989-9820-4527f087ae3c tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c03f0365ee4a26b8c076ae365325b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfbc3a46f12942299b99cdd20c989e1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:37:07.668323 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-70e7c15d-00ca-4989-9820-4527f087ae3c tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] 10.222.0.15 "GET /compute/v2.1/servers/46cae3a9-45e8-401c-b201-2ed4402e9e97" status: 200 len: 1367 microversion: 2.1 time: 0.155062 Oct 31 12:37:07.668895 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 309/607] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:37:07 2022] GET /compute/v2.1/servers/46cae3a9-45e8-401c-b201-2ed4402e9e97 => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:37:07.680229 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [req-def3a269-b66e-4c4c-93e2-1067f4b12dc2 req-78a297b9-c1b0-4aee-a86d-f47fa1547feb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46cae3a9-45e8-401c-b201-2ed4402e9e97", "name": "network-vif-plugged", "status": "completed", "tag": "81273f70-32ad-4271-bbb8-913808f06f34"}]} {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 12:37:07.690260 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [req-def3a269-b66e-4c4c-93e2-1067f4b12dc2 req-78a297b9-c1b0-4aee-a86d-f47fa1547feb service nova] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:37:07.690749 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [req-def3a269-b66e-4c4c-93e2-1067f4b12dc2 req-78a297b9-c1b0-4aee-a86d-f47fa1547feb service nova] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:37:07.691505 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [req-def3a269-b66e-4c4c-93e2-1067f4b12dc2 req-78a297b9-c1b0-4aee-a86d-f47fa1547feb service nova] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:37:07.702885 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.compute.server_external_events [req-def3a269-b66e-4c4c-93e2-1067f4b12dc2 req-78a297b9-c1b0-4aee-a86d-f47fa1547feb service nova] Creating event network-vif-plugged:81273f70-32ad-4271-bbb8-913808f06f34 for instance 46cae3a9-45e8-401c-b201-2ed4402e9e97 on hv-cinder-79617 Oct 31 12:37:07.707617 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [req-def3a269-b66e-4c4c-93e2-1067f4b12dc2 req-78a297b9-c1b0-4aee-a86d-f47fa1547feb service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031739 Oct 31 12:37:07.708205 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 299/608] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Oct 31 12:37:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 12:37:07.751030 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-9d32ec12-ea81-4ffc-ac1b-748d2686c83c tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:37:07.751654 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-9d32ec12-ea81-4ffc-ac1b-748d2686c83c tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] [instance: ee260508-cdfb-468d-9ff4-df06cc3bdadf] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:37:07.757713 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-9d32ec12-ea81-4ffc-ac1b-748d2686c83c tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:37:07.758190 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-9d32ec12-ea81-4ffc-ac1b-748d2686c83c tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:37:07.758607 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-9d32ec12-ea81-4ffc-ac1b-748d2686c83c tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:37:07.759306 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-9d32ec12-ea81-4ffc-ac1b-748d2686c83c tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:37:07.759751 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-9d32ec12-ea81-4ffc-ac1b-748d2686c83c tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:37:07.760160 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-9d32ec12-ea81-4ffc-ac1b-748d2686c83c tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:37:07.889243 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-9d32ec12-ea81-4ffc-ac1b-748d2686c83c tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2e978bcb824a5e9d593b861c9e3bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7573cb9c503243ab90b1649591d550e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:37:07.900770 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-9d32ec12-ea81-4ffc-ac1b-748d2686c83c tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] 10.222.0.15 "GET /compute/v2.1/servers/ee260508-cdfb-468d-9ff4-df06cc3bdadf" status: 200 len: 1737 microversion: 2.1 time: 0.153474 Oct 31 12:37:07.901285 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 310/609] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:37:07 2022] GET /compute/v2.1/servers/ee260508-cdfb-468d-9ff4-df06cc3bdadf => generated 1737 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:37:08.691386 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-1ab34f72-bfd3-4a66-99f9-1b20be9381a3 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:37:08.692077 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-1ab34f72-bfd3-4a66-99f9-1b20be9381a3 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] [instance: 46cae3a9-45e8-401c-b201-2ed4402e9e97] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:37:08.699066 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-1ab34f72-bfd3-4a66-99f9-1b20be9381a3 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:37:08.699568 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-1ab34f72-bfd3-4a66-99f9-1b20be9381a3 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:37:08.699997 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-1ab34f72-bfd3-4a66-99f9-1b20be9381a3 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:37:08.700672 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-1ab34f72-bfd3-4a66-99f9-1b20be9381a3 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:37:08.701118 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-1ab34f72-bfd3-4a66-99f9-1b20be9381a3 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:37:08.701535 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-1ab34f72-bfd3-4a66-99f9-1b20be9381a3 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:37:08.831145 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-1ab34f72-bfd3-4a66-99f9-1b20be9381a3 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c03f0365ee4a26b8c076ae365325b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfbc3a46f12942299b99cdd20c989e1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:37:08.838799 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-1ab34f72-bfd3-4a66-99f9-1b20be9381a3 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] 10.222.0.15 "GET /compute/v2.1/servers/46cae3a9-45e8-401c-b201-2ed4402e9e97" status: 200 len: 1367 microversion: 2.1 time: 0.152187 Oct 31 12:37:08.839389 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 300/610] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:37:08 2022] GET /compute/v2.1/servers/46cae3a9-45e8-401c-b201-2ed4402e9e97 => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:37:08.924080 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-1c7ae7c4-eb27-4d58-834b-43a32814d690 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:37:08.924672 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-1c7ae7c4-eb27-4d58-834b-43a32814d690 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] [instance: ee260508-cdfb-468d-9ff4-df06cc3bdadf] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:37:08.931661 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-1c7ae7c4-eb27-4d58-834b-43a32814d690 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:37:08.932128 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-1c7ae7c4-eb27-4d58-834b-43a32814d690 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:37:08.932551 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-1c7ae7c4-eb27-4d58-834b-43a32814d690 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:37:08.933223 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-1c7ae7c4-eb27-4d58-834b-43a32814d690 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:37:08.933666 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-1c7ae7c4-eb27-4d58-834b-43a32814d690 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:37:08.934077 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-1c7ae7c4-eb27-4d58-834b-43a32814d690 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:37:09.064095 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-1c7ae7c4-eb27-4d58-834b-43a32814d690 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2e978bcb824a5e9d593b861c9e3bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7573cb9c503243ab90b1649591d550e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:37:09.072374 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-1c7ae7c4-eb27-4d58-834b-43a32814d690 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] 10.222.0.15 "GET /compute/v2.1/servers/ee260508-cdfb-468d-9ff4-df06cc3bdadf" status: 200 len: 1737 microversion: 2.1 time: 0.152097 Oct 31 12:37:09.072930 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 311/611] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:37:08 2022] GET /compute/v2.1/servers/ee260508-cdfb-468d-9ff4-df06cc3bdadf => generated 1737 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:37:09.861013 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-1769769a-927e-403f-aaa0-a97235dd47ec tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:37:09.861617 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-1769769a-927e-403f-aaa0-a97235dd47ec tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] [instance: 46cae3a9-45e8-401c-b201-2ed4402e9e97] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:37:09.863543 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG dbcounter [-] [125441] Writing DB stats nova_cell0:SELECT=2 {{(pid=125441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:37:09.864271 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG dbcounter [-] [125441] Writing DB stats nova_cell0:SELECT=12 {{(pid=125441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:37:09.871656 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-1769769a-927e-403f-aaa0-a97235dd47ec tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:37:09.872132 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-1769769a-927e-403f-aaa0-a97235dd47ec tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:37:09.872556 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-1769769a-927e-403f-aaa0-a97235dd47ec tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:37:09.873236 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-1769769a-927e-403f-aaa0-a97235dd47ec tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:37:09.873682 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-1769769a-927e-403f-aaa0-a97235dd47ec tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:37:09.874096 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-1769769a-927e-403f-aaa0-a97235dd47ec tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:37:10.002629 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-1769769a-927e-403f-aaa0-a97235dd47ec tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c03f0365ee4a26b8c076ae365325b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfbc3a46f12942299b99cdd20c989e1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:37:10.010192 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-1769769a-927e-403f-aaa0-a97235dd47ec tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] 10.222.0.15 "GET /compute/v2.1/servers/46cae3a9-45e8-401c-b201-2ed4402e9e97" status: 200 len: 1367 microversion: 2.1 time: 0.153037 Oct 31 12:37:10.010756 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 301/612] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:37:09 2022] GET /compute/v2.1/servers/46cae3a9-45e8-401c-b201-2ed4402e9e97 => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:37:10.094917 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-6660e23b-46a7-4538-b0b9-441479c55843 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:37:10.095565 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-6660e23b-46a7-4538-b0b9-441479c55843 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] [instance: ee260508-cdfb-468d-9ff4-df06cc3bdadf] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:37:10.102446 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-6660e23b-46a7-4538-b0b9-441479c55843 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:37:10.102910 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-6660e23b-46a7-4538-b0b9-441479c55843 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:37:10.103365 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-6660e23b-46a7-4538-b0b9-441479c55843 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:37:10.104039 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-6660e23b-46a7-4538-b0b9-441479c55843 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:37:10.104481 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-6660e23b-46a7-4538-b0b9-441479c55843 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:37:10.104891 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-6660e23b-46a7-4538-b0b9-441479c55843 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:37:10.236087 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-6660e23b-46a7-4538-b0b9-441479c55843 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2e978bcb824a5e9d593b861c9e3bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7573cb9c503243ab90b1649591d550e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:37:10.244256 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-6660e23b-46a7-4538-b0b9-441479c55843 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] 10.222.0.15 "GET /compute/v2.1/servers/ee260508-cdfb-468d-9ff4-df06cc3bdadf" status: 200 len: 1717 microversion: 2.1 time: 0.153119 Oct 31 12:37:10.244810 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 312/613] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:37:10 2022] GET /compute/v2.1/servers/ee260508-cdfb-468d-9ff4-df06cc3bdadf => generated 1717 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 12:37:10.360727 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-29f9a7ac-5fec-4fd2-8c81-a9e51c0b15d6 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:37:10.361202 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-29f9a7ac-5fec-4fd2-8c81-a9e51c0b15d6 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] [instance: ee260508-cdfb-468d-9ff4-df06cc3bdadf] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:37:10.367143 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-29f9a7ac-5fec-4fd2-8c81-a9e51c0b15d6 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:37:10.367762 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-29f9a7ac-5fec-4fd2-8c81-a9e51c0b15d6 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:37:10.368217 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-29f9a7ac-5fec-4fd2-8c81-a9e51c0b15d6 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:37:10.368912 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-29f9a7ac-5fec-4fd2-8c81-a9e51c0b15d6 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:37:10.369555 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-29f9a7ac-5fec-4fd2-8c81-a9e51c0b15d6 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:37:10.369974 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-29f9a7ac-5fec-4fd2-8c81-a9e51c0b15d6 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:37:10.494548 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.wsgi [None req-29f9a7ac-5fec-4fd2-8c81-a9e51c0b15d6 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] HTTP exception thrown: Cannot 'detach_volume' instance ee260508-cdfb-468d-9ff4-df06cc3bdadf while it is in vm_state rescued Oct 31 12:37:10.496175 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-29f9a7ac-5fec-4fd2-8c81-a9e51c0b15d6 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Request method failure captured: Oct 31 12:37:10.496175 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: request: DELETE /compute/v2.1/servers/ee260508-cdfb-468d-9ff4-df06cc3bdadf/os-volume_attachments/88e52680-9a7e-4b34-8457-f009b875caee HTTP/1.1 Oct 31 12:37:10.496175 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: Accept: application/json Oct 31 12:37:10.496175 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: Accept-Encoding: identity Oct 31 12:37:10.496175 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: Connection: close Oct 31 12:37:10.496175 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: Content-Length: 0 Oct 31 12:37:10.496175 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: Content-Type: application/json Oct 31 12:37:10.496175 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: Host: 10.222.0.15 Oct 31 12:37:10.496175 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: Openstack-System-Scope: None Oct 31 12:37:10.496175 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: User-Agent: python-urllib3/1.26.12 Oct 31 12:37:10.496175 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Auth-Token: gAAAAABjX8B9TbEC4h9BQ_Pg6iyHk1PnZ6xM8QTj0p7BN52PNmExSmli9L2RQnu8wsaJHiorFY0ROJy8DFUPBMj8D1dWQd22JAoLKdxFZnWHPiWQc3-KjGpPHBlTK_jmIsaeVJlcwD00sScGPd4UgCUOBwD-FKwNC8xgXuheB5YggUWlcx9L5tw Oct 31 12:37:10.496175 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Domain-Id: None Oct 31 12:37:10.496175 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Domain-Name: None Oct 31 12:37:10.496175 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Identity-Status: Confirmed Oct 31 12:37:10.496175 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Is-Admin-Project: True Oct 31 12:37:10.496175 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Project-Domain-Id: default Oct 31 12:37:10.496175 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Project-Domain-Name: Default Oct 31 12:37:10.496175 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Project-Id: 7573cb9c503243ab90b1649591d550e6 Oct 31 12:37:10.496175 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1357722577 Oct 31 12:37:10.496175 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Role: reader,member Oct 31 12:37:10.496175 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Roles: reader,member Oct 31 12:37:10.497465 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/7573cb9c503243ab90b1649591d550e6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_7573cb9c503243ab90b1649591d550e6", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/7573cb9c503243ab90b1649591d550e6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/7573cb9c503243ab90b1649591d550e6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Oct 31 12:37:10.497465 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1357722577 Oct 31 12:37:10.497465 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Tenant-Id: 7573cb9c503243ab90b1649591d550e6 Oct 31 12:37:10.497465 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1357722577 Oct 31 12:37:10.497465 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-User: tempest-ServerRescueNegativeTestJSON-1357722577-project Oct 31 12:37:10.497465 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-User-Domain-Id: default Oct 31 12:37:10.497465 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-User-Domain-Name: Default Oct 31 12:37:10.497465 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-User-Id: db2e978bcb824a5e9d593b861c9e3bd7 Oct 31 12:37:10.497465 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1357722577-project Oct 31 12:37:10.497465 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: method: > Oct 31 12:37:10.497465 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: exception: Cannot 'detach_volume' instance ee260508-cdfb-468d-9ff4-df06cc3bdadf while it is in vm_state rescued Oct 31 12:37:10.498100 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: action_args: {'server_id': 'ee260508-cdfb-468d-9ff4-df06cc3bdadf', 'id': '88e52680-9a7e-4b34-8457-f009b875caee'} Oct 31 12:37:10.498100 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 12:37:10.498100 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 12:37:10.498100 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Oct 31 12:37:10.498100 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Oct 31 12:37:10.498100 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 31 12:37:10.498100 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 31 12:37:10.498100 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 31 12:37:10.498100 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 31 12:37:10.498100 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance ee260508-cdfb-468d-9ff4-df06cc3bdadf in vm_state rescued. Cannot detach_volume while the instance is in this state. Oct 31 12:37:10.498100 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Oct 31 12:37:10.498100 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 12:37:10.498100 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Oct 31 12:37:10.498100 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 12:37:10.498100 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 12:37:10.498100 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 12:37:10.498100 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 12:37:10.498100 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 12:37:10.498100 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 12:37:10.498100 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 12:37:10.499444 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Oct 31 12:37:10.499444 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 31 12:37:10.499444 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 31 12:37:10.499444 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 31 12:37:10.499444 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance ee260508-cdfb-468d-9ff4-df06cc3bdadf while it is in vm_state rescued Oct 31 12:37:10.499444 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Oct 31 12:37:10.499444 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 12:37:10.499444 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Oct 31 12:37:10.499444 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 12:37:10.499444 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 12:37:10.499444 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 12:37:10.499444 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 12:37:10.499444 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 12:37:10.499444 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance ee260508-cdfb-468d-9ff4-df06cc3bdadf while it is in vm_state rescued Oct 31 12:37:10.499444 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Oct 31 12:37:10.499444 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-29f9a7ac-5fec-4fd2-8c81-a9e51c0b15d6 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Returning 409 to user: Cannot 'detach_volume' instance ee260508-cdfb-468d-9ff4-df06cc3bdadf while it is in vm_state rescued {{(pid=125441) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 12:37:10.500662 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-29f9a7ac-5fec-4fd2-8c81-a9e51c0b15d6 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] 10.222.0.15 "DELETE /compute/v2.1/servers/ee260508-cdfb-468d-9ff4-df06cc3bdadf/os-volume_attachments/88e52680-9a7e-4b34-8457-f009b875caee" status: 409 len: 152 microversion: 2.1 time: 0.140844 Oct 31 12:37:10.500662 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 302/614] 10.222.0.15 () {58 vars in 1416 bytes} [Mon Oct 31 12:37:10 2022] DELETE /compute/v2.1/servers/ee260508-cdfb-468d-9ff4-df06cc3bdadf/os-volume_attachments/88e52680-9a7e-4b34-8457-f009b875caee => generated 152 bytes in 142 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 31 12:37:10.506316 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-6cb82c76-fac1-4757-a425-5c649325f55a tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 12:37:10.506873 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-6cb82c76-fac1-4757-a425-5c649325f55a tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] [instance: ee260508-cdfb-468d-9ff4-df06cc3bdadf] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:37:10.513660 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-6cb82c76-fac1-4757-a425-5c649325f55a tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:37:10.514139 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-6cb82c76-fac1-4757-a425-5c649325f55a tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:37:10.514571 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-6cb82c76-fac1-4757-a425-5c649325f55a tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:37:10.515344 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-6cb82c76-fac1-4757-a425-5c649325f55a tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:37:10.515796 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-6cb82c76-fac1-4757-a425-5c649325f55a tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:37:10.516210 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-6cb82c76-fac1-4757-a425-5c649325f55a tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:37:10.581004 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-6cb82c76-fac1-4757-a425-5c649325f55a tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] 10.222.0.15 "POST /compute/v2.1/servers/ee260508-cdfb-468d-9ff4-df06cc3bdadf/action" status: 202 len: 0 microversion: 2.1 time: 0.078325 Oct 31 12:37:10.581632 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 313/615] 10.222.0.15 () {60 vars in 1278 bytes} [Mon Oct 31 12:37:10 2022] POST /compute/v2.1/servers/ee260508-cdfb-468d-9ff4-df06cc3bdadf/action => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 12:37:10.590647 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-320e48b0-088a-4d32-b6d7-739cfbe88bb8 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:37:10.591284 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-320e48b0-088a-4d32-b6d7-739cfbe88bb8 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] [instance: ee260508-cdfb-468d-9ff4-df06cc3bdadf] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:37:10.597908 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-320e48b0-088a-4d32-b6d7-739cfbe88bb8 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:37:10.598373 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-320e48b0-088a-4d32-b6d7-739cfbe88bb8 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:37:10.598810 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-320e48b0-088a-4d32-b6d7-739cfbe88bb8 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:37:10.599526 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-320e48b0-088a-4d32-b6d7-739cfbe88bb8 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:37:10.600001 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-320e48b0-088a-4d32-b6d7-739cfbe88bb8 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:37:10.600409 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-320e48b0-088a-4d32-b6d7-739cfbe88bb8 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:37:10.729917 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-320e48b0-088a-4d32-b6d7-739cfbe88bb8 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2e978bcb824a5e9d593b861c9e3bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7573cb9c503243ab90b1649591d550e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:37:10.738110 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-320e48b0-088a-4d32-b6d7-739cfbe88bb8 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] 10.222.0.15 "GET /compute/v2.1/servers/ee260508-cdfb-468d-9ff4-df06cc3bdadf" status: 200 len: 1725 microversion: 2.1 time: 0.152300 Oct 31 12:37:10.738670 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 303/616] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:37:10 2022] GET /compute/v2.1/servers/ee260508-cdfb-468d-9ff4-df06cc3bdadf => generated 1725 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:37:11.034582 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-b4419f55-61c0-4a12-a332-d2725d98774b tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:37:11.035300 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-b4419f55-61c0-4a12-a332-d2725d98774b tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] [instance: 46cae3a9-45e8-401c-b201-2ed4402e9e97] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:37:11.042122 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-b4419f55-61c0-4a12-a332-d2725d98774b tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:37:11.042710 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-b4419f55-61c0-4a12-a332-d2725d98774b tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:37:11.043146 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-b4419f55-61c0-4a12-a332-d2725d98774b tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:37:11.043851 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-b4419f55-61c0-4a12-a332-d2725d98774b tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:37:11.044298 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-b4419f55-61c0-4a12-a332-d2725d98774b tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:37:11.044713 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-b4419f55-61c0-4a12-a332-d2725d98774b tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:37:11.255209 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-b4419f55-61c0-4a12-a332-d2725d98774b tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c03f0365ee4a26b8c076ae365325b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfbc3a46f12942299b99cdd20c989e1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:37:11.263593 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-b4419f55-61c0-4a12-a332-d2725d98774b tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] 10.222.0.15 "GET /compute/v2.1/servers/46cae3a9-45e8-401c-b201-2ed4402e9e97" status: 200 len: 1558 microversion: 2.1 time: 0.233504 Oct 31 12:37:11.264155 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 314/617] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:37:11 2022] GET /compute/v2.1/servers/46cae3a9-45e8-401c-b201-2ed4402e9e97 => generated 1558 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:37:11.287131 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-28768ea6-b25f-46a8-86b4-ac392d221d65 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:37:11.287681 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-28768ea6-b25f-46a8-86b4-ac392d221d65 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] [instance: 46cae3a9-45e8-401c-b201-2ed4402e9e97] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:37:11.294983 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-28768ea6-b25f-46a8-86b4-ac392d221d65 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:37:11.295491 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-28768ea6-b25f-46a8-86b4-ac392d221d65 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:37:11.295915 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-28768ea6-b25f-46a8-86b4-ac392d221d65 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:37:11.296594 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-28768ea6-b25f-46a8-86b4-ac392d221d65 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:37:11.297094 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-28768ea6-b25f-46a8-86b4-ac392d221d65 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:37:11.297508 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-28768ea6-b25f-46a8-86b4-ac392d221d65 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:37:11.375396 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-28768ea6-b25f-46a8-86b4-ac392d221d65 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] 10.222.0.15 "GET /compute/v2.1/servers/46cae3a9-45e8-401c-b201-2ed4402e9e97/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.092251 Oct 31 12:37:11.375994 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 304/618] 10.222.0.15 () {58 vars in 1275 bytes} [Mon Oct 31 12:37:11 2022] GET /compute/v2.1/servers/46cae3a9-45e8-401c-b201-2ed4402e9e97/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 12:37:11.760876 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-b77d9050-d83d-497f-b8ec-7fa4ec4500e0 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:37:11.761581 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-b77d9050-d83d-497f-b8ec-7fa4ec4500e0 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] [instance: ee260508-cdfb-468d-9ff4-df06cc3bdadf] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:37:11.767578 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-b77d9050-d83d-497f-b8ec-7fa4ec4500e0 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:37:11.768057 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-b77d9050-d83d-497f-b8ec-7fa4ec4500e0 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:37:11.768483 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-b77d9050-d83d-497f-b8ec-7fa4ec4500e0 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:37:11.769164 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-b77d9050-d83d-497f-b8ec-7fa4ec4500e0 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:37:11.769888 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-b77d9050-d83d-497f-b8ec-7fa4ec4500e0 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:37:11.770306 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-b77d9050-d83d-497f-b8ec-7fa4ec4500e0 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:37:11.902944 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-b77d9050-d83d-497f-b8ec-7fa4ec4500e0 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2e978bcb824a5e9d593b861c9e3bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7573cb9c503243ab90b1649591d550e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:37:11.911056 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-b77d9050-d83d-497f-b8ec-7fa4ec4500e0 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] 10.222.0.15 "GET /compute/v2.1/servers/ee260508-cdfb-468d-9ff4-df06cc3bdadf" status: 200 len: 1725 microversion: 2.1 time: 0.154209 Oct 31 12:37:11.911842 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 315/619] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:37:11 2022] GET /compute/v2.1/servers/ee260508-cdfb-468d-9ff4-df06cc3bdadf => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:37:12.300465 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [req-1576bdcf-f040-4077-a6ca-f20abb5af408 req-5ebebafb-3eba-4850-bfa4-e5aced5c9de3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "46cae3a9-45e8-401c-b201-2ed4402e9e97", "tag": "81273f70-32ad-4271-bbb8-913808f06f34"}]} {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 12:37:12.312185 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [req-1576bdcf-f040-4077-a6ca-f20abb5af408 req-5ebebafb-3eba-4850-bfa4-e5aced5c9de3 service nova] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:37:12.312661 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [req-1576bdcf-f040-4077-a6ca-f20abb5af408 req-5ebebafb-3eba-4850-bfa4-e5aced5c9de3 service nova] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:37:12.313081 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [req-1576bdcf-f040-4077-a6ca-f20abb5af408 req-5ebebafb-3eba-4850-bfa4-e5aced5c9de3 service nova] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:37:12.324751 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.compute.server_external_events [req-1576bdcf-f040-4077-a6ca-f20abb5af408 req-5ebebafb-3eba-4850-bfa4-e5aced5c9de3 service nova] Creating event network-changed:81273f70-32ad-4271-bbb8-913808f06f34 for instance 46cae3a9-45e8-401c-b201-2ed4402e9e97 on hv-cinder-79617 Oct 31 12:37:12.329578 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [req-1576bdcf-f040-4077-a6ca-f20abb5af408 req-5ebebafb-3eba-4850-bfa4-e5aced5c9de3 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033202 Oct 31 12:37:12.330151 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 305/620] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Oct 31 12:37:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 12:37:12.935323 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-9363da93-676c-40cf-a98b-e7cf056bee48 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:37:12.935863 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-9363da93-676c-40cf-a98b-e7cf056bee48 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] [instance: ee260508-cdfb-468d-9ff4-df06cc3bdadf] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:37:12.942137 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-9363da93-676c-40cf-a98b-e7cf056bee48 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:37:12.942612 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-9363da93-676c-40cf-a98b-e7cf056bee48 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:37:12.943044 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-9363da93-676c-40cf-a98b-e7cf056bee48 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:37:12.943742 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-9363da93-676c-40cf-a98b-e7cf056bee48 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:37:12.944190 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-9363da93-676c-40cf-a98b-e7cf056bee48 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:37:12.944615 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-9363da93-676c-40cf-a98b-e7cf056bee48 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:37:12.964886 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG dbcounter [-] [125440] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:37:13.080053 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-9363da93-676c-40cf-a98b-e7cf056bee48 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2e978bcb824a5e9d593b861c9e3bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7573cb9c503243ab90b1649591d550e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:37:13.088863 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-9363da93-676c-40cf-a98b-e7cf056bee48 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] 10.222.0.15 "GET /compute/v2.1/servers/ee260508-cdfb-468d-9ff4-df06cc3bdadf" status: 200 len: 1725 microversion: 2.1 time: 0.157476 Oct 31 12:37:13.089436 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 316/621] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:37:12 2022] GET /compute/v2.1/servers/ee260508-cdfb-468d-9ff4-df06cc3bdadf => generated 1725 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:37:14.112967 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-26173597-7445-4d2e-a111-a1a5943fecdb tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:37:14.113857 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-26173597-7445-4d2e-a111-a1a5943fecdb tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] [instance: ee260508-cdfb-468d-9ff4-df06cc3bdadf] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:37:14.116303 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG dbcounter [-] [125441] Writing DB stats nova_api:SELECT=89,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=125441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:37:14.122798 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-26173597-7445-4d2e-a111-a1a5943fecdb tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:37:14.123310 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-26173597-7445-4d2e-a111-a1a5943fecdb tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:37:14.123733 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-26173597-7445-4d2e-a111-a1a5943fecdb tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:37:14.124422 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-26173597-7445-4d2e-a111-a1a5943fecdb tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:37:14.124866 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-26173597-7445-4d2e-a111-a1a5943fecdb tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:37:14.125279 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-26173597-7445-4d2e-a111-a1a5943fecdb tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:37:14.263612 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-26173597-7445-4d2e-a111-a1a5943fecdb tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2e978bcb824a5e9d593b861c9e3bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7573cb9c503243ab90b1649591d550e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:37:14.271984 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-26173597-7445-4d2e-a111-a1a5943fecdb tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] 10.222.0.15 "GET /compute/v2.1/servers/ee260508-cdfb-468d-9ff4-df06cc3bdadf" status: 200 len: 1731 microversion: 2.1 time: 0.163309 Oct 31 12:37:14.272551 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 306/622] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:37:14 2022] GET /compute/v2.1/servers/ee260508-cdfb-468d-9ff4-df06cc3bdadf => generated 1731 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:37:14.294745 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-1200ff4e-201d-4249-b42f-33ab77b3421d tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:37:14.295327 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-1200ff4e-201d-4249-b42f-33ab77b3421d tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] [instance: ee260508-cdfb-468d-9ff4-df06cc3bdadf] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:37:14.301545 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-1200ff4e-201d-4249-b42f-33ab77b3421d tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:37:14.302026 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-1200ff4e-201d-4249-b42f-33ab77b3421d tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:37:14.302464 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-1200ff4e-201d-4249-b42f-33ab77b3421d tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:37:14.303150 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-1200ff4e-201d-4249-b42f-33ab77b3421d tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:37:14.303648 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-1200ff4e-201d-4249-b42f-33ab77b3421d tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:37:14.304062 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-1200ff4e-201d-4249-b42f-33ab77b3421d tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:37:14.412948 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-1200ff4e-201d-4249-b42f-33ab77b3421d tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] 10.222.0.15 "GET /compute/v2.1/servers/ee260508-cdfb-468d-9ff4-df06cc3bdadf/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.121974 Oct 31 12:37:14.413602 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 317/623] 10.222.0.15 () {58 vars in 1275 bytes} [Mon Oct 31 12:37:14 2022] GET /compute/v2.1/servers/ee260508-cdfb-468d-9ff4-df06cc3bdadf/os-interface => generated 284 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 12:37:15.503052 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [req-2fd6c758-e72f-4f60-a0ec-0cf873b393cb req-63c16263-1588-4ecc-9a8c-31b8a1054206 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee260508-cdfb-468d-9ff4-df06cc3bdadf", "tag": "7591dba3-56f4-4739-8b1f-33a42a9073b1"}]} {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 12:37:15.513767 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [req-2fd6c758-e72f-4f60-a0ec-0cf873b393cb req-63c16263-1588-4ecc-9a8c-31b8a1054206 service nova] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:37:15.514369 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [req-2fd6c758-e72f-4f60-a0ec-0cf873b393cb req-63c16263-1588-4ecc-9a8c-31b8a1054206 service nova] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:37:15.514895 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [req-2fd6c758-e72f-4f60-a0ec-0cf873b393cb req-63c16263-1588-4ecc-9a8c-31b8a1054206 service nova] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:37:15.527072 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.compute.server_external_events [req-2fd6c758-e72f-4f60-a0ec-0cf873b393cb req-63c16263-1588-4ecc-9a8c-31b8a1054206 service nova] Creating event network-changed:7591dba3-56f4-4739-8b1f-33a42a9073b1 for instance ee260508-cdfb-468d-9ff4-df06cc3bdadf on hv-cinder-79617 Oct 31 12:37:15.535093 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [req-2fd6c758-e72f-4f60-a0ec-0cf873b393cb req-63c16263-1588-4ecc-9a8c-31b8a1054206 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035855 Oct 31 12:37:15.535744 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 307/624] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Oct 31 12:37:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 12:37:17.549767 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [req-df1e1e48-55a5-4dc4-aaae-1f00eb39755b req-38bfab4c-15b7-47bc-b283-38b00d7cfe87 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee260508-cdfb-468d-9ff4-df06cc3bdadf", "tag": "7591dba3-56f4-4739-8b1f-33a42a9073b1"}]} {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 12:37:17.559844 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [req-df1e1e48-55a5-4dc4-aaae-1f00eb39755b req-38bfab4c-15b7-47bc-b283-38b00d7cfe87 service nova] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:37:17.560313 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [req-df1e1e48-55a5-4dc4-aaae-1f00eb39755b req-38bfab4c-15b7-47bc-b283-38b00d7cfe87 service nova] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:37:17.560732 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [req-df1e1e48-55a5-4dc4-aaae-1f00eb39755b req-38bfab4c-15b7-47bc-b283-38b00d7cfe87 service nova] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:37:17.571472 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.compute.server_external_events [req-df1e1e48-55a5-4dc4-aaae-1f00eb39755b req-38bfab4c-15b7-47bc-b283-38b00d7cfe87 service nova] Creating event network-changed:7591dba3-56f4-4739-8b1f-33a42a9073b1 for instance ee260508-cdfb-468d-9ff4-df06cc3bdadf on hv-cinder-79617 Oct 31 12:37:17.576258 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [req-df1e1e48-55a5-4dc4-aaae-1f00eb39755b req-38bfab4c-15b7-47bc-b283-38b00d7cfe87 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030735 Oct 31 12:37:17.576825 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 318/625] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Oct 31 12:37:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 12:37:25.365606 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-05d6f824-a1ac-4fe2-bd28-24857f0377df tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:37:25.366149 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-05d6f824-a1ac-4fe2-bd28-24857f0377df tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] [instance: 852e8870-b3ec-4a21-a9b5-e31a423ddd3d] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:37:25.372611 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-05d6f824-a1ac-4fe2-bd28-24857f0377df tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:37:25.373081 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-05d6f824-a1ac-4fe2-bd28-24857f0377df tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:37:25.373506 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-05d6f824-a1ac-4fe2-bd28-24857f0377df tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:37:25.374179 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-05d6f824-a1ac-4fe2-bd28-24857f0377df tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:37:25.374638 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-05d6f824-a1ac-4fe2-bd28-24857f0377df tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:37:25.375036 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-05d6f824-a1ac-4fe2-bd28-24857f0377df tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:37:25.377436 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG dbcounter [-] [125441] Writing DB stats nova_cell1:SELECT=88 {{(pid=125441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:37:25.408549 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-05d6f824-a1ac-4fe2-bd28-24857f0377df tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] 10.222.0.15 "GET /compute/v2.1/servers/852e8870-b3ec-4a21-a9b5-e31a423ddd3d/os-volume_attachments/aa1967e3-6d8f-4832-b20b-ed03ce790419" status: 200 len: 194 microversion: 2.20 time: 0.048126 Oct 31 12:37:25.409137 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 308/626] 10.222.0.15 () {60 vars in 1454 bytes} [Mon Oct 31 12:37:25 2022] GET /compute/v2.1/servers/852e8870-b3ec-4a21-a9b5-e31a423ddd3d/os-volume_attachments/aa1967e3-6d8f-4832-b20b-ed03ce790419 => generated 194 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 12:37:25.478608 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-30a5dadc-1f70-41ce-9c8f-3d333699e1d8 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:37:25.479186 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-30a5dadc-1f70-41ce-9c8f-3d333699e1d8 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] [instance: 852e8870-b3ec-4a21-a9b5-e31a423ddd3d] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:37:25.481126 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG dbcounter [-] [125440] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=1 {{(pid=125440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:37:25.486449 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-30a5dadc-1f70-41ce-9c8f-3d333699e1d8 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:37:25.486922 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-30a5dadc-1f70-41ce-9c8f-3d333699e1d8 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:37:25.487382 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-30a5dadc-1f70-41ce-9c8f-3d333699e1d8 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:37:25.488068 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-30a5dadc-1f70-41ce-9c8f-3d333699e1d8 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:37:25.488516 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-30a5dadc-1f70-41ce-9c8f-3d333699e1d8 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:37:25.488930 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-30a5dadc-1f70-41ce-9c8f-3d333699e1d8 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:37:25.569573 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.objects.instance [None req-30a5dadc-1f70-41ce-9c8f-3d333699e1d8 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lazy-loading 'services' on Instance uuid 852e8870-b3ec-4a21-a9b5-e31a423ddd3d {{(pid=125440) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 12:37:25.642318 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-30a5dadc-1f70-41ce-9c8f-3d333699e1d8 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] 10.222.0.15 "DELETE /compute/v2.1/servers/852e8870-b3ec-4a21-a9b5-e31a423ddd3d/os-volume_attachments/aa1967e3-6d8f-4832-b20b-ed03ce790419" status: 202 len: 0 microversion: 2.20 time: 0.169226 Oct 31 12:37:25.642898 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 319/627] 10.222.0.15 () {60 vars in 1457 bytes} [Mon Oct 31 12:37:25 2022] DELETE /compute/v2.1/servers/852e8870-b3ec-4a21-a9b5-e31a423ddd3d/os-volume_attachments/aa1967e3-6d8f-4832-b20b-ed03ce790419 => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 31 12:37:25.652573 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-a00499c9-9bb1-4b9e-b39d-754e8cd62de2 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:37:25.654702 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-a00499c9-9bb1-4b9e-b39d-754e8cd62de2 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] [instance: 852e8870-b3ec-4a21-a9b5-e31a423ddd3d] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:37:25.661132 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-a00499c9-9bb1-4b9e-b39d-754e8cd62de2 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:37:25.661764 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-a00499c9-9bb1-4b9e-b39d-754e8cd62de2 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:37:25.662248 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-a00499c9-9bb1-4b9e-b39d-754e8cd62de2 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:37:25.663127 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-a00499c9-9bb1-4b9e-b39d-754e8cd62de2 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:37:25.664141 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-a00499c9-9bb1-4b9e-b39d-754e8cd62de2 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:37:25.664624 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-a00499c9-9bb1-4b9e-b39d-754e8cd62de2 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:37:25.695931 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-a00499c9-9bb1-4b9e-b39d-754e8cd62de2 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] 10.222.0.15 "GET /compute/v2.1/servers/852e8870-b3ec-4a21-a9b5-e31a423ddd3d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048309 Oct 31 12:37:25.696881 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 309/628] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Oct 31 12:37:25 2022] GET /compute/v2.1/servers/852e8870-b3ec-4a21-a9b5-e31a423ddd3d/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 12:37:26.709861 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-b97a5444-ce3a-4e2d-9d37-279302e9120d tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:37:26.712603 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-b97a5444-ce3a-4e2d-9d37-279302e9120d tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] [instance: 852e8870-b3ec-4a21-a9b5-e31a423ddd3d] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:37:26.718583 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-b97a5444-ce3a-4e2d-9d37-279302e9120d tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:37:26.719055 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-b97a5444-ce3a-4e2d-9d37-279302e9120d tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:37:26.719545 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-b97a5444-ce3a-4e2d-9d37-279302e9120d tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:37:26.720224 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-b97a5444-ce3a-4e2d-9d37-279302e9120d tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:37:26.720671 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-b97a5444-ce3a-4e2d-9d37-279302e9120d tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:37:26.721086 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-b97a5444-ce3a-4e2d-9d37-279302e9120d tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:37:26.749564 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-b97a5444-ce3a-4e2d-9d37-279302e9120d tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] 10.222.0.15 "GET /compute/v2.1/servers/852e8870-b3ec-4a21-a9b5-e31a423ddd3d/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.044569 Oct 31 12:37:26.750113 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 320/629] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Oct 31 12:37:26 2022] GET /compute/v2.1/servers/852e8870-b3ec-4a21-a9b5-e31a423ddd3d/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:37:26.814043 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-39db0ed2-6dfb-4ac4-a207-9d93efa74d8e tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:37:26.814547 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-39db0ed2-6dfb-4ac4-a207-9d93efa74d8e tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] [instance: 852e8870-b3ec-4a21-a9b5-e31a423ddd3d] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:37:26.820725 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-39db0ed2-6dfb-4ac4-a207-9d93efa74d8e tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:37:26.821196 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-39db0ed2-6dfb-4ac4-a207-9d93efa74d8e tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:37:26.821622 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-39db0ed2-6dfb-4ac4-a207-9d93efa74d8e tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:37:26.822299 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-39db0ed2-6dfb-4ac4-a207-9d93efa74d8e tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:37:26.822742 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-39db0ed2-6dfb-4ac4-a207-9d93efa74d8e tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:37:26.823156 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-39db0ed2-6dfb-4ac4-a207-9d93efa74d8e tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:37:26.847914 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-39db0ed2-6dfb-4ac4-a207-9d93efa74d8e tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] [instance: 852e8870-b3ec-4a21-a9b5-e31a423ddd3d] Going to try to terminate instance {{(pid=125441) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 12:37:26.920735 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-39db0ed2-6dfb-4ac4-a207-9d93efa74d8e tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] 10.222.0.15 "DELETE /compute/v2.1/servers/852e8870-b3ec-4a21-a9b5-e31a423ddd3d" status: 204 len: 0 microversion: 2.20 time: 0.110267 Oct 31 12:37:26.921312 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 310/630] 10.222.0.15 () {60 vars in 1280 bytes} [Mon Oct 31 12:37:26 2022] DELETE /compute/v2.1/servers/852e8870-b3ec-4a21-a9b5-e31a423ddd3d => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 31 12:37:26.931505 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-ea358295-0c6d-409b-aa4c-3eb086583ec7 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:37:26.932194 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-ea358295-0c6d-409b-aa4c-3eb086583ec7 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] [instance: 852e8870-b3ec-4a21-a9b5-e31a423ddd3d] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:37:26.938031 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-ea358295-0c6d-409b-aa4c-3eb086583ec7 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:37:26.938491 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-ea358295-0c6d-409b-aa4c-3eb086583ec7 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:37:26.938915 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-ea358295-0c6d-409b-aa4c-3eb086583ec7 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:37:26.939628 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-ea358295-0c6d-409b-aa4c-3eb086583ec7 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:37:26.940074 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-ea358295-0c6d-409b-aa4c-3eb086583ec7 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:37:26.940488 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-ea358295-0c6d-409b-aa4c-3eb086583ec7 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:37:27.075863 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-ea358295-0c6d-409b-aa4c-3eb086583ec7 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:37:27.083924 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-ea358295-0c6d-409b-aa4c-3eb086583ec7 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:37:27.085359 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-ea358295-0c6d-409b-aa4c-3eb086583ec7 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:37:27.086490 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-ea358295-0c6d-409b-aa4c-3eb086583ec7 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] 10.222.0.15 "GET /compute/v2.1/servers/852e8870-b3ec-4a21-a9b5-e31a423ddd3d" status: 200 len: 1724 microversion: 2.20 time: 0.160355 Oct 31 12:37:27.087044 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 321/631] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Oct 31 12:37:26 2022] GET /compute/v2.1/servers/852e8870-b3ec-4a21-a9b5-e31a423ddd3d => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 12:37:27.198376 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-b151d83e-3e9b-48ee-93c0-cb222dab996d tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 12:37:27.198978 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-b151d83e-3e9b-48ee-93c0-cb222dab996d tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] [instance: b8c93a18-ee0e-438e-823c-cf51f9d4985f] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:37:27.204796 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-b151d83e-3e9b-48ee-93c0-cb222dab996d tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:37:27.205271 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-b151d83e-3e9b-48ee-93c0-cb222dab996d tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:37:27.205692 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-b151d83e-3e9b-48ee-93c0-cb222dab996d tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:37:27.206361 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-b151d83e-3e9b-48ee-93c0-cb222dab996d tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:37:27.206805 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-b151d83e-3e9b-48ee-93c0-cb222dab996d tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:37:27.207244 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-b151d83e-3e9b-48ee-93c0-cb222dab996d tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:37:27.229626 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.objects.instance [None req-b151d83e-3e9b-48ee-93c0-cb222dab996d tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lazy-loading 'flavor' on Instance uuid b8c93a18-ee0e-438e-823c-cf51f9d4985f {{(pid=125441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 12:37:27.298822 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-b151d83e-3e9b-48ee-93c0-cb222dab996d tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] 10.222.0.15 "POST /compute/v2.1/servers/b8c93a18-ee0e-438e-823c-cf51f9d4985f/action" status: 202 len: 0 microversion: 2.1 time: 0.104986 Oct 31 12:37:27.299445 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 311/632] 10.222.0.15 () {60 vars in 1278 bytes} [Mon Oct 31 12:37:27 2022] POST /compute/v2.1/servers/b8c93a18-ee0e-438e-823c-cf51f9d4985f/action => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 12:37:27.308290 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-203987f2-4274-4146-9f7a-d1d1f3ef4fbe tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:37:27.308899 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-203987f2-4274-4146-9f7a-d1d1f3ef4fbe tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] [instance: b8c93a18-ee0e-438e-823c-cf51f9d4985f] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:37:27.314816 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-203987f2-4274-4146-9f7a-d1d1f3ef4fbe tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:37:27.315335 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-203987f2-4274-4146-9f7a-d1d1f3ef4fbe tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:37:27.315763 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-203987f2-4274-4146-9f7a-d1d1f3ef4fbe tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:37:27.316447 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-203987f2-4274-4146-9f7a-d1d1f3ef4fbe tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:37:27.316895 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-203987f2-4274-4146-9f7a-d1d1f3ef4fbe tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:37:27.317310 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-203987f2-4274-4146-9f7a-d1d1f3ef4fbe tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:37:27.447492 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-203987f2-4274-4146-9f7a-d1d1f3ef4fbe tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825059319a204b6da5bc7004b3a09361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14b98f006574deabc030c2e93c680c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:37:27.455154 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-203987f2-4274-4146-9f7a-d1d1f3ef4fbe tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] 10.222.0.15 "GET /compute/v2.1/servers/b8c93a18-ee0e-438e-823c-cf51f9d4985f" status: 200 len: 1567 microversion: 2.1 time: 0.151409 Oct 31 12:37:27.455745 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 322/633] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:37:27 2022] GET /compute/v2.1/servers/b8c93a18-ee0e-438e-823c-cf51f9d4985f => generated 1567 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:37:28.114486 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-1b33022d-d397-4f0a-afa4-6d52736c9392 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:37:28.115200 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-1b33022d-d397-4f0a-afa4-6d52736c9392 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] [instance: 852e8870-b3ec-4a21-a9b5-e31a423ddd3d] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:37:28.121890 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-1b33022d-d397-4f0a-afa4-6d52736c9392 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:37:28.122361 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-1b33022d-d397-4f0a-afa4-6d52736c9392 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:37:28.122793 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-1b33022d-d397-4f0a-afa4-6d52736c9392 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:37:28.123497 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-1b33022d-d397-4f0a-afa4-6d52736c9392 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:37:28.123944 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-1b33022d-d397-4f0a-afa4-6d52736c9392 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:37:28.124361 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-1b33022d-d397-4f0a-afa4-6d52736c9392 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:37:28.255351 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-1b33022d-d397-4f0a-afa4-6d52736c9392 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:37:28.264187 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-1b33022d-d397-4f0a-afa4-6d52736c9392 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:37:28.265743 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-1b33022d-d397-4f0a-afa4-6d52736c9392 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:37:28.266911 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-1b33022d-d397-4f0a-afa4-6d52736c9392 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] 10.222.0.15 "GET /compute/v2.1/servers/852e8870-b3ec-4a21-a9b5-e31a423ddd3d" status: 200 len: 1724 microversion: 2.20 time: 0.157466 Oct 31 12:37:28.279078 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 312/634] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Oct 31 12:37:28 2022] GET /compute/v2.1/servers/852e8870-b3ec-4a21-a9b5-e31a423ddd3d => generated 1724 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 12:37:28.479946 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-68480211-668e-4107-9b02-edd8b5f8a11c tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:37:28.480649 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-68480211-668e-4107-9b02-edd8b5f8a11c tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] [instance: b8c93a18-ee0e-438e-823c-cf51f9d4985f] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:37:28.487140 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-68480211-668e-4107-9b02-edd8b5f8a11c tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:37:28.487663 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-68480211-668e-4107-9b02-edd8b5f8a11c tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:37:28.488075 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-68480211-668e-4107-9b02-edd8b5f8a11c tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:37:28.488761 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-68480211-668e-4107-9b02-edd8b5f8a11c tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:37:28.489213 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-68480211-668e-4107-9b02-edd8b5f8a11c tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:37:28.489633 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-68480211-668e-4107-9b02-edd8b5f8a11c tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:37:28.619789 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-68480211-668e-4107-9b02-edd8b5f8a11c tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825059319a204b6da5bc7004b3a09361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14b98f006574deabc030c2e93c680c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:37:28.627580 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-68480211-668e-4107-9b02-edd8b5f8a11c tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] 10.222.0.15 "GET /compute/v2.1/servers/b8c93a18-ee0e-438e-823c-cf51f9d4985f" status: 200 len: 1567 microversion: 2.1 time: 0.152642 Oct 31 12:37:28.628171 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 323/635] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:37:28 2022] GET /compute/v2.1/servers/b8c93a18-ee0e-438e-823c-cf51f9d4985f => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:37:29.294223 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-21248c7f-a2db-461f-819b-796e816a9d1b tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:37:29.294923 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-21248c7f-a2db-461f-819b-796e816a9d1b tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] [instance: 852e8870-b3ec-4a21-a9b5-e31a423ddd3d] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:37:29.301923 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-21248c7f-a2db-461f-819b-796e816a9d1b tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:37:29.302481 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-21248c7f-a2db-461f-819b-796e816a9d1b tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:37:29.302988 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-21248c7f-a2db-461f-819b-796e816a9d1b tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:37:29.303738 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-21248c7f-a2db-461f-819b-796e816a9d1b tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:37:29.304191 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-21248c7f-a2db-461f-819b-796e816a9d1b tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:37:29.304610 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-21248c7f-a2db-461f-819b-796e816a9d1b tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:37:29.366510 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-21248c7f-a2db-461f-819b-796e816a9d1b tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:37:29.375436 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-21248c7f-a2db-461f-819b-796e816a9d1b tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:37:29.376863 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-21248c7f-a2db-461f-819b-796e816a9d1b tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:37:29.378001 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-21248c7f-a2db-461f-819b-796e816a9d1b tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] 10.222.0.15 "GET /compute/v2.1/servers/852e8870-b3ec-4a21-a9b5-e31a423ddd3d" status: 200 len: 1656 microversion: 2.20 time: 0.089049 Oct 31 12:37:29.378563 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 313/636] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Oct 31 12:37:29 2022] GET /compute/v2.1/servers/852e8870-b3ec-4a21-a9b5-e31a423ddd3d => generated 1656 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 12:37:29.551400 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [req-3a33a71e-f605-4452-ac55-013c0041e642 req-e8f5c9ed-439a-4916-8007-e7a627aaf0ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "852e8870-b3ec-4a21-a9b5-e31a423ddd3d", "name": "network-vif-deleted", "tag": "dffec82d-007b-4838-9898-19da61885395"}]} {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 12:37:29.563668 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [req-3a33a71e-f605-4452-ac55-013c0041e642 req-e8f5c9ed-439a-4916-8007-e7a627aaf0ac service nova] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:37:29.564405 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [req-3a33a71e-f605-4452-ac55-013c0041e642 req-e8f5c9ed-439a-4916-8007-e7a627aaf0ac service nova] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:37:29.564827 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [req-3a33a71e-f605-4452-ac55-013c0041e642 req-e8f5c9ed-439a-4916-8007-e7a627aaf0ac service nova] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:37:29.576538 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.compute.server_external_events [req-3a33a71e-f605-4452-ac55-013c0041e642 req-e8f5c9ed-439a-4916-8007-e7a627aaf0ac service nova] Creating event network-vif-deleted:dffec82d-007b-4838-9898-19da61885395 for instance 852e8870-b3ec-4a21-a9b5-e31a423ddd3d on hv-cinder-79617 Oct 31 12:37:29.582419 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [req-3a33a71e-f605-4452-ac55-013c0041e642 req-e8f5c9ed-439a-4916-8007-e7a627aaf0ac service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034874 Oct 31 12:37:29.583024 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 324/637] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Oct 31 12:37:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 12:37:29.650915 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-2815d8fd-b339-4e24-bdf5-3385d5895653 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:37:29.651678 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-2815d8fd-b339-4e24-bdf5-3385d5895653 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] [instance: b8c93a18-ee0e-438e-823c-cf51f9d4985f] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:37:29.659821 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-2815d8fd-b339-4e24-bdf5-3385d5895653 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:37:29.660613 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-2815d8fd-b339-4e24-bdf5-3385d5895653 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:37:29.661256 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-2815d8fd-b339-4e24-bdf5-3385d5895653 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:37:29.662177 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-2815d8fd-b339-4e24-bdf5-3385d5895653 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:37:29.663075 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-2815d8fd-b339-4e24-bdf5-3385d5895653 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:37:29.663615 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-2815d8fd-b339-4e24-bdf5-3385d5895653 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:37:29.816853 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-2815d8fd-b339-4e24-bdf5-3385d5895653 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825059319a204b6da5bc7004b3a09361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14b98f006574deabc030c2e93c680c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:37:29.824789 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-2815d8fd-b339-4e24-bdf5-3385d5895653 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] 10.222.0.15 "GET /compute/v2.1/servers/b8c93a18-ee0e-438e-823c-cf51f9d4985f" status: 200 len: 1567 microversion: 2.1 time: 0.178445 Oct 31 12:37:29.825439 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 314/638] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:37:29 2022] GET /compute/v2.1/servers/b8c93a18-ee0e-438e-823c-cf51f9d4985f => generated 1567 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:37:30.404413 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-a719023a-4523-422c-a06d-284a2a91ff27 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:37:30.405130 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-a719023a-4523-422c-a06d-284a2a91ff27 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] [instance: 852e8870-b3ec-4a21-a9b5-e31a423ddd3d] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:37:30.411668 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-a719023a-4523-422c-a06d-284a2a91ff27 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:37:30.412493 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-a719023a-4523-422c-a06d-284a2a91ff27 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:37:30.413134 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-a719023a-4523-422c-a06d-284a2a91ff27 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:37:30.413835 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-a719023a-4523-422c-a06d-284a2a91ff27 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:37:30.414409 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-a719023a-4523-422c-a06d-284a2a91ff27 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:37:30.414922 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-a719023a-4523-422c-a06d-284a2a91ff27 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:37:30.429547 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.wsgi [None req-a719023a-4523-422c-a06d-284a2a91ff27 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] HTTP exception thrown: Instance 852e8870-b3ec-4a21-a9b5-e31a423ddd3d could not be found. Oct 31 12:37:30.432408 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-a719023a-4523-422c-a06d-284a2a91ff27 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Request method failure captured: Oct 31 12:37:30.432408 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: request: GET /compute/v2.1/servers/852e8870-b3ec-4a21-a9b5-e31a423ddd3d HTTP/1.1 Oct 31 12:37:30.432408 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: Accept: application/json Oct 31 12:37:30.432408 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: Accept-Encoding: identity Oct 31 12:37:30.432408 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: Connection: close Oct 31 12:37:30.432408 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: Content-Length: 0 Oct 31 12:37:30.432408 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: Content-Type: application/json Oct 31 12:37:30.432408 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: Host: 10.222.0.15 Oct 31 12:37:30.432408 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: Openstack-System-Scope: None Oct 31 12:37:30.432408 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: User-Agent: python-urllib3/1.26.12 Oct 31 12:37:30.432408 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Auth-Token: gAAAAABjX8CAU-Z6rmTsOadbZ2-kygEvrKOAHC9p8QgbouuWspxvwvMw4rWKAxJEbLtzWEG5yT7mVZ5UZMVzhCA5u4L3XKKTnX7SSzRf0Pj2uxTByGhUnpS30ozcS7GtmDrKy6KDxXpkjjdIKR3RiXYqFb6liM6ngLcSsgOpnWm5p5T4R3bwl60 Oct 31 12:37:30.432408 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Domain-Id: None Oct 31 12:37:30.432408 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Domain-Name: None Oct 31 12:37:30.432408 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Identity-Status: Confirmed Oct 31 12:37:30.432408 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Is-Admin-Project: True Oct 31 12:37:30.432408 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Openstack-Nova-Api-Version: 2.20 Oct 31 12:37:30.432408 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Project-Domain-Id: default Oct 31 12:37:30.432408 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Project-Domain-Name: Default Oct 31 12:37:30.432408 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Project-Id: de0eb090bf44403983e0cbb99e038321 Oct 31 12:37:30.432408 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-192762088 Oct 31 12:37:30.432408 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Role: reader,member Oct 31 12:37:30.432408 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Roles: reader,member Oct 31 12:37:30.434083 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/de0eb090bf44403983e0cbb99e038321"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_de0eb090bf44403983e0cbb99e038321", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/de0eb090bf44403983e0cbb99e038321"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/de0eb090bf44403983e0cbb99e038321"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Oct 31 12:37:30.434083 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Tenant: tempest-AttachVolumeShelveTestJSON-192762088 Oct 31 12:37:30.434083 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Tenant-Id: de0eb090bf44403983e0cbb99e038321 Oct 31 12:37:30.434083 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-192762088 Oct 31 12:37:30.434083 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-User: tempest-AttachVolumeShelveTestJSON-192762088-project Oct 31 12:37:30.434083 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-User-Domain-Id: default Oct 31 12:37:30.434083 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-User-Domain-Name: Default Oct 31 12:37:30.434083 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-User-Id: a6d1ace68aa84499a4929da60f3d71bf Oct 31 12:37:30.434083 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-User-Name: tempest-AttachVolumeShelveTestJSON-192762088-project Oct 31 12:37:30.434083 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: method: > Oct 31 12:37:30.434083 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: exception: Instance 852e8870-b3ec-4a21-a9b5-e31a423ddd3d could not be found. Oct 31 12:37:30.434083 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: action_args: {'id': '852e8870-b3ec-4a21-a9b5-e31a423ddd3d'} Oct 31 12:37:30.434887 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 12:37:30.434887 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 12:37:30.434887 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 12:37:30.434887 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 12:37:30.434887 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 12:37:30.434887 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 12:37:30.434887 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 12:37:30.434887 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 12:37:30.434887 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 12:37:30.434887 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 12:37:30.434887 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 852e8870-b3ec-4a21-a9b5-e31a423ddd3d could not be found. Oct 31 12:37:30.434887 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Oct 31 12:37:30.434887 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 12:37:30.434887 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Oct 31 12:37:30.434887 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 12:37:30.434887 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 12:37:30.434887 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 12:37:30.434887 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 12:37:30.434887 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 12:37:30.434887 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 12:37:30.436149 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 12:37:30.436149 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 12:37:30.436149 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 12:37:30.436149 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 12:37:30.436149 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 12:37:30.436149 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 12:37:30.436149 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 12:37:30.436149 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 852e8870-b3ec-4a21-a9b5-e31a423ddd3d could not be found. Oct 31 12:37:30.436149 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Oct 31 12:37:30.436149 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 12:37:30.436149 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Oct 31 12:37:30.436149 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 12:37:30.436149 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 12:37:30.436149 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 12:37:30.436149 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 12:37:30.436149 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 12:37:30.436149 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 852e8870-b3ec-4a21-a9b5-e31a423ddd3d could not be found. Oct 31 12:37:30.436149 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Oct 31 12:37:30.438204 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-a719023a-4523-422c-a06d-284a2a91ff27 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Returning 404 to user: Instance 852e8870-b3ec-4a21-a9b5-e31a423ddd3d could not be found. {{(pid=125440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 12:37:30.439083 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-a719023a-4523-422c-a06d-284a2a91ff27 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] 10.222.0.15 "GET /compute/v2.1/servers/852e8870-b3ec-4a21-a9b5-e31a423ddd3d" status: 404 len: 111 microversion: 2.20 time: 0.039456 Oct 31 12:37:30.440138 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 325/639] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Oct 31 12:37:30 2022] GET /compute/v2.1/servers/852e8870-b3ec-4a21-a9b5-e31a423ddd3d => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 31 12:37:30.449682 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-5f3661fb-6001-4923-8d08-258f916075f8 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Calling method '.version_select at 0x7f2aa5003670>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:37:30.471192 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-5f3661fb-6001-4923-8d08-258f916075f8 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1575790766" status: 204 len: 0 microversion: 2.20 time: 0.026431 Oct 31 12:37:30.471840 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 315/640] 10.222.0.15 () {60 vars in 1262 bytes} [Mon Oct 31 12:37:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1575790766 => generated 0 bytes in 28 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 31 12:37:30.848709 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-8fd2cd34-6009-4486-8e85-699df0447986 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:37:30.849319 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-8fd2cd34-6009-4486-8e85-699df0447986 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] [instance: b8c93a18-ee0e-438e-823c-cf51f9d4985f] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:37:30.855782 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-8fd2cd34-6009-4486-8e85-699df0447986 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:37:30.856261 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-8fd2cd34-6009-4486-8e85-699df0447986 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:37:30.856719 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-8fd2cd34-6009-4486-8e85-699df0447986 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:37:30.857400 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-8fd2cd34-6009-4486-8e85-699df0447986 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:37:30.857843 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-8fd2cd34-6009-4486-8e85-699df0447986 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:37:30.858254 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-8fd2cd34-6009-4486-8e85-699df0447986 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:37:31.047531 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-8fd2cd34-6009-4486-8e85-699df0447986 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825059319a204b6da5bc7004b3a09361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14b98f006574deabc030c2e93c680c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:37:31.055271 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-8fd2cd34-6009-4486-8e85-699df0447986 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] 10.222.0.15 "GET /compute/v2.1/servers/b8c93a18-ee0e-438e-823c-cf51f9d4985f" status: 200 len: 1567 microversion: 2.1 time: 0.210875 Oct 31 12:37:31.055993 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 326/641] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:37:30 2022] GET /compute/v2.1/servers/b8c93a18-ee0e-438e-823c-cf51f9d4985f => generated 1567 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:37:31.155799 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-fe216330-4da9-4755-a826-43c4e9cd3ddb tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Action: 'create', calling method: .version_select at 0x7f2aa5166c10>, body: {"keypair": {"name": "tempest-keypair-1803472968", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKTNYIoEWs52n51vR06y8eVEeIcjt5b5DYuelT7diWsBxt3aK6AVCuLaYBsgPZSIqFqy/W66B0rggiXIdmWAbY7Je8Z3rGLdW31lwOV7R6zcXLmusDvE60bSqC1K/8UXow=="}} {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 12:37:31.171461 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.quota [None req-fe216330-4da9-4755-a826-43c4e9cd3ddb tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Getting quotas for project de0eb090bf44403983e0cbb99e038321. Resources: {'key_pairs'} {{(pid=125441) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 12:37:31.175345 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.quota [None req-fe216330-4da9-4755-a826-43c4e9cd3ddb tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Getting quotas for user a6d1ace68aa84499a4929da60f3d71bf and project de0eb090bf44403983e0cbb99e038321. Resources: {'key_pairs'} {{(pid=125441) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 12:37:31.197593 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-fe216330-4da9-4755-a826-43c4e9cd3ddb tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.045815 Oct 31 12:37:31.198179 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 316/642] 10.222.0.15 () {62 vars in 1200 bytes} [Mon Oct 31 12:37:31 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 47 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 31 12:37:32.078768 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-d08ce647-eeec-4eaf-956b-b9731f4b4e4c tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:37:32.079439 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-d08ce647-eeec-4eaf-956b-b9731f4b4e4c tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] [instance: b8c93a18-ee0e-438e-823c-cf51f9d4985f] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:37:32.085869 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-d08ce647-eeec-4eaf-956b-b9731f4b4e4c tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:37:32.086345 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-d08ce647-eeec-4eaf-956b-b9731f4b4e4c tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:37:32.086772 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-d08ce647-eeec-4eaf-956b-b9731f4b4e4c tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:37:32.087482 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-d08ce647-eeec-4eaf-956b-b9731f4b4e4c tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:37:32.087934 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-d08ce647-eeec-4eaf-956b-b9731f4b4e4c tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:37:32.088496 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-d08ce647-eeec-4eaf-956b-b9731f4b4e4c tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:37:32.225179 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-d08ce647-eeec-4eaf-956b-b9731f4b4e4c tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825059319a204b6da5bc7004b3a09361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14b98f006574deabc030c2e93c680c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:37:32.232982 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-d08ce647-eeec-4eaf-956b-b9731f4b4e4c tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] 10.222.0.15 "GET /compute/v2.1/servers/b8c93a18-ee0e-438e-823c-cf51f9d4985f" status: 200 len: 1567 microversion: 2.1 time: 0.158334 Oct 31 12:37:32.233549 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 327/643] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:37:32 2022] GET /compute/v2.1/servers/b8c93a18-ee0e-438e-823c-cf51f9d4985f => generated 1567 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:37:32.451713 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-91ba846d-2e9a-4e02-96f8-ef4db23b3080 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-570555480", "imageRef": "fbbea321-8f0d-4092-b070-b67a6931d610", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "89ec9ee8-fff5-4bf0-84fc-cc885776f150"}], "security_groups": [{"name": "tempest-securitygroup--1058761967"}], "key_name": "tempest-keypair-1803472968", "user_data": "}} {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 12:37:32.553012 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.network.neutron [None req-91ba846d-2e9a-4e02-96f8-ef4db23b3080 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] validate_networks() for [('89ec9ee8-fff5-4bf0-84fc-cc885776f150', None, None, None, None, None)] {{(pid=125441) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 12:37:32.914361 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.virt.hardware [None req-91ba846d-2e9a-4e02-96f8-ef4db23b3080 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Flavor limits 0:0:0 {{(pid=125441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 12:37:32.914802 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.virt.hardware [None req-91ba846d-2e9a-4e02-96f8-ef4db23b3080 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Image limits 0:0:0 {{(pid=125441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 12:37:32.915388 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.virt.hardware [None req-91ba846d-2e9a-4e02-96f8-ef4db23b3080 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Flavor pref 0:0:0 {{(pid=125441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 12:37:32.915803 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.virt.hardware [None req-91ba846d-2e9a-4e02-96f8-ef4db23b3080 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Image pref 0:0:0 {{(pid=125441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 12:37:32.916700 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.virt.hardware [None req-91ba846d-2e9a-4e02-96f8-ef4db23b3080 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 12:37:32.925993 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-91ba846d-2e9a-4e02-96f8-ef4db23b3080 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:37:32.926472 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-91ba846d-2e9a-4e02-96f8-ef4db23b3080 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:37:32.926899 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-91ba846d-2e9a-4e02-96f8-ef4db23b3080 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:37:32.927652 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-91ba846d-2e9a-4e02-96f8-ef4db23b3080 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:37:32.928106 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-91ba846d-2e9a-4e02-96f8-ef4db23b3080 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:37:32.928527 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-91ba846d-2e9a-4e02-96f8-ef4db23b3080 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:37:32.945803 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.quota [None req-91ba846d-2e9a-4e02-96f8-ef4db23b3080 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Getting quotas for project de0eb090bf44403983e0cbb99e038321. Resources: {'instances', 'cores', 'ram'} {{(pid=125441) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 12:37:32.950279 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.quota [None req-91ba846d-2e9a-4e02-96f8-ef4db23b3080 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Getting quotas for user a6d1ace68aa84499a4929da60f3d71bf and project de0eb090bf44403983e0cbb99e038321. Resources: {'instances', 'cores', 'ram'} {{(pid=125441) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 12:37:32.961020 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-91ba846d-2e9a-4e02-96f8-ef4db23b3080 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Going to run 1 instances... {{(pid=125441) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 12:37:32.963657 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-91ba846d-2e9a-4e02-96f8-ef4db23b3080 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] [instance: b3800adf-8cae-407e-9a5e-9eb107bff58d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fbbea321-8f0d-4092-b070-b67a6931d610',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125441) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 12:37:33.011467 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-91ba846d-2e9a-4e02-96f8-ef4db23b3080 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.564669 Oct 31 12:37:33.012043 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 317/644] 10.222.0.15 () {62 vars in 1188 bytes} [Mon Oct 31 12:37:32 2022] POST /compute/v2.1/servers => generated 402 bytes in 566 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 31 12:37:33.027989 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-3c5b0b51-ca74-4a3f-b801-e7535a7bfe40 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:37:33.028599 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-3c5b0b51-ca74-4a3f-b801-e7535a7bfe40 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] [instance: b3800adf-8cae-407e-9a5e-9eb107bff58d] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:37:33.082907 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-3c5b0b51-ca74-4a3f-b801-e7535a7bfe40 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:37:33.091843 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-3c5b0b51-ca74-4a3f-b801-e7535a7bfe40 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:37:33.093278 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-3c5b0b51-ca74-4a3f-b801-e7535a7bfe40 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:37:33.094358 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-3c5b0b51-ca74-4a3f-b801-e7535a7bfe40 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] 10.222.0.15 "GET /compute/v2.1/servers/b3800adf-8cae-407e-9a5e-9eb107bff58d" status: 200 len: 1281 microversion: 2.20 time: 0.075155 Oct 31 12:37:33.094915 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 328/645] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Oct 31 12:37:33 2022] GET /compute/v2.1/servers/b3800adf-8cae-407e-9a5e-9eb107bff58d => generated 1281 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 12:37:33.256361 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-e38e6235-7b69-4789-83b2-6b58ba3df537 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:37:33.256971 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-e38e6235-7b69-4789-83b2-6b58ba3df537 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] [instance: b8c93a18-ee0e-438e-823c-cf51f9d4985f] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:37:33.264171 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-e38e6235-7b69-4789-83b2-6b58ba3df537 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:37:33.264585 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-e38e6235-7b69-4789-83b2-6b58ba3df537 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:37:33.265008 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-e38e6235-7b69-4789-83b2-6b58ba3df537 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:37:33.265724 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-e38e6235-7b69-4789-83b2-6b58ba3df537 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:37:33.266175 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-e38e6235-7b69-4789-83b2-6b58ba3df537 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:37:33.266591 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-e38e6235-7b69-4789-83b2-6b58ba3df537 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:37:33.402095 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-e38e6235-7b69-4789-83b2-6b58ba3df537 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825059319a204b6da5bc7004b3a09361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14b98f006574deabc030c2e93c680c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:37:33.411045 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-e38e6235-7b69-4789-83b2-6b58ba3df537 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] 10.222.0.15 "GET /compute/v2.1/servers/b8c93a18-ee0e-438e-823c-cf51f9d4985f" status: 200 len: 1567 microversion: 2.1 time: 0.158631 Oct 31 12:37:33.411648 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 318/646] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:37:33 2022] GET /compute/v2.1/servers/b8c93a18-ee0e-438e-823c-cf51f9d4985f => generated 1567 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 12:37:34.120011 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-11648ff2-1419-4f6c-8220-f41656b4853f tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:37:34.120592 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-11648ff2-1419-4f6c-8220-f41656b4853f tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] [instance: b3800adf-8cae-407e-9a5e-9eb107bff58d] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:37:34.129010 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-11648ff2-1419-4f6c-8220-f41656b4853f tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:37:34.129494 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-11648ff2-1419-4f6c-8220-f41656b4853f tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:37:34.129930 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-11648ff2-1419-4f6c-8220-f41656b4853f tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:37:34.130615 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-11648ff2-1419-4f6c-8220-f41656b4853f tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:37:34.131066 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-11648ff2-1419-4f6c-8220-f41656b4853f tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:37:34.131571 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-11648ff2-1419-4f6c-8220-f41656b4853f tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:37:34.192651 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-11648ff2-1419-4f6c-8220-f41656b4853f tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:37:34.200659 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-11648ff2-1419-4f6c-8220-f41656b4853f tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:37:34.202119 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-11648ff2-1419-4f6c-8220-f41656b4853f tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:37:34.203217 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-11648ff2-1419-4f6c-8220-f41656b4853f tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] 10.222.0.15 "GET /compute/v2.1/servers/b3800adf-8cae-407e-9a5e-9eb107bff58d" status: 200 len: 1333 microversion: 2.20 time: 0.087343 Oct 31 12:37:34.203770 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 329/647] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Oct 31 12:37:34 2022] GET /compute/v2.1/servers/b3800adf-8cae-407e-9a5e-9eb107bff58d => generated 1333 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 12:37:34.437120 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-15f9aa64-fed9-4fb7-bdb9-0f953e154148 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:37:34.437625 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-15f9aa64-fed9-4fb7-bdb9-0f953e154148 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] [instance: b8c93a18-ee0e-438e-823c-cf51f9d4985f] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:37:34.443858 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-15f9aa64-fed9-4fb7-bdb9-0f953e154148 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:37:34.444368 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-15f9aa64-fed9-4fb7-bdb9-0f953e154148 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:37:34.444807 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-15f9aa64-fed9-4fb7-bdb9-0f953e154148 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:37:34.445494 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-15f9aa64-fed9-4fb7-bdb9-0f953e154148 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:37:34.445929 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-15f9aa64-fed9-4fb7-bdb9-0f953e154148 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:37:34.446345 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-15f9aa64-fed9-4fb7-bdb9-0f953e154148 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:37:34.583015 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-15f9aa64-fed9-4fb7-bdb9-0f953e154148 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825059319a204b6da5bc7004b3a09361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14b98f006574deabc030c2e93c680c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:37:34.591052 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-15f9aa64-fed9-4fb7-bdb9-0f953e154148 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] 10.222.0.15 "GET /compute/v2.1/servers/b8c93a18-ee0e-438e-823c-cf51f9d4985f" status: 200 len: 1567 microversion: 2.1 time: 0.159453 Oct 31 12:37:34.591668 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 319/648] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:37:34 2022] GET /compute/v2.1/servers/b8c93a18-ee0e-438e-823c-cf51f9d4985f => generated 1567 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:37:35.230049 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-116388ca-b262-4abd-b2d1-0594e59d2b98 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:37:35.230662 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-116388ca-b262-4abd-b2d1-0594e59d2b98 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] [instance: b3800adf-8cae-407e-9a5e-9eb107bff58d] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:37:35.237704 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-116388ca-b262-4abd-b2d1-0594e59d2b98 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:37:35.238325 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-116388ca-b262-4abd-b2d1-0594e59d2b98 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:37:35.238844 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-116388ca-b262-4abd-b2d1-0594e59d2b98 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:37:35.239661 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-116388ca-b262-4abd-b2d1-0594e59d2b98 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:37:35.240530 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-116388ca-b262-4abd-b2d1-0594e59d2b98 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:37:35.241107 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-116388ca-b262-4abd-b2d1-0594e59d2b98 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:37:35.449027 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-116388ca-b262-4abd-b2d1-0594e59d2b98 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:37:35.457259 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-116388ca-b262-4abd-b2d1-0594e59d2b98 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:37:35.458686 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-116388ca-b262-4abd-b2d1-0594e59d2b98 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:37:35.459854 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-116388ca-b262-4abd-b2d1-0594e59d2b98 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] 10.222.0.15 "GET /compute/v2.1/servers/b3800adf-8cae-407e-9a5e-9eb107bff58d" status: 200 len: 1407 microversion: 2.20 time: 0.234468 Oct 31 12:37:35.460482 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 330/649] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Oct 31 12:37:35 2022] GET /compute/v2.1/servers/b3800adf-8cae-407e-9a5e-9eb107bff58d => generated 1407 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 12:37:35.613976 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-9edc7dd4-5e9a-4ad4-b020-2a4185b0b467 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:37:35.614484 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-9edc7dd4-5e9a-4ad4-b020-2a4185b0b467 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] [instance: b8c93a18-ee0e-438e-823c-cf51f9d4985f] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:37:35.621207 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-9edc7dd4-5e9a-4ad4-b020-2a4185b0b467 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:37:35.621688 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-9edc7dd4-5e9a-4ad4-b020-2a4185b0b467 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:37:35.622113 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-9edc7dd4-5e9a-4ad4-b020-2a4185b0b467 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:37:35.622796 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-9edc7dd4-5e9a-4ad4-b020-2a4185b0b467 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:37:35.623265 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-9edc7dd4-5e9a-4ad4-b020-2a4185b0b467 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:37:35.623707 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-9edc7dd4-5e9a-4ad4-b020-2a4185b0b467 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:37:35.758186 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-9edc7dd4-5e9a-4ad4-b020-2a4185b0b467 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825059319a204b6da5bc7004b3a09361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14b98f006574deabc030c2e93c680c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:37:35.766274 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-9edc7dd4-5e9a-4ad4-b020-2a4185b0b467 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] 10.222.0.15 "GET /compute/v2.1/servers/b8c93a18-ee0e-438e-823c-cf51f9d4985f" status: 200 len: 1567 microversion: 2.1 time: 0.156340 Oct 31 12:37:35.766850 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 320/650] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:37:35 2022] GET /compute/v2.1/servers/b8c93a18-ee0e-438e-823c-cf51f9d4985f => generated 1567 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:37:35.938302 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [req-48ef628e-489d-4862-996e-90dc925216de req-d0feefd2-2d27-42f4-ada4-c05935d9391b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b3800adf-8cae-407e-9a5e-9eb107bff58d", "tag": "360a1655-b233-4d4d-a557-dc89ddf2b18e"}]} {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 12:37:35.948880 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [req-48ef628e-489d-4862-996e-90dc925216de req-d0feefd2-2d27-42f4-ada4-c05935d9391b service nova] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:37:35.949346 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [req-48ef628e-489d-4862-996e-90dc925216de req-d0feefd2-2d27-42f4-ada4-c05935d9391b service nova] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:37:35.949770 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [req-48ef628e-489d-4862-996e-90dc925216de req-d0feefd2-2d27-42f4-ada4-c05935d9391b service nova] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:37:35.967243 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.compute.server_external_events [req-48ef628e-489d-4862-996e-90dc925216de req-d0feefd2-2d27-42f4-ada4-c05935d9391b service nova] Creating event network-changed:360a1655-b233-4d4d-a557-dc89ddf2b18e for instance b3800adf-8cae-407e-9a5e-9eb107bff58d on hv-cinder-79617 Oct 31 12:37:35.971848 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [req-48ef628e-489d-4862-996e-90dc925216de req-d0feefd2-2d27-42f4-ada4-c05935d9391b service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037318 Oct 31 12:37:35.972442 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 331/651] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Oct 31 12:37:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 12:37:36.486905 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-776b28f6-dbd4-4218-a42a-b3ce11473b6c tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:37:36.487459 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-776b28f6-dbd4-4218-a42a-b3ce11473b6c tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] [instance: b3800adf-8cae-407e-9a5e-9eb107bff58d] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:37:36.497959 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-776b28f6-dbd4-4218-a42a-b3ce11473b6c tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:37:36.499293 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-776b28f6-dbd4-4218-a42a-b3ce11473b6c tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:37:36.499728 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-776b28f6-dbd4-4218-a42a-b3ce11473b6c tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:37:36.500582 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-776b28f6-dbd4-4218-a42a-b3ce11473b6c tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:37:36.501075 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-776b28f6-dbd4-4218-a42a-b3ce11473b6c tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:37:36.501544 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-776b28f6-dbd4-4218-a42a-b3ce11473b6c tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:37:36.648552 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-776b28f6-dbd4-4218-a42a-b3ce11473b6c tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:37:36.657452 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-776b28f6-dbd4-4218-a42a-b3ce11473b6c tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:37:36.658881 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-776b28f6-dbd4-4218-a42a-b3ce11473b6c tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:37:36.659993 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-776b28f6-dbd4-4218-a42a-b3ce11473b6c tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] 10.222.0.15 "GET /compute/v2.1/servers/b3800adf-8cae-407e-9a5e-9eb107bff58d" status: 200 len: 1407 microversion: 2.20 time: 0.177403 Oct 31 12:37:36.660546 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 321/652] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Oct 31 12:37:36 2022] GET /compute/v2.1/servers/b3800adf-8cae-407e-9a5e-9eb107bff58d => generated 1407 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 12:37:36.792129 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-bab52440-9c6f-43fa-adfb-6a9c92584d07 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:37:36.792842 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-bab52440-9c6f-43fa-adfb-6a9c92584d07 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] [instance: b8c93a18-ee0e-438e-823c-cf51f9d4985f] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:37:36.798976 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-bab52440-9c6f-43fa-adfb-6a9c92584d07 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:37:36.799493 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-bab52440-9c6f-43fa-adfb-6a9c92584d07 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:37:36.799923 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-bab52440-9c6f-43fa-adfb-6a9c92584d07 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:37:36.800599 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-bab52440-9c6f-43fa-adfb-6a9c92584d07 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:37:36.801046 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-bab52440-9c6f-43fa-adfb-6a9c92584d07 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:37:36.801460 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-bab52440-9c6f-43fa-adfb-6a9c92584d07 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:37:36.931226 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-bab52440-9c6f-43fa-adfb-6a9c92584d07 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825059319a204b6da5bc7004b3a09361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14b98f006574deabc030c2e93c680c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:37:36.938917 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-bab52440-9c6f-43fa-adfb-6a9c92584d07 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] 10.222.0.15 "GET /compute/v2.1/servers/b8c93a18-ee0e-438e-823c-cf51f9d4985f" status: 200 len: 1567 microversion: 2.1 time: 0.151565 Oct 31 12:37:36.939520 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 332/653] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:37:36 2022] GET /compute/v2.1/servers/b8c93a18-ee0e-438e-823c-cf51f9d4985f => generated 1567 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:37:37.685845 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-1d85bcb5-906f-438b-9665-98ddca9e2b30 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:37:37.686447 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-1d85bcb5-906f-438b-9665-98ddca9e2b30 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] [instance: b3800adf-8cae-407e-9a5e-9eb107bff58d] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:37:37.693159 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-1d85bcb5-906f-438b-9665-98ddca9e2b30 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:37:37.693527 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-1d85bcb5-906f-438b-9665-98ddca9e2b30 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:37:37.693968 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-1d85bcb5-906f-438b-9665-98ddca9e2b30 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:37:37.694641 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-1d85bcb5-906f-438b-9665-98ddca9e2b30 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:37:37.695092 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-1d85bcb5-906f-438b-9665-98ddca9e2b30 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:37:37.695537 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-1d85bcb5-906f-438b-9665-98ddca9e2b30 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:37:37.833653 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-1d85bcb5-906f-438b-9665-98ddca9e2b30 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:37:37.843631 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-1d85bcb5-906f-438b-9665-98ddca9e2b30 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:37:37.845752 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-1d85bcb5-906f-438b-9665-98ddca9e2b30 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:37:37.847349 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-1d85bcb5-906f-438b-9665-98ddca9e2b30 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] 10.222.0.15 "GET /compute/v2.1/servers/b3800adf-8cae-407e-9a5e-9eb107bff58d" status: 200 len: 1407 microversion: 2.20 time: 0.165231 Oct 31 12:37:37.850453 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 322/654] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Oct 31 12:37:37 2022] GET /compute/v2.1/servers/b3800adf-8cae-407e-9a5e-9eb107bff58d => generated 1407 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 12:37:37.962317 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-1af7baae-868f-45fc-a26a-f8200c0d9578 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:37:37.963640 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-1af7baae-868f-45fc-a26a-f8200c0d9578 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] [instance: b8c93a18-ee0e-438e-823c-cf51f9d4985f] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:37:37.970238 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-1af7baae-868f-45fc-a26a-f8200c0d9578 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:37:37.970719 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-1af7baae-868f-45fc-a26a-f8200c0d9578 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:37:37.971154 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-1af7baae-868f-45fc-a26a-f8200c0d9578 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:37:37.971867 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-1af7baae-868f-45fc-a26a-f8200c0d9578 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:37:37.972316 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-1af7baae-868f-45fc-a26a-f8200c0d9578 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:37:37.972734 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-1af7baae-868f-45fc-a26a-f8200c0d9578 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:37:38.105071 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-1af7baae-868f-45fc-a26a-f8200c0d9578 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825059319a204b6da5bc7004b3a09361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14b98f006574deabc030c2e93c680c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:37:38.112787 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-1af7baae-868f-45fc-a26a-f8200c0d9578 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] 10.222.0.15 "GET /compute/v2.1/servers/b8c93a18-ee0e-438e-823c-cf51f9d4985f" status: 200 len: 1567 microversion: 2.1 time: 0.154345 Oct 31 12:37:38.113387 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 333/655] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:37:37 2022] GET /compute/v2.1/servers/b8c93a18-ee0e-438e-823c-cf51f9d4985f => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:37:38.876205 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-45d79078-e85c-4305-a920-2c65275bcee4 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:37:38.876805 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-45d79078-e85c-4305-a920-2c65275bcee4 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] [instance: b3800adf-8cae-407e-9a5e-9eb107bff58d] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:37:38.883003 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-45d79078-e85c-4305-a920-2c65275bcee4 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:37:38.883532 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-45d79078-e85c-4305-a920-2c65275bcee4 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:37:38.883958 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-45d79078-e85c-4305-a920-2c65275bcee4 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:37:38.884634 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-45d79078-e85c-4305-a920-2c65275bcee4 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:37:38.885625 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-45d79078-e85c-4305-a920-2c65275bcee4 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:37:38.886136 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-45d79078-e85c-4305-a920-2c65275bcee4 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:37:39.016245 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-45d79078-e85c-4305-a920-2c65275bcee4 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:37:39.018569 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG dbcounter [-] [125441] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=125441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:37:39.027256 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-45d79078-e85c-4305-a920-2c65275bcee4 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:37:39.029008 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-45d79078-e85c-4305-a920-2c65275bcee4 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:37:39.030137 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-45d79078-e85c-4305-a920-2c65275bcee4 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] 10.222.0.15 "GET /compute/v2.1/servers/b3800adf-8cae-407e-9a5e-9eb107bff58d" status: 200 len: 1407 microversion: 2.20 time: 0.157850 Oct 31 12:37:39.030700 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 323/656] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Oct 31 12:37:38 2022] GET /compute/v2.1/servers/b3800adf-8cae-407e-9a5e-9eb107bff58d => generated 1407 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 12:37:39.136900 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-b3870a00-3514-4832-8f27-69dc8eceda0a tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:37:39.137509 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-b3870a00-3514-4832-8f27-69dc8eceda0a tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] [instance: b8c93a18-ee0e-438e-823c-cf51f9d4985f] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:37:39.144008 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-b3870a00-3514-4832-8f27-69dc8eceda0a tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:37:39.144744 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-b3870a00-3514-4832-8f27-69dc8eceda0a tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:37:39.145174 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-b3870a00-3514-4832-8f27-69dc8eceda0a tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:37:39.145862 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-b3870a00-3514-4832-8f27-69dc8eceda0a tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:37:39.146322 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-b3870a00-3514-4832-8f27-69dc8eceda0a tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:37:39.146739 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-b3870a00-3514-4832-8f27-69dc8eceda0a tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:37:39.280539 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-b3870a00-3514-4832-8f27-69dc8eceda0a tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825059319a204b6da5bc7004b3a09361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14b98f006574deabc030c2e93c680c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:37:39.288117 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-b3870a00-3514-4832-8f27-69dc8eceda0a tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] 10.222.0.15 "GET /compute/v2.1/servers/b8c93a18-ee0e-438e-823c-cf51f9d4985f" status: 200 len: 1567 microversion: 2.1 time: 0.155873 Oct 31 12:37:39.288674 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 334/657] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:37:39 2022] GET /compute/v2.1/servers/b8c93a18-ee0e-438e-823c-cf51f9d4985f => generated 1567 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:37:39.888929 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [req-f4d52a9d-4660-4188-bdd7-5f11f3971a31 req-a248b1ac-91ac-4882-87a9-4c188ab2f940 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3800adf-8cae-407e-9a5e-9eb107bff58d", "name": "network-vif-plugged", "status": "completed", "tag": "360a1655-b233-4d4d-a557-dc89ddf2b18e"}]} {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 12:37:39.899791 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [req-f4d52a9d-4660-4188-bdd7-5f11f3971a31 req-a248b1ac-91ac-4882-87a9-4c188ab2f940 service nova] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:37:39.900317 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [req-f4d52a9d-4660-4188-bdd7-5f11f3971a31 req-a248b1ac-91ac-4882-87a9-4c188ab2f940 service nova] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:37:39.901205 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [req-f4d52a9d-4660-4188-bdd7-5f11f3971a31 req-a248b1ac-91ac-4882-87a9-4c188ab2f940 service nova] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:37:39.912262 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.compute.server_external_events [req-f4d52a9d-4660-4188-bdd7-5f11f3971a31 req-a248b1ac-91ac-4882-87a9-4c188ab2f940 service nova] Creating event network-vif-plugged:360a1655-b233-4d4d-a557-dc89ddf2b18e for instance b3800adf-8cae-407e-9a5e-9eb107bff58d on hv-cinder-79617 Oct 31 12:37:39.917799 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [req-f4d52a9d-4660-4188-bdd7-5f11f3971a31 req-a248b1ac-91ac-4882-87a9-4c188ab2f940 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033200 Oct 31 12:37:39.918394 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 324/658] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Oct 31 12:37:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 12:37:40.054600 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-507e13d6-01eb-40a9-b51b-43e192b85001 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:37:40.055224 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-507e13d6-01eb-40a9-b51b-43e192b85001 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] [instance: b3800adf-8cae-407e-9a5e-9eb107bff58d] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:37:40.061497 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-507e13d6-01eb-40a9-b51b-43e192b85001 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:37:40.062081 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-507e13d6-01eb-40a9-b51b-43e192b85001 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:37:40.062512 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-507e13d6-01eb-40a9-b51b-43e192b85001 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:37:40.063224 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-507e13d6-01eb-40a9-b51b-43e192b85001 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:37:40.063672 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-507e13d6-01eb-40a9-b51b-43e192b85001 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:37:40.064084 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-507e13d6-01eb-40a9-b51b-43e192b85001 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:37:40.190513 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-507e13d6-01eb-40a9-b51b-43e192b85001 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:37:40.198570 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-507e13d6-01eb-40a9-b51b-43e192b85001 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:37:40.200023 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-507e13d6-01eb-40a9-b51b-43e192b85001 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:37:40.201129 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-507e13d6-01eb-40a9-b51b-43e192b85001 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] 10.222.0.15 "GET /compute/v2.1/servers/b3800adf-8cae-407e-9a5e-9eb107bff58d" status: 200 len: 1407 microversion: 2.20 time: 0.150451 Oct 31 12:37:40.201679 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 335/659] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Oct 31 12:37:40 2022] GET /compute/v2.1/servers/b3800adf-8cae-407e-9a5e-9eb107bff58d => generated 1407 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 12:37:40.312373 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-8866ccc4-85bc-469b-93a9-f090f3e4a2c2 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:37:40.313014 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-8866ccc4-85bc-469b-93a9-f090f3e4a2c2 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] [instance: b8c93a18-ee0e-438e-823c-cf51f9d4985f] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:37:40.319045 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-8866ccc4-85bc-469b-93a9-f090f3e4a2c2 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:37:40.319553 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-8866ccc4-85bc-469b-93a9-f090f3e4a2c2 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:37:40.319974 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-8866ccc4-85bc-469b-93a9-f090f3e4a2c2 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:37:40.320644 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-8866ccc4-85bc-469b-93a9-f090f3e4a2c2 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:37:40.321137 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-8866ccc4-85bc-469b-93a9-f090f3e4a2c2 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:37:40.321547 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-8866ccc4-85bc-469b-93a9-f090f3e4a2c2 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:37:40.459980 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-8866ccc4-85bc-469b-93a9-f090f3e4a2c2 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825059319a204b6da5bc7004b3a09361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14b98f006574deabc030c2e93c680c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:37:40.468053 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-8866ccc4-85bc-469b-93a9-f090f3e4a2c2 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] 10.222.0.15 "GET /compute/v2.1/servers/b8c93a18-ee0e-438e-823c-cf51f9d4985f" status: 200 len: 1567 microversion: 2.1 time: 0.159960 Oct 31 12:37:40.468627 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 325/660] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:37:40 2022] GET /compute/v2.1/servers/b8c93a18-ee0e-438e-823c-cf51f9d4985f => generated 1567 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:37:41.226365 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-3aac78c7-4276-4ed2-b18e-483e02095dbc tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:37:41.226895 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-3aac78c7-4276-4ed2-b18e-483e02095dbc tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] [instance: b3800adf-8cae-407e-9a5e-9eb107bff58d] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:37:41.233838 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-3aac78c7-4276-4ed2-b18e-483e02095dbc tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:37:41.234316 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-3aac78c7-4276-4ed2-b18e-483e02095dbc tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:37:41.234979 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-3aac78c7-4276-4ed2-b18e-483e02095dbc tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:37:41.235870 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-3aac78c7-4276-4ed2-b18e-483e02095dbc tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:37:41.236316 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-3aac78c7-4276-4ed2-b18e-483e02095dbc tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:37:41.236731 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-3aac78c7-4276-4ed2-b18e-483e02095dbc tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:37:41.256684 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG dbcounter [-] [125440] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=125440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:37:41.366282 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-3aac78c7-4276-4ed2-b18e-483e02095dbc tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:37:41.374442 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-3aac78c7-4276-4ed2-b18e-483e02095dbc tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:37:41.375901 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-3aac78c7-4276-4ed2-b18e-483e02095dbc tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:37:41.376983 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-3aac78c7-4276-4ed2-b18e-483e02095dbc tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] 10.222.0.15 "GET /compute/v2.1/servers/b3800adf-8cae-407e-9a5e-9eb107bff58d" status: 200 len: 1407 microversion: 2.20 time: 0.154532 Oct 31 12:37:41.377548 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 336/661] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Oct 31 12:37:41 2022] GET /compute/v2.1/servers/b3800adf-8cae-407e-9a5e-9eb107bff58d => generated 1407 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 12:37:41.491370 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-e5fd6200-74a0-40d4-a061-5ceb4e66f062 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:37:41.491972 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-e5fd6200-74a0-40d4-a061-5ceb4e66f062 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] [instance: b8c93a18-ee0e-438e-823c-cf51f9d4985f] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:37:41.498950 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-e5fd6200-74a0-40d4-a061-5ceb4e66f062 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:37:41.499461 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-e5fd6200-74a0-40d4-a061-5ceb4e66f062 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:37:41.499910 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-e5fd6200-74a0-40d4-a061-5ceb4e66f062 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:37:41.500569 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-e5fd6200-74a0-40d4-a061-5ceb4e66f062 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:37:41.501017 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-e5fd6200-74a0-40d4-a061-5ceb4e66f062 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:37:41.501431 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-e5fd6200-74a0-40d4-a061-5ceb4e66f062 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:37:41.628888 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-e5fd6200-74a0-40d4-a061-5ceb4e66f062 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825059319a204b6da5bc7004b3a09361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14b98f006574deabc030c2e93c680c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:37:41.637932 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-e5fd6200-74a0-40d4-a061-5ceb4e66f062 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] 10.222.0.15 "GET /compute/v2.1/servers/b8c93a18-ee0e-438e-823c-cf51f9d4985f" status: 200 len: 1567 microversion: 2.1 time: 0.150206 Oct 31 12:37:41.638758 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 326/662] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:37:41 2022] GET /compute/v2.1/servers/b8c93a18-ee0e-438e-823c-cf51f9d4985f => generated 1567 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:37:42.402374 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-68dc4ee3-a19e-42b8-b5fa-1839ddea0df5 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:37:42.402966 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-68dc4ee3-a19e-42b8-b5fa-1839ddea0df5 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] [instance: b3800adf-8cae-407e-9a5e-9eb107bff58d] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:37:42.410583 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-68dc4ee3-a19e-42b8-b5fa-1839ddea0df5 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:37:42.411056 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-68dc4ee3-a19e-42b8-b5fa-1839ddea0df5 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:37:42.411502 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-68dc4ee3-a19e-42b8-b5fa-1839ddea0df5 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:37:42.412182 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-68dc4ee3-a19e-42b8-b5fa-1839ddea0df5 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:37:42.412624 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-68dc4ee3-a19e-42b8-b5fa-1839ddea0df5 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:37:42.413031 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-68dc4ee3-a19e-42b8-b5fa-1839ddea0df5 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:37:42.551318 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-68dc4ee3-a19e-42b8-b5fa-1839ddea0df5 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:37:42.562545 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-68dc4ee3-a19e-42b8-b5fa-1839ddea0df5 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:37:42.564000 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-68dc4ee3-a19e-42b8-b5fa-1839ddea0df5 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:37:42.565516 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-68dc4ee3-a19e-42b8-b5fa-1839ddea0df5 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] 10.222.0.15 "GET /compute/v2.1/servers/b3800adf-8cae-407e-9a5e-9eb107bff58d" status: 200 len: 1407 microversion: 2.20 time: 0.167106 Oct 31 12:37:42.566124 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 337/663] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Oct 31 12:37:42 2022] GET /compute/v2.1/servers/b3800adf-8cae-407e-9a5e-9eb107bff58d => generated 1407 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 12:37:42.661567 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-e839affa-8e83-4b18-af8d-8a3320d95f13 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:37:42.662129 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-e839affa-8e83-4b18-af8d-8a3320d95f13 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] [instance: b8c93a18-ee0e-438e-823c-cf51f9d4985f] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:37:42.668739 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-e839affa-8e83-4b18-af8d-8a3320d95f13 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:37:42.669221 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-e839affa-8e83-4b18-af8d-8a3320d95f13 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:37:42.669657 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-e839affa-8e83-4b18-af8d-8a3320d95f13 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:37:42.670345 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-e839affa-8e83-4b18-af8d-8a3320d95f13 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:37:42.670798 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-e839affa-8e83-4b18-af8d-8a3320d95f13 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:37:42.671250 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-e839affa-8e83-4b18-af8d-8a3320d95f13 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:37:42.799306 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-7233c4d0-1476-4651-906a-d60694c2bf08 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:37:42.801436 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-7233c4d0-1476-4651-906a-d60694c2bf08 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] [instance: ff125cf8-e8a5-4f00-ade9-045b18ee33f4] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:37:42.806326 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-e839affa-8e83-4b18-af8d-8a3320d95f13 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825059319a204b6da5bc7004b3a09361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14b98f006574deabc030c2e93c680c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:37:42.807586 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-7233c4d0-1476-4651-906a-d60694c2bf08 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:37:42.808067 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-7233c4d0-1476-4651-906a-d60694c2bf08 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:37:42.808493 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-7233c4d0-1476-4651-906a-d60694c2bf08 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:37:42.809193 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-7233c4d0-1476-4651-906a-d60694c2bf08 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:37:42.809643 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-7233c4d0-1476-4651-906a-d60694c2bf08 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:37:42.810065 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-7233c4d0-1476-4651-906a-d60694c2bf08 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:37:42.814108 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-e839affa-8e83-4b18-af8d-8a3320d95f13 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] 10.222.0.15 "GET /compute/v2.1/servers/b8c93a18-ee0e-438e-823c-cf51f9d4985f" status: 200 len: 1568 microversion: 2.1 time: 0.156443 Oct 31 12:37:42.814686 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 327/664] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:37:42 2022] GET /compute/v2.1/servers/b8c93a18-ee0e-438e-823c-cf51f9d4985f => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:37:42.842476 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-7233c4d0-1476-4651-906a-d60694c2bf08 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] 10.222.0.15 "GET /compute/v2.1/servers/ff125cf8-e8a5-4f00-ade9-045b18ee33f4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046993 Oct 31 12:37:42.843074 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 338/665] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Oct 31 12:37:42 2022] GET /compute/v2.1/servers/ff125cf8-e8a5-4f00-ade9-045b18ee33f4/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 31 12:37:42.898553 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-3c736b0d-ec2b-407b-9a56-e96f3d5b4642 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 12:37:42.899394 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-3c736b0d-ec2b-407b-9a56-e96f3d5b4642 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] [instance: b8c93a18-ee0e-438e-823c-cf51f9d4985f] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:37:42.906875 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-3c736b0d-ec2b-407b-9a56-e96f3d5b4642 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:37:42.907462 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-3c736b0d-ec2b-407b-9a56-e96f3d5b4642 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:37:42.907900 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-3c736b0d-ec2b-407b-9a56-e96f3d5b4642 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:37:42.908601 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-3c736b0d-ec2b-407b-9a56-e96f3d5b4642 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:37:42.909056 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-3c736b0d-ec2b-407b-9a56-e96f3d5b4642 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:37:42.909478 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-3c736b0d-ec2b-407b-9a56-e96f3d5b4642 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:37:42.911396 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-c39fd202-23c7-4d0c-bac5-4f99a0fbd358 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:37:42.912163 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-c39fd202-23c7-4d0c-bac5-4f99a0fbd358 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] [instance: ff125cf8-e8a5-4f00-ade9-045b18ee33f4] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:37:42.918694 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-c39fd202-23c7-4d0c-bac5-4f99a0fbd358 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:37:42.919378 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-c39fd202-23c7-4d0c-bac5-4f99a0fbd358 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:37:42.919865 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-c39fd202-23c7-4d0c-bac5-4f99a0fbd358 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:37:42.920649 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-c39fd202-23c7-4d0c-bac5-4f99a0fbd358 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:37:42.921192 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-c39fd202-23c7-4d0c-bac5-4f99a0fbd358 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:37:42.921703 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-c39fd202-23c7-4d0c-bac5-4f99a0fbd358 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:37:42.937283 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG dbcounter [-] [125441] Writing DB stats nova_cell0:SELECT=2 {{(pid=125441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:37:42.941567 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-3c736b0d-ec2b-407b-9a56-e96f3d5b4642 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] [instance: b8c93a18-ee0e-438e-823c-cf51f9d4985f] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=125441) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 31 12:37:42.951152 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-c39fd202-23c7-4d0c-bac5-4f99a0fbd358 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] [instance: ff125cf8-e8a5-4f00-ade9-045b18ee33f4] Going to try to terminate instance {{(pid=125440) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 12:37:42.956834 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG dbcounter [-] [125441] Writing DB stats nova_cell0:SELECT=10 {{(pid=125441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:37:43.013133 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-3c736b0d-ec2b-407b-9a56-e96f3d5b4642 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] 10.222.0.15 "POST /compute/v2.1/servers/b8c93a18-ee0e-438e-823c-cf51f9d4985f/action" status: 202 len: 0 microversion: 2.1 time: 0.118429 Oct 31 12:37:43.013862 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 328/666] 10.222.0.15 () {60 vars in 1278 bytes} [Mon Oct 31 12:37:42 2022] POST /compute/v2.1/servers/b8c93a18-ee0e-438e-823c-cf51f9d4985f/action => generated 0 bytes in 120 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 12:37:43.022342 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-b6a0158d-2d6c-438b-acd3-7ae049a3a050 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:37:43.023692 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-b6a0158d-2d6c-438b-acd3-7ae049a3a050 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] [instance: b8c93a18-ee0e-438e-823c-cf51f9d4985f] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:37:43.030757 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-b6a0158d-2d6c-438b-acd3-7ae049a3a050 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:37:43.031481 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-b6a0158d-2d6c-438b-acd3-7ae049a3a050 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:37:43.032363 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-b6a0158d-2d6c-438b-acd3-7ae049a3a050 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:37:43.033245 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-b6a0158d-2d6c-438b-acd3-7ae049a3a050 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:37:43.033998 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-b6a0158d-2d6c-438b-acd3-7ae049a3a050 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:37:43.034550 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-b6a0158d-2d6c-438b-acd3-7ae049a3a050 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:37:43.038511 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-c39fd202-23c7-4d0c-bac5-4f99a0fbd358 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] 10.222.0.15 "DELETE /compute/v2.1/servers/ff125cf8-e8a5-4f00-ade9-045b18ee33f4" status: 204 len: 0 microversion: 2.1 time: 0.131136 Oct 31 12:37:43.039822 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 339/667] 10.222.0.15 () {58 vars in 1239 bytes} [Mon Oct 31 12:37:42 2022] DELETE /compute/v2.1/servers/ff125cf8-e8a5-4f00-ade9-045b18ee33f4 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 12:37:43.048652 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-318f5156-03c1-4b92-ae4b-30c1d52a1e34 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:37:43.049427 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-318f5156-03c1-4b92-ae4b-30c1d52a1e34 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] [instance: ff125cf8-e8a5-4f00-ade9-045b18ee33f4] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:37:43.055869 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-318f5156-03c1-4b92-ae4b-30c1d52a1e34 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:37:43.056983 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-318f5156-03c1-4b92-ae4b-30c1d52a1e34 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:37:43.057491 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-318f5156-03c1-4b92-ae4b-30c1d52a1e34 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:37:43.058255 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-318f5156-03c1-4b92-ae4b-30c1d52a1e34 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:37:43.058797 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-318f5156-03c1-4b92-ae4b-30c1d52a1e34 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:37:43.059316 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-318f5156-03c1-4b92-ae4b-30c1d52a1e34 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:37:43.087154 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG dbcounter [-] [125440] Writing DB stats nova_cell0:SELECT=2 {{(pid=125440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:37:43.184170 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-b6a0158d-2d6c-438b-acd3-7ae049a3a050 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825059319a204b6da5bc7004b3a09361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14b98f006574deabc030c2e93c680c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:37:43.191856 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-b6a0158d-2d6c-438b-acd3-7ae049a3a050 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] 10.222.0.15 "GET /compute/v2.1/servers/b8c93a18-ee0e-438e-823c-cf51f9d4985f" status: 200 len: 1516 microversion: 2.1 time: 0.173448 Oct 31 12:37:43.192377 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 329/668] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:37:43 2022] GET /compute/v2.1/servers/b8c93a18-ee0e-438e-823c-cf51f9d4985f => generated 1516 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:37:43.238351 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-318f5156-03c1-4b92-ae4b-30c1d52a1e34 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c1beb321e44908ab987b17f7b74484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a2bf9a5a484523a700e4e6c568d4de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:37:43.246964 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-318f5156-03c1-4b92-ae4b-30c1d52a1e34 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] 10.222.0.15 "GET /compute/v2.1/servers/ff125cf8-e8a5-4f00-ade9-045b18ee33f4" status: 200 len: 1674 microversion: 2.1 time: 0.202771 Oct 31 12:37:43.247572 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 340/669] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:37:43 2022] GET /compute/v2.1/servers/ff125cf8-e8a5-4f00-ade9-045b18ee33f4 => generated 1674 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:37:43.591981 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-0f912bb1-a94a-4ed7-8831-0e9b13abfcda tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:37:43.592577 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-0f912bb1-a94a-4ed7-8831-0e9b13abfcda tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] [instance: b3800adf-8cae-407e-9a5e-9eb107bff58d] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:37:43.598482 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-0f912bb1-a94a-4ed7-8831-0e9b13abfcda tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:37:43.598956 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-0f912bb1-a94a-4ed7-8831-0e9b13abfcda tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:37:43.599416 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-0f912bb1-a94a-4ed7-8831-0e9b13abfcda tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:37:43.600090 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-0f912bb1-a94a-4ed7-8831-0e9b13abfcda tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:37:43.600533 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-0f912bb1-a94a-4ed7-8831-0e9b13abfcda tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:37:43.600946 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-0f912bb1-a94a-4ed7-8831-0e9b13abfcda tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:37:43.728784 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-0f912bb1-a94a-4ed7-8831-0e9b13abfcda tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:37:43.736733 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-0f912bb1-a94a-4ed7-8831-0e9b13abfcda tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:37:43.738152 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-0f912bb1-a94a-4ed7-8831-0e9b13abfcda tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:37:43.739314 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-0f912bb1-a94a-4ed7-8831-0e9b13abfcda tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] 10.222.0.15 "GET /compute/v2.1/servers/b3800adf-8cae-407e-9a5e-9eb107bff58d" status: 200 len: 1599 microversion: 2.20 time: 0.152042 Oct 31 12:37:43.739874 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 330/670] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Oct 31 12:37:43 2022] GET /compute/v2.1/servers/b3800adf-8cae-407e-9a5e-9eb107bff58d => generated 1599 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 12:37:43.764967 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-dce011a6-67b0-4407-9dff-deb828563d0c tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:37:43.765637 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-dce011a6-67b0-4407-9dff-deb828563d0c tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] [instance: b3800adf-8cae-407e-9a5e-9eb107bff58d] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:37:43.772326 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-dce011a6-67b0-4407-9dff-deb828563d0c tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:37:43.772809 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-dce011a6-67b0-4407-9dff-deb828563d0c tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:37:43.773234 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-dce011a6-67b0-4407-9dff-deb828563d0c tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:37:43.774059 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-dce011a6-67b0-4407-9dff-deb828563d0c tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:37:43.774556 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-dce011a6-67b0-4407-9dff-deb828563d0c tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:37:43.775337 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-dce011a6-67b0-4407-9dff-deb828563d0c tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:37:43.857224 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-dce011a6-67b0-4407-9dff-deb828563d0c tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] 10.222.0.15 "GET /compute/v2.1/servers/b3800adf-8cae-407e-9a5e-9eb107bff58d/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.096096 Oct 31 12:37:43.857916 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 341/671] 10.222.0.15 () {60 vars in 1316 bytes} [Mon Oct 31 12:37:43 2022] GET /compute/v2.1/servers/b3800adf-8cae-407e-9a5e-9eb107bff58d/os-interface => generated 285 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 12:37:43.872113 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [req-0d9d5ece-8c44-44cb-b3aa-9cf5b723c318 req-9a0b8d5e-6fc1-42ce-8ee8-66529362e21b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8c93a18-ee0e-438e-823c-cf51f9d4985f", "name": "network-vif-unplugged", "status": "completed", "tag": "c444a742-6430-4bab-91f7-bff045443454"}]} {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 12:37:43.882052 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [req-0d9d5ece-8c44-44cb-b3aa-9cf5b723c318 req-9a0b8d5e-6fc1-42ce-8ee8-66529362e21b service nova] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:37:43.882541 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [req-0d9d5ece-8c44-44cb-b3aa-9cf5b723c318 req-9a0b8d5e-6fc1-42ce-8ee8-66529362e21b service nova] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:37:43.882969 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [req-0d9d5ece-8c44-44cb-b3aa-9cf5b723c318 req-9a0b8d5e-6fc1-42ce-8ee8-66529362e21b service nova] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:37:43.895875 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.compute.server_external_events [req-0d9d5ece-8c44-44cb-b3aa-9cf5b723c318 req-9a0b8d5e-6fc1-42ce-8ee8-66529362e21b service nova] Unable to find a host for instance b8c93a18-ee0e-438e-823c-cf51f9d4985f. Dropping event network-vif-unplugged {{(pid=125441) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 31 12:37:43.896755 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [req-0d9d5ece-8c44-44cb-b3aa-9cf5b723c318 req-9a0b8d5e-6fc1-42ce-8ee8-66529362e21b service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.036573 Oct 31 12:37:43.897646 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 331/672] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Oct 31 12:37:43 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 38 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 31 12:37:44.214081 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-09236e43-431a-4d12-ad77-da4c93fb5f32 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:37:44.214692 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-09236e43-431a-4d12-ad77-da4c93fb5f32 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] [instance: b8c93a18-ee0e-438e-823c-cf51f9d4985f] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:37:44.220962 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-09236e43-431a-4d12-ad77-da4c93fb5f32 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:37:44.221450 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-09236e43-431a-4d12-ad77-da4c93fb5f32 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:37:44.221881 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-09236e43-431a-4d12-ad77-da4c93fb5f32 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:37:44.222583 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-09236e43-431a-4d12-ad77-da4c93fb5f32 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:37:44.223036 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-09236e43-431a-4d12-ad77-da4c93fb5f32 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:37:44.223487 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-09236e43-431a-4d12-ad77-da4c93fb5f32 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:37:44.270104 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-b0137d1e-3944-4ce5-8ad4-f489266fc003 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:37:44.270716 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-b0137d1e-3944-4ce5-8ad4-f489266fc003 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] [instance: ff125cf8-e8a5-4f00-ade9-045b18ee33f4] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:37:44.272940 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG dbcounter [-] [125441] Writing DB stats nova_api:SELECT=84,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=125441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:37:44.278529 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-b0137d1e-3944-4ce5-8ad4-f489266fc003 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:37:44.279014 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-b0137d1e-3944-4ce5-8ad4-f489266fc003 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:37:44.279469 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-b0137d1e-3944-4ce5-8ad4-f489266fc003 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:37:44.280173 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-b0137d1e-3944-4ce5-8ad4-f489266fc003 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:37:44.280711 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-b0137d1e-3944-4ce5-8ad4-f489266fc003 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:37:44.281130 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-b0137d1e-3944-4ce5-8ad4-f489266fc003 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:37:44.366776 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-09236e43-431a-4d12-ad77-da4c93fb5f32 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825059319a204b6da5bc7004b3a09361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14b98f006574deabc030c2e93c680c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:37:44.375759 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-09236e43-431a-4d12-ad77-da4c93fb5f32 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] 10.222.0.15 "GET /compute/v2.1/servers/b8c93a18-ee0e-438e-823c-cf51f9d4985f" status: 200 len: 1516 microversion: 2.1 time: 0.165507 Oct 31 12:37:44.376458 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 342/673] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:37:44 2022] GET /compute/v2.1/servers/b8c93a18-ee0e-438e-823c-cf51f9d4985f => generated 1516 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:37:44.588438 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-b0137d1e-3944-4ce5-8ad4-f489266fc003 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c1beb321e44908ab987b17f7b74484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a2bf9a5a484523a700e4e6c568d4de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:37:44.596081 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-b0137d1e-3944-4ce5-8ad4-f489266fc003 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] 10.222.0.15 "GET /compute/v2.1/servers/ff125cf8-e8a5-4f00-ade9-045b18ee33f4" status: 200 len: 1674 microversion: 2.1 time: 0.330070 Oct 31 12:37:44.596664 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 332/674] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:37:44 2022] GET /compute/v2.1/servers/ff125cf8-e8a5-4f00-ade9-045b18ee33f4 => generated 1674 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 12:37:45.095475 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [req-6e21d1e6-24c3-47ff-9c8c-c4cf39475747 req-0042cd2a-8e50-458b-8c9a-b2d94e20452f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b3800adf-8cae-407e-9a5e-9eb107bff58d", "tag": "360a1655-b233-4d4d-a557-dc89ddf2b18e"}]} {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 12:37:45.105642 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [req-6e21d1e6-24c3-47ff-9c8c-c4cf39475747 req-0042cd2a-8e50-458b-8c9a-b2d94e20452f service nova] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:37:45.106114 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [req-6e21d1e6-24c3-47ff-9c8c-c4cf39475747 req-0042cd2a-8e50-458b-8c9a-b2d94e20452f service nova] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:37:45.106541 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [req-6e21d1e6-24c3-47ff-9c8c-c4cf39475747 req-0042cd2a-8e50-458b-8c9a-b2d94e20452f service nova] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:37:45.117782 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.compute.server_external_events [req-6e21d1e6-24c3-47ff-9c8c-c4cf39475747 req-0042cd2a-8e50-458b-8c9a-b2d94e20452f service nova] Creating event network-changed:360a1655-b233-4d4d-a557-dc89ddf2b18e for instance b3800adf-8cae-407e-9a5e-9eb107bff58d on hv-cinder-79617 Oct 31 12:37:45.122640 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [req-6e21d1e6-24c3-47ff-9c8c-c4cf39475747 req-0042cd2a-8e50-458b-8c9a-b2d94e20452f service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030967 Oct 31 12:37:45.123667 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 343/675] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Oct 31 12:37:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 12:37:45.398348 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-21953799-6d3f-4459-8c7a-c969fed3bca6 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:37:45.398998 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-21953799-6d3f-4459-8c7a-c969fed3bca6 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] [instance: b8c93a18-ee0e-438e-823c-cf51f9d4985f] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:37:45.406578 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-21953799-6d3f-4459-8c7a-c969fed3bca6 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:37:45.407062 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-21953799-6d3f-4459-8c7a-c969fed3bca6 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:37:45.407523 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-21953799-6d3f-4459-8c7a-c969fed3bca6 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:37:45.408625 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-21953799-6d3f-4459-8c7a-c969fed3bca6 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:37:45.408716 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-21953799-6d3f-4459-8c7a-c969fed3bca6 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:37:45.409086 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-21953799-6d3f-4459-8c7a-c969fed3bca6 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:37:45.582439 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-21953799-6d3f-4459-8c7a-c969fed3bca6 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825059319a204b6da5bc7004b3a09361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14b98f006574deabc030c2e93c680c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:37:45.596216 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-21953799-6d3f-4459-8c7a-c969fed3bca6 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] 10.222.0.15 "GET /compute/v2.1/servers/b8c93a18-ee0e-438e-823c-cf51f9d4985f" status: 200 len: 1518 microversion: 2.1 time: 0.202014 Oct 31 12:37:45.596800 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 333/676] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:37:45 2022] GET /compute/v2.1/servers/b8c93a18-ee0e-438e-823c-cf51f9d4985f => generated 1518 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:37:45.620925 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-83cae0d6-cb39-4de6-b2fd-6680d5b8dc97 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:37:45.621624 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-83cae0d6-cb39-4de6-b2fd-6680d5b8dc97 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] [instance: ff125cf8-e8a5-4f00-ade9-045b18ee33f4] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:37:45.628092 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-83cae0d6-cb39-4de6-b2fd-6680d5b8dc97 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:37:45.628569 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-83cae0d6-cb39-4de6-b2fd-6680d5b8dc97 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:37:45.628998 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-83cae0d6-cb39-4de6-b2fd-6680d5b8dc97 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:37:45.629686 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-83cae0d6-cb39-4de6-b2fd-6680d5b8dc97 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:37:45.630361 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-83cae0d6-cb39-4de6-b2fd-6680d5b8dc97 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:37:45.630938 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-83cae0d6-cb39-4de6-b2fd-6680d5b8dc97 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:37:46.013908 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-83cae0d6-cb39-4de6-b2fd-6680d5b8dc97 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c1beb321e44908ab987b17f7b74484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a2bf9a5a484523a700e4e6c568d4de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:37:46.023578 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-83cae0d6-cb39-4de6-b2fd-6680d5b8dc97 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] 10.222.0.15 "GET /compute/v2.1/servers/ff125cf8-e8a5-4f00-ade9-045b18ee33f4" status: 200 len: 1674 microversion: 2.1 time: 0.406790 Oct 31 12:37:46.042871 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 344/677] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:37:45 2022] GET /compute/v2.1/servers/ff125cf8-e8a5-4f00-ade9-045b18ee33f4 => generated 1674 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:37:46.621154 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-9f7b5e28-b7e4-4587-a352-9b98f4c6bf94 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:37:46.621769 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-9f7b5e28-b7e4-4587-a352-9b98f4c6bf94 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] [instance: b8c93a18-ee0e-438e-823c-cf51f9d4985f] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:37:46.628232 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-9f7b5e28-b7e4-4587-a352-9b98f4c6bf94 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:37:46.628741 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-9f7b5e28-b7e4-4587-a352-9b98f4c6bf94 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:37:46.629171 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-9f7b5e28-b7e4-4587-a352-9b98f4c6bf94 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:37:46.629877 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-9f7b5e28-b7e4-4587-a352-9b98f4c6bf94 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:37:46.630317 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-9f7b5e28-b7e4-4587-a352-9b98f4c6bf94 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:37:46.630734 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-9f7b5e28-b7e4-4587-a352-9b98f4c6bf94 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:37:46.833323 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-9f7b5e28-b7e4-4587-a352-9b98f4c6bf94 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825059319a204b6da5bc7004b3a09361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14b98f006574deabc030c2e93c680c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:37:46.842474 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-9f7b5e28-b7e4-4587-a352-9b98f4c6bf94 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] 10.222.0.15 "GET /compute/v2.1/servers/b8c93a18-ee0e-438e-823c-cf51f9d4985f" status: 200 len: 1574 microversion: 2.1 time: 0.225361 Oct 31 12:37:46.843507 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 334/678] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:37:46 2022] GET /compute/v2.1/servers/b8c93a18-ee0e-438e-823c-cf51f9d4985f => generated 1574 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:37:46.998871 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [req-5a543b47-ad54-4d60-9f75-9bc78626a406 req-56381394-6e97-445a-89f6-1f71af2d201a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff125cf8-e8a5-4f00-ade9-045b18ee33f4", "name": "network-vif-deleted", "tag": "f9ca4955-7ad3-407e-b90d-7bad757cb1d8"}]} {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 12:37:47.010578 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [req-5a543b47-ad54-4d60-9f75-9bc78626a406 req-56381394-6e97-445a-89f6-1f71af2d201a service nova] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:37:47.011538 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [req-5a543b47-ad54-4d60-9f75-9bc78626a406 req-56381394-6e97-445a-89f6-1f71af2d201a service nova] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:37:47.012180 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [req-5a543b47-ad54-4d60-9f75-9bc78626a406 req-56381394-6e97-445a-89f6-1f71af2d201a service nova] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:37:47.024500 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.compute.server_external_events [req-5a543b47-ad54-4d60-9f75-9bc78626a406 req-56381394-6e97-445a-89f6-1f71af2d201a service nova] Creating event network-vif-deleted:f9ca4955-7ad3-407e-b90d-7bad757cb1d8 for instance ff125cf8-e8a5-4f00-ade9-045b18ee33f4 on hv-cinder-79617 Oct 31 12:37:47.030178 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [req-5a543b47-ad54-4d60-9f75-9bc78626a406 req-56381394-6e97-445a-89f6-1f71af2d201a service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036326 Oct 31 12:37:47.031229 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 345/679] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Oct 31 12:37:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 12:37:47.050235 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-dcff2c3f-720a-4710-8532-c55491312276 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:37:47.051402 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-dcff2c3f-720a-4710-8532-c55491312276 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] [instance: ff125cf8-e8a5-4f00-ade9-045b18ee33f4] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:37:47.059674 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-dcff2c3f-720a-4710-8532-c55491312276 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:37:47.060582 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-dcff2c3f-720a-4710-8532-c55491312276 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:37:47.061428 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-dcff2c3f-720a-4710-8532-c55491312276 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:37:47.062504 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-dcff2c3f-720a-4710-8532-c55491312276 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:37:47.063488 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-dcff2c3f-720a-4710-8532-c55491312276 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:37:47.064007 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-dcff2c3f-720a-4710-8532-c55491312276 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:37:47.147262 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-dcff2c3f-720a-4710-8532-c55491312276 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c1beb321e44908ab987b17f7b74484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a2bf9a5a484523a700e4e6c568d4de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:37:47.158157 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-dcff2c3f-720a-4710-8532-c55491312276 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] 10.222.0.15 "GET /compute/v2.1/servers/ff125cf8-e8a5-4f00-ade9-045b18ee33f4" status: 200 len: 1323 microversion: 2.1 time: 0.112314 Oct 31 12:37:47.159044 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 335/680] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:37:47 2022] GET /compute/v2.1/servers/ff125cf8-e8a5-4f00-ade9-045b18ee33f4 => generated 1323 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 12:37:47.870321 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-5792d7bd-d256-4a12-a173-2a2ed2d4ef04 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:37:47.871417 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-5792d7bd-d256-4a12-a173-2a2ed2d4ef04 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] [instance: b8c93a18-ee0e-438e-823c-cf51f9d4985f] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:37:47.877943 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-5792d7bd-d256-4a12-a173-2a2ed2d4ef04 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:37:47.878522 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-5792d7bd-d256-4a12-a173-2a2ed2d4ef04 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:37:47.879045 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-5792d7bd-d256-4a12-a173-2a2ed2d4ef04 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:37:47.879819 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-5792d7bd-d256-4a12-a173-2a2ed2d4ef04 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:37:47.880263 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-5792d7bd-d256-4a12-a173-2a2ed2d4ef04 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:37:47.880672 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-5792d7bd-d256-4a12-a173-2a2ed2d4ef04 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:37:48.020943 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-5792d7bd-d256-4a12-a173-2a2ed2d4ef04 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825059319a204b6da5bc7004b3a09361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14b98f006574deabc030c2e93c680c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:37:48.029785 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-5792d7bd-d256-4a12-a173-2a2ed2d4ef04 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] 10.222.0.15 "GET /compute/v2.1/servers/b8c93a18-ee0e-438e-823c-cf51f9d4985f" status: 200 len: 1574 microversion: 2.1 time: 0.165945 Oct 31 12:37:48.036883 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 346/681] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:37:47 2022] GET /compute/v2.1/servers/b8c93a18-ee0e-438e-823c-cf51f9d4985f => generated 1574 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:37:48.182287 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-c3689753-b63b-487b-ae49-dbd3b7f93e6a tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:37:48.183004 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-c3689753-b63b-487b-ae49-dbd3b7f93e6a tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] [instance: ff125cf8-e8a5-4f00-ade9-045b18ee33f4] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:37:48.189728 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-c3689753-b63b-487b-ae49-dbd3b7f93e6a tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:37:48.190213 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-c3689753-b63b-487b-ae49-dbd3b7f93e6a tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:37:48.190643 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-c3689753-b63b-487b-ae49-dbd3b7f93e6a tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:37:48.191370 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-c3689753-b63b-487b-ae49-dbd3b7f93e6a tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:37:48.191825 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-c3689753-b63b-487b-ae49-dbd3b7f93e6a tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:37:48.192242 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-c3689753-b63b-487b-ae49-dbd3b7f93e6a tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:37:48.208032 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.wsgi [None req-c3689753-b63b-487b-ae49-dbd3b7f93e6a tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] HTTP exception thrown: Instance ff125cf8-e8a5-4f00-ade9-045b18ee33f4 could not be found. Oct 31 12:37:48.209706 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-c3689753-b63b-487b-ae49-dbd3b7f93e6a tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Request method failure captured: Oct 31 12:37:48.209706 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: request: GET /compute/v2.1/servers/ff125cf8-e8a5-4f00-ade9-045b18ee33f4 HTTP/1.1 Oct 31 12:37:48.209706 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: Accept: application/json Oct 31 12:37:48.209706 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: Accept-Encoding: identity Oct 31 12:37:48.209706 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: Connection: close Oct 31 12:37:48.209706 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: Content-Length: 0 Oct 31 12:37:48.209706 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: Content-Type: application/json Oct 31 12:37:48.209706 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: Host: 10.222.0.15 Oct 31 12:37:48.209706 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: Openstack-System-Scope: None Oct 31 12:37:48.209706 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: User-Agent: python-urllib3/1.26.12 Oct 31 12:37:48.209706 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Auth-Token: gAAAAABjX8B2m1m9MuKBHO0SxDm7arupmshYlZMAAEgJbORjur4Qe9OXcQVHKBx6k7T788otdlxtGddMg-xkFyl2KDcVhkjBWCqqwl5KGIfG6sLllN0xH9I_wHEXqxzSWixQ1A2CE1FBbOiKiTEJ4kGxgYMjSo6WKiJZiEFxLVgKkbpX9vSJpEU Oct 31 12:37:48.209706 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Domain-Id: None Oct 31 12:37:48.209706 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Domain-Name: None Oct 31 12:37:48.209706 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Identity-Status: Confirmed Oct 31 12:37:48.209706 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Is-Admin-Project: True Oct 31 12:37:48.209706 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Project-Domain-Id: default Oct 31 12:37:48.209706 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Project-Domain-Name: Default Oct 31 12:37:48.209706 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Project-Id: b9a2bf9a5a484523a700e4e6c568d4de Oct 31 12:37:48.209706 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Project-Name: tempest-AttachVolumeTestJSON-447861972 Oct 31 12:37:48.209706 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Role: reader,member Oct 31 12:37:48.209706 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Roles: reader,member Oct 31 12:37:48.211374 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/b9a2bf9a5a484523a700e4e6c568d4de"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_b9a2bf9a5a484523a700e4e6c568d4de", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/b9a2bf9a5a484523a700e4e6c568d4de"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/b9a2bf9a5a484523a700e4e6c568d4de"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Oct 31 12:37:48.211374 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Tenant: tempest-AttachVolumeTestJSON-447861972 Oct 31 12:37:48.211374 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Tenant-Id: b9a2bf9a5a484523a700e4e6c568d4de Oct 31 12:37:48.211374 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Tenant-Name: tempest-AttachVolumeTestJSON-447861972 Oct 31 12:37:48.211374 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-User: tempest-AttachVolumeTestJSON-447861972-project Oct 31 12:37:48.211374 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-User-Domain-Id: default Oct 31 12:37:48.211374 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-User-Domain-Name: Default Oct 31 12:37:48.211374 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-User-Id: d6c1beb321e44908ab987b17f7b74484 Oct 31 12:37:48.211374 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-User-Name: tempest-AttachVolumeTestJSON-447861972-project Oct 31 12:37:48.211374 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: method: > Oct 31 12:37:48.211374 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: exception: Instance ff125cf8-e8a5-4f00-ade9-045b18ee33f4 could not be found. Oct 31 12:37:48.211374 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: action_args: {'id': 'ff125cf8-e8a5-4f00-ade9-045b18ee33f4'} Oct 31 12:37:48.212350 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 12:37:48.212350 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 12:37:48.212350 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 12:37:48.212350 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 12:37:48.212350 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 12:37:48.212350 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 12:37:48.212350 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 12:37:48.212350 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 12:37:48.212350 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 12:37:48.212350 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 12:37:48.212350 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ff125cf8-e8a5-4f00-ade9-045b18ee33f4 could not be found. Oct 31 12:37:48.212350 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Oct 31 12:37:48.212350 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 12:37:48.212350 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Oct 31 12:37:48.212350 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 12:37:48.212350 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 12:37:48.212350 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 12:37:48.212350 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 12:37:48.212350 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 12:37:48.212350 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 12:37:48.215151 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 12:37:48.215151 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 12:37:48.215151 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 12:37:48.215151 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 12:37:48.215151 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 12:37:48.215151 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 12:37:48.215151 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 12:37:48.215151 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ff125cf8-e8a5-4f00-ade9-045b18ee33f4 could not be found. Oct 31 12:37:48.215151 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Oct 31 12:37:48.215151 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 12:37:48.215151 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Oct 31 12:37:48.215151 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 12:37:48.215151 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 12:37:48.215151 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 12:37:48.215151 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 12:37:48.215151 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 12:37:48.215151 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ff125cf8-e8a5-4f00-ade9-045b18ee33f4 could not be found. Oct 31 12:37:48.215151 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Oct 31 12:37:48.216426 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-c3689753-b63b-487b-ae49-dbd3b7f93e6a tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Returning 404 to user: Instance ff125cf8-e8a5-4f00-ade9-045b18ee33f4 could not be found. {{(pid=125441) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 12:37:48.216426 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-c3689753-b63b-487b-ae49-dbd3b7f93e6a tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] 10.222.0.15 "GET /compute/v2.1/servers/ff125cf8-e8a5-4f00-ade9-045b18ee33f4" status: 404 len: 111 microversion: 2.1 time: 0.032900 Oct 31 12:37:48.216426 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 336/682] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:37:48 2022] GET /compute/v2.1/servers/ff125cf8-e8a5-4f00-ade9-045b18ee33f4 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 12:37:48.221784 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-2255723c-0f8b-4b82-9809-6f80cadc02eb tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Calling method '.version_select at 0x7f2aa530f310>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:37:48.242566 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-2255723c-0f8b-4b82-9809-6f80cadc02eb tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2037540967" status: 202 len: 0 microversion: 2.1 time: 0.024540 Oct 31 12:37:48.243309 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 347/683] 10.222.0.15 () {58 vars in 1221 bytes} [Mon Oct 31 12:37:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2037540967 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 12:37:48.836382 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-259f9a44-b41d-4313-b262-d3a0bbbbe577 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Action: 'create', calling method: .version_select at 0x7f2aa5073ca0>, body: {"keypair": {"name": "tempest-keypair-1119950657", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGIkQH5qXDN1XDzQLwwCaIOAKFA/7TxNWsQJiERVFiyZHmCIuZWw8PjMSv8w0OYqImyRDLynwohEzrcCKKx5vRctkjwYUY4aJSNuMw2+xF+8ZVmFjytvLw13ywm3munKEQ=="}} {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 12:37:48.852601 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.quota [None req-259f9a44-b41d-4313-b262-d3a0bbbbe577 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Getting quotas for project b9a2bf9a5a484523a700e4e6c568d4de. Resources: {'key_pairs'} {{(pid=125441) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 12:37:48.856518 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.quota [None req-259f9a44-b41d-4313-b262-d3a0bbbbe577 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Getting quotas for user d6c1beb321e44908ab987b17f7b74484 and project b9a2bf9a5a484523a700e4e6c568d4de. Resources: {'key_pairs'} {{(pid=125441) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 12:37:48.877458 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-259f9a44-b41d-4313-b262-d3a0bbbbe577 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.045044 Oct 31 12:37:48.878046 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 337/684] 10.222.0.15 () {60 vars in 1159 bytes} [Mon Oct 31 12:37:48 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 12:37:49.055185 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-09085129-d142-4775-9db9-67be1ceb0c23 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:37:49.056931 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-09085129-d142-4775-9db9-67be1ceb0c23 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] [instance: b8c93a18-ee0e-438e-823c-cf51f9d4985f] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:37:49.064092 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-09085129-d142-4775-9db9-67be1ceb0c23 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:37:49.064768 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-09085129-d142-4775-9db9-67be1ceb0c23 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:37:49.065193 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-09085129-d142-4775-9db9-67be1ceb0c23 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:37:49.065921 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-09085129-d142-4775-9db9-67be1ceb0c23 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:37:49.066428 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-09085129-d142-4775-9db9-67be1ceb0c23 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:37:49.067074 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-09085129-d142-4775-9db9-67be1ceb0c23 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:37:49.208089 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-09085129-d142-4775-9db9-67be1ceb0c23 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825059319a204b6da5bc7004b3a09361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14b98f006574deabc030c2e93c680c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:37:49.215947 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-09085129-d142-4775-9db9-67be1ceb0c23 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] 10.222.0.15 "GET /compute/v2.1/servers/b8c93a18-ee0e-438e-823c-cf51f9d4985f" status: 200 len: 1574 microversion: 2.1 time: 0.165596 Oct 31 12:37:49.216514 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 348/685] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:37:49 2022] GET /compute/v2.1/servers/b8c93a18-ee0e-438e-823c-cf51f9d4985f => generated 1574 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:37:50.147203 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-b9a06e4e-5da9-4a6e-98b8-024cefceae8d tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1004204059", "imageRef": "fbbea321-8f0d-4092-b070-b67a6931d610", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "213ef750-b5e2-42dd-8125-73c9f2985c9d"}], "security_groups": [{"name": "tempest-securitygroup--1296546876"}], "key_name": "tempest-keypair-1119950657", "user_data": "}} {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 12:37:50.239469 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-8d95da51-02da-46f7-a3bf-ab2b736c26ef tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:37:50.240835 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-8d95da51-02da-46f7-a3bf-ab2b736c26ef tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] [instance: b8c93a18-ee0e-438e-823c-cf51f9d4985f] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:37:50.247289 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-8d95da51-02da-46f7-a3bf-ab2b736c26ef tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:37:50.247819 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-8d95da51-02da-46f7-a3bf-ab2b736c26ef tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:37:50.248178 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-8d95da51-02da-46f7-a3bf-ab2b736c26ef tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:37:50.248863 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-8d95da51-02da-46f7-a3bf-ab2b736c26ef tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:37:50.249114 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.network.neutron [None req-b9a06e4e-5da9-4a6e-98b8-024cefceae8d tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] validate_networks() for [('213ef750-b5e2-42dd-8125-73c9f2985c9d', None, None, None, None, None)] {{(pid=125441) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 12:37:50.249311 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-8d95da51-02da-46f7-a3bf-ab2b736c26ef tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:37:50.249726 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-8d95da51-02da-46f7-a3bf-ab2b736c26ef tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:37:50.382992 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-8d95da51-02da-46f7-a3bf-ab2b736c26ef tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825059319a204b6da5bc7004b3a09361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14b98f006574deabc030c2e93c680c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:37:50.391736 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-8d95da51-02da-46f7-a3bf-ab2b736c26ef tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] 10.222.0.15 "GET /compute/v2.1/servers/b8c93a18-ee0e-438e-823c-cf51f9d4985f" status: 200 len: 1574 microversion: 2.1 time: 0.156201 Oct 31 12:37:50.392311 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 349/686] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:37:50 2022] GET /compute/v2.1/servers/b8c93a18-ee0e-438e-823c-cf51f9d4985f => generated 1574 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 12:37:50.621673 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.virt.hardware [None req-b9a06e4e-5da9-4a6e-98b8-024cefceae8d tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Flavor limits 0:0:0 {{(pid=125441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 12:37:50.622086 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.virt.hardware [None req-b9a06e4e-5da9-4a6e-98b8-024cefceae8d tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Image limits 0:0:0 {{(pid=125441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 12:37:50.622550 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.virt.hardware [None req-b9a06e4e-5da9-4a6e-98b8-024cefceae8d tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Flavor pref 0:0:0 {{(pid=125441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 12:37:50.622958 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.virt.hardware [None req-b9a06e4e-5da9-4a6e-98b8-024cefceae8d tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Image pref 0:0:0 {{(pid=125441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 12:37:50.623398 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.virt.hardware [None req-b9a06e4e-5da9-4a6e-98b8-024cefceae8d tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 12:37:50.631865 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-b9a06e4e-5da9-4a6e-98b8-024cefceae8d tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:37:50.632338 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-b9a06e4e-5da9-4a6e-98b8-024cefceae8d tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:37:50.632760 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-b9a06e4e-5da9-4a6e-98b8-024cefceae8d tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:37:50.633466 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-b9a06e4e-5da9-4a6e-98b8-024cefceae8d tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:37:50.633911 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-b9a06e4e-5da9-4a6e-98b8-024cefceae8d tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:37:50.634390 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-b9a06e4e-5da9-4a6e-98b8-024cefceae8d tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:37:50.651691 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.quota [None req-b9a06e4e-5da9-4a6e-98b8-024cefceae8d tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Getting quotas for project b9a2bf9a5a484523a700e4e6c568d4de. Resources: {'instances', 'cores', 'ram'} {{(pid=125441) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 12:37:50.655673 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.quota [None req-b9a06e4e-5da9-4a6e-98b8-024cefceae8d tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Getting quotas for user d6c1beb321e44908ab987b17f7b74484 and project b9a2bf9a5a484523a700e4e6c568d4de. Resources: {'instances', 'cores', 'ram'} {{(pid=125441) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 12:37:50.666968 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-b9a06e4e-5da9-4a6e-98b8-024cefceae8d tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Going to run 1 instances... {{(pid=125441) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 12:37:50.669237 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-b9a06e4e-5da9-4a6e-98b8-024cefceae8d tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] [instance: 96065a23-4a5f-4ffb-8b48-746d2dc2c301] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fbbea321-8f0d-4092-b070-b67a6931d610',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125441) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 12:37:50.716251 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-b9a06e4e-5da9-4a6e-98b8-024cefceae8d tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.574119 Oct 31 12:37:50.716868 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 338/687] 10.222.0.15 () {60 vars in 1147 bytes} [Mon Oct 31 12:37:50 2022] POST /compute/v2.1/servers => generated 402 bytes in 575 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 12:37:50.728144 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-2a8e8a9a-794c-4dfe-9577-3f4a9672e8d7 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:37:50.729411 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-2a8e8a9a-794c-4dfe-9577-3f4a9672e8d7 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] [instance: 96065a23-4a5f-4ffb-8b48-746d2dc2c301] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:37:50.784942 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-2a8e8a9a-794c-4dfe-9577-3f4a9672e8d7 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c1beb321e44908ab987b17f7b74484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a2bf9a5a484523a700e4e6c568d4de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:37:50.793086 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-2a8e8a9a-794c-4dfe-9577-3f4a9672e8d7 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] 10.222.0.15 "GET /compute/v2.1/servers/96065a23-4a5f-4ffb-8b48-746d2dc2c301" status: 200 len: 1238 microversion: 2.1 time: 0.069013 Oct 31 12:37:50.793654 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 350/688] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:37:50 2022] GET /compute/v2.1/servers/96065a23-4a5f-4ffb-8b48-746d2dc2c301 => generated 1238 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:37:51.416528 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-dac237c1-84ea-4a8c-80da-b136c644c87a tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:37:51.417141 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-dac237c1-84ea-4a8c-80da-b136c644c87a tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] [instance: b8c93a18-ee0e-438e-823c-cf51f9d4985f] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:37:51.423453 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-dac237c1-84ea-4a8c-80da-b136c644c87a tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:37:51.423930 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-dac237c1-84ea-4a8c-80da-b136c644c87a tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:37:51.424391 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-dac237c1-84ea-4a8c-80da-b136c644c87a tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:37:51.425076 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-dac237c1-84ea-4a8c-80da-b136c644c87a tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:37:51.425532 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-dac237c1-84ea-4a8c-80da-b136c644c87a tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:37:51.425949 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-dac237c1-84ea-4a8c-80da-b136c644c87a tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:37:51.564414 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-dac237c1-84ea-4a8c-80da-b136c644c87a tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825059319a204b6da5bc7004b3a09361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14b98f006574deabc030c2e93c680c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:37:51.572978 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-dac237c1-84ea-4a8c-80da-b136c644c87a tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] 10.222.0.15 "GET /compute/v2.1/servers/b8c93a18-ee0e-438e-823c-cf51f9d4985f" status: 200 len: 1574 microversion: 2.1 time: 0.161377 Oct 31 12:37:51.573541 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 339/689] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:37:51 2022] GET /compute/v2.1/servers/b8c93a18-ee0e-438e-823c-cf51f9d4985f => generated 1574 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:37:51.815443 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-fed851fb-3005-4f59-bdce-b924c34f9699 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:37:51.816046 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-fed851fb-3005-4f59-bdce-b924c34f9699 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] [instance: 96065a23-4a5f-4ffb-8b48-746d2dc2c301] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:37:51.822450 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-fed851fb-3005-4f59-bdce-b924c34f9699 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:37:51.822916 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-fed851fb-3005-4f59-bdce-b924c34f9699 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:37:51.823366 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-fed851fb-3005-4f59-bdce-b924c34f9699 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:37:51.824041 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-fed851fb-3005-4f59-bdce-b924c34f9699 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:37:51.824488 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-fed851fb-3005-4f59-bdce-b924c34f9699 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:37:51.824920 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-fed851fb-3005-4f59-bdce-b924c34f9699 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:37:51.890861 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-fed851fb-3005-4f59-bdce-b924c34f9699 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c1beb321e44908ab987b17f7b74484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a2bf9a5a484523a700e4e6c568d4de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:37:51.898673 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-fed851fb-3005-4f59-bdce-b924c34f9699 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] 10.222.0.15 "GET /compute/v2.1/servers/96065a23-4a5f-4ffb-8b48-746d2dc2c301" status: 200 len: 1290 microversion: 2.1 time: 0.087117 Oct 31 12:37:51.899256 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 351/690] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:37:51 2022] GET /compute/v2.1/servers/96065a23-4a5f-4ffb-8b48-746d2dc2c301 => generated 1290 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:37:52.596664 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-89957c3e-2848-4d27-9634-58ae27a19d8d tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:37:52.597359 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-89957c3e-2848-4d27-9634-58ae27a19d8d tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] [instance: b8c93a18-ee0e-438e-823c-cf51f9d4985f] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:37:52.604175 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-89957c3e-2848-4d27-9634-58ae27a19d8d tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:37:52.604656 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-89957c3e-2848-4d27-9634-58ae27a19d8d tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:37:52.605077 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-89957c3e-2848-4d27-9634-58ae27a19d8d tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:37:52.605795 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-89957c3e-2848-4d27-9634-58ae27a19d8d tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:37:52.606209 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-89957c3e-2848-4d27-9634-58ae27a19d8d tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:37:52.606652 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-89957c3e-2848-4d27-9634-58ae27a19d8d tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:37:52.756432 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-89957c3e-2848-4d27-9634-58ae27a19d8d tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825059319a204b6da5bc7004b3a09361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14b98f006574deabc030c2e93c680c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:37:52.765157 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-89957c3e-2848-4d27-9634-58ae27a19d8d tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] 10.222.0.15 "GET /compute/v2.1/servers/b8c93a18-ee0e-438e-823c-cf51f9d4985f" status: 200 len: 1574 microversion: 2.1 time: 0.172241 Oct 31 12:37:52.765744 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 340/691] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:37:52 2022] GET /compute/v2.1/servers/b8c93a18-ee0e-438e-823c-cf51f9d4985f => generated 1574 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:37:52.922019 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-7fe88198-98eb-4073-8f21-ce33916800cf tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:37:52.922825 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-7fe88198-98eb-4073-8f21-ce33916800cf tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] [instance: 96065a23-4a5f-4ffb-8b48-746d2dc2c301] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:37:52.930384 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-7fe88198-98eb-4073-8f21-ce33916800cf tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:37:52.930952 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-7fe88198-98eb-4073-8f21-ce33916800cf tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:37:52.931998 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-7fe88198-98eb-4073-8f21-ce33916800cf tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:37:52.932815 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-7fe88198-98eb-4073-8f21-ce33916800cf tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:37:52.933332 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-7fe88198-98eb-4073-8f21-ce33916800cf tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:37:52.933815 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-7fe88198-98eb-4073-8f21-ce33916800cf tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:37:53.143324 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-7fe88198-98eb-4073-8f21-ce33916800cf tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c1beb321e44908ab987b17f7b74484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a2bf9a5a484523a700e4e6c568d4de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:37:53.152297 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-7fe88198-98eb-4073-8f21-ce33916800cf tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] 10.222.0.15 "GET /compute/v2.1/servers/96065a23-4a5f-4ffb-8b48-746d2dc2c301" status: 200 len: 1364 microversion: 2.1 time: 0.234125 Oct 31 12:37:53.153236 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 352/692] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:37:52 2022] GET /compute/v2.1/servers/96065a23-4a5f-4ffb-8b48-746d2dc2c301 => generated 1364 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:37:53.387385 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-f72442e0-2812-478b-bfa0-68725c8f5cf4 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:37:53.387877 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-f72442e0-2812-478b-bfa0-68725c8f5cf4 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] [instance: ee260508-cdfb-468d-9ff4-df06cc3bdadf] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:37:53.394117 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-f72442e0-2812-478b-bfa0-68725c8f5cf4 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:37:53.394858 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-f72442e0-2812-478b-bfa0-68725c8f5cf4 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:37:53.395320 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-f72442e0-2812-478b-bfa0-68725c8f5cf4 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:37:53.396013 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-f72442e0-2812-478b-bfa0-68725c8f5cf4 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:37:53.396465 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-f72442e0-2812-478b-bfa0-68725c8f5cf4 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:37:53.396896 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-f72442e0-2812-478b-bfa0-68725c8f5cf4 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:37:53.425624 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [req-db508837-4e8b-469b-b325-9b5608c09acf req-238fb9be-f3e3-439d-89ab-0c9d8cc8108f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96065a23-4a5f-4ffb-8b48-746d2dc2c301", "tag": "7b6ab379-5ce7-4b17-b091-dac7cbe3cfd0"}]} {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 12:37:53.441777 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [req-db508837-4e8b-469b-b325-9b5608c09acf req-238fb9be-f3e3-439d-89ab-0c9d8cc8108f service nova] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:37:53.442353 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [req-db508837-4e8b-469b-b325-9b5608c09acf req-238fb9be-f3e3-439d-89ab-0c9d8cc8108f service nova] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:37:53.443449 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [req-db508837-4e8b-469b-b325-9b5608c09acf req-238fb9be-f3e3-439d-89ab-0c9d8cc8108f service nova] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:37:53.460144 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.compute.server_external_events [req-db508837-4e8b-469b-b325-9b5608c09acf req-238fb9be-f3e3-439d-89ab-0c9d8cc8108f service nova] Creating event network-changed:7b6ab379-5ce7-4b17-b091-dac7cbe3cfd0 for instance 96065a23-4a5f-4ffb-8b48-746d2dc2c301 on hv-cinder-79617 Oct 31 12:37:53.465994 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [req-db508837-4e8b-469b-b325-9b5608c09acf req-238fb9be-f3e3-439d-89ab-0c9d8cc8108f service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044041 Oct 31 12:37:53.466527 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 353/693] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Oct 31 12:37:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 12:37:53.486115 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.objects.instance [None req-f72442e0-2812-478b-bfa0-68725c8f5cf4 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lazy-loading 'services' on Instance uuid ee260508-cdfb-468d-9ff4-df06cc3bdadf {{(pid=125441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 12:37:53.596268 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-f72442e0-2812-478b-bfa0-68725c8f5cf4 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] 10.222.0.15 "DELETE /compute/v2.1/servers/ee260508-cdfb-468d-9ff4-df06cc3bdadf/os-volume_attachments/88e52680-9a7e-4b34-8457-f009b875caee" status: 202 len: 0 microversion: 2.1 time: 0.212669 Oct 31 12:37:53.596857 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 341/694] 10.222.0.15 () {58 vars in 1416 bytes} [Mon Oct 31 12:37:53 2022] DELETE /compute/v2.1/servers/ee260508-cdfb-468d-9ff4-df06cc3bdadf/os-volume_attachments/88e52680-9a7e-4b34-8457-f009b875caee => generated 0 bytes in 214 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 12:37:53.605749 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-2ade3bbb-90b9-4eb9-9283-2f8d93c162dd tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:37:53.607980 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-2ade3bbb-90b9-4eb9-9283-2f8d93c162dd tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] [instance: ee260508-cdfb-468d-9ff4-df06cc3bdadf] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:37:53.614010 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-2ade3bbb-90b9-4eb9-9283-2f8d93c162dd tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:37:53.614483 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-2ade3bbb-90b9-4eb9-9283-2f8d93c162dd tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:37:53.614904 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-2ade3bbb-90b9-4eb9-9283-2f8d93c162dd tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:37:53.615617 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-2ade3bbb-90b9-4eb9-9283-2f8d93c162dd tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:37:53.616060 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-2ade3bbb-90b9-4eb9-9283-2f8d93c162dd tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:37:53.616474 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-2ade3bbb-90b9-4eb9-9283-2f8d93c162dd tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:37:53.645914 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-2ade3bbb-90b9-4eb9-9283-2f8d93c162dd tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] 10.222.0.15 "GET /compute/v2.1/servers/ee260508-cdfb-468d-9ff4-df06cc3bdadf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044517 Oct 31 12:37:53.646457 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 354/695] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Oct 31 12:37:53 2022] GET /compute/v2.1/servers/ee260508-cdfb-468d-9ff4-df06cc3bdadf/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 12:37:53.790290 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-835c3d52-bb5d-44e4-93c0-7879f0d1310a tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:37:53.791157 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-835c3d52-bb5d-44e4-93c0-7879f0d1310a tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] [instance: b8c93a18-ee0e-438e-823c-cf51f9d4985f] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:37:53.797325 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-835c3d52-bb5d-44e4-93c0-7879f0d1310a tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:37:53.797799 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-835c3d52-bb5d-44e4-93c0-7879f0d1310a tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:37:53.798225 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-835c3d52-bb5d-44e4-93c0-7879f0d1310a tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:37:53.798894 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-835c3d52-bb5d-44e4-93c0-7879f0d1310a tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:37:53.799366 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-835c3d52-bb5d-44e4-93c0-7879f0d1310a tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:37:53.799777 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-835c3d52-bb5d-44e4-93c0-7879f0d1310a tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:37:53.814609 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG dbcounter [-] [125441] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=125441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:37:53.931992 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-835c3d52-bb5d-44e4-93c0-7879f0d1310a tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825059319a204b6da5bc7004b3a09361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14b98f006574deabc030c2e93c680c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:37:53.939598 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-835c3d52-bb5d-44e4-93c0-7879f0d1310a tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] 10.222.0.15 "GET /compute/v2.1/servers/b8c93a18-ee0e-438e-823c-cf51f9d4985f" status: 200 len: 1574 microversion: 2.1 time: 0.153955 Oct 31 12:37:53.940161 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 342/696] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:37:53 2022] GET /compute/v2.1/servers/b8c93a18-ee0e-438e-823c-cf51f9d4985f => generated 1574 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:37:54.176231 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-89e7da58-86f4-4595-9620-8bb28d8b5e90 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:37:54.176857 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-89e7da58-86f4-4595-9620-8bb28d8b5e90 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] [instance: 96065a23-4a5f-4ffb-8b48-746d2dc2c301] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:37:54.183994 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-89e7da58-86f4-4595-9620-8bb28d8b5e90 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:37:54.184541 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-89e7da58-86f4-4595-9620-8bb28d8b5e90 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:37:54.184968 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-89e7da58-86f4-4595-9620-8bb28d8b5e90 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:37:54.185686 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-89e7da58-86f4-4595-9620-8bb28d8b5e90 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:37:54.186133 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-89e7da58-86f4-4595-9620-8bb28d8b5e90 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:37:54.186549 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-89e7da58-86f4-4595-9620-8bb28d8b5e90 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:37:54.319042 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-89e7da58-86f4-4595-9620-8bb28d8b5e90 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c1beb321e44908ab987b17f7b74484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a2bf9a5a484523a700e4e6c568d4de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:37:54.323404 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG dbcounter [-] [125440] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:37:54.328144 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-89e7da58-86f4-4595-9620-8bb28d8b5e90 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] 10.222.0.15 "GET /compute/v2.1/servers/96065a23-4a5f-4ffb-8b48-746d2dc2c301" status: 200 len: 1364 microversion: 2.1 time: 0.155859 Oct 31 12:37:54.328708 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 355/697] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:37:54 2022] GET /compute/v2.1/servers/96065a23-4a5f-4ffb-8b48-746d2dc2c301 => generated 1364 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:37:54.658574 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-170d4e5a-bae8-4fd5-974c-665b47fb4af1 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:37:54.660994 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-170d4e5a-bae8-4fd5-974c-665b47fb4af1 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] [instance: ee260508-cdfb-468d-9ff4-df06cc3bdadf] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:37:54.668070 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-170d4e5a-bae8-4fd5-974c-665b47fb4af1 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:37:54.668560 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-170d4e5a-bae8-4fd5-974c-665b47fb4af1 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:37:54.669015 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-170d4e5a-bae8-4fd5-974c-665b47fb4af1 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:37:54.669695 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-170d4e5a-bae8-4fd5-974c-665b47fb4af1 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:37:54.670208 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-170d4e5a-bae8-4fd5-974c-665b47fb4af1 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:37:54.670670 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-170d4e5a-bae8-4fd5-974c-665b47fb4af1 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:37:54.702674 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-170d4e5a-bae8-4fd5-974c-665b47fb4af1 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] 10.222.0.15 "GET /compute/v2.1/servers/ee260508-cdfb-468d-9ff4-df06cc3bdadf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048327 Oct 31 12:37:54.703369 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 343/698] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Oct 31 12:37:54 2022] GET /compute/v2.1/servers/ee260508-cdfb-468d-9ff4-df06cc3bdadf/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 12:37:54.962308 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-516f1818-bcad-48eb-9f6d-c85d48f664b4 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:37:54.963134 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-516f1818-bcad-48eb-9f6d-c85d48f664b4 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] [instance: b8c93a18-ee0e-438e-823c-cf51f9d4985f] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:37:54.970168 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-516f1818-bcad-48eb-9f6d-c85d48f664b4 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:37:54.970640 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-516f1818-bcad-48eb-9f6d-c85d48f664b4 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:37:54.971061 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-516f1818-bcad-48eb-9f6d-c85d48f664b4 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:37:54.971764 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-516f1818-bcad-48eb-9f6d-c85d48f664b4 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:37:54.972215 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-516f1818-bcad-48eb-9f6d-c85d48f664b4 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:37:54.972624 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-516f1818-bcad-48eb-9f6d-c85d48f664b4 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:37:55.162705 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-516f1818-bcad-48eb-9f6d-c85d48f664b4 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825059319a204b6da5bc7004b3a09361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14b98f006574deabc030c2e93c680c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:37:55.170861 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-516f1818-bcad-48eb-9f6d-c85d48f664b4 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] 10.222.0.15 "GET /compute/v2.1/servers/b8c93a18-ee0e-438e-823c-cf51f9d4985f" status: 200 len: 1574 microversion: 2.1 time: 0.212350 Oct 31 12:37:55.171448 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 356/699] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:37:54 2022] GET /compute/v2.1/servers/b8c93a18-ee0e-438e-823c-cf51f9d4985f => generated 1574 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:37:55.400783 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-3c604dfc-a8b3-451e-ad8f-1ca7e50c3146 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:37:55.401391 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-3c604dfc-a8b3-451e-ad8f-1ca7e50c3146 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] [instance: 96065a23-4a5f-4ffb-8b48-746d2dc2c301] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:37:55.407351 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-3c604dfc-a8b3-451e-ad8f-1ca7e50c3146 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:37:55.407850 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-3c604dfc-a8b3-451e-ad8f-1ca7e50c3146 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:37:55.408280 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-3c604dfc-a8b3-451e-ad8f-1ca7e50c3146 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:37:55.408992 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-3c604dfc-a8b3-451e-ad8f-1ca7e50c3146 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:37:55.409442 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-3c604dfc-a8b3-451e-ad8f-1ca7e50c3146 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:37:55.409861 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-3c604dfc-a8b3-451e-ad8f-1ca7e50c3146 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:37:55.545006 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-3c604dfc-a8b3-451e-ad8f-1ca7e50c3146 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c1beb321e44908ab987b17f7b74484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a2bf9a5a484523a700e4e6c568d4de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:37:55.552501 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-3c604dfc-a8b3-451e-ad8f-1ca7e50c3146 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] 10.222.0.15 "GET /compute/v2.1/servers/96065a23-4a5f-4ffb-8b48-746d2dc2c301" status: 200 len: 1364 microversion: 2.1 time: 0.205403 Oct 31 12:37:55.553062 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 344/700] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:37:55 2022] GET /compute/v2.1/servers/96065a23-4a5f-4ffb-8b48-746d2dc2c301 => generated 1364 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:37:55.716372 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-c4ae9c28-c63b-4251-86e3-bea9cde2a8eb tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:37:55.718561 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-c4ae9c28-c63b-4251-86e3-bea9cde2a8eb tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] [instance: ee260508-cdfb-468d-9ff4-df06cc3bdadf] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:37:55.720820 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG dbcounter [-] [125440] Writing DB stats nova_api:SELECT=86,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=125440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:37:55.726190 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-c4ae9c28-c63b-4251-86e3-bea9cde2a8eb tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:37:55.726663 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-c4ae9c28-c63b-4251-86e3-bea9cde2a8eb tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:37:55.727109 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-c4ae9c28-c63b-4251-86e3-bea9cde2a8eb tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:37:55.727804 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-c4ae9c28-c63b-4251-86e3-bea9cde2a8eb tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:37:55.728248 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-c4ae9c28-c63b-4251-86e3-bea9cde2a8eb tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:37:55.728776 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-c4ae9c28-c63b-4251-86e3-bea9cde2a8eb tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:37:55.758761 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-c4ae9c28-c63b-4251-86e3-bea9cde2a8eb tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] 10.222.0.15 "GET /compute/v2.1/servers/ee260508-cdfb-468d-9ff4-df06cc3bdadf/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047061 Oct 31 12:37:55.759379 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 357/701] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Oct 31 12:37:55 2022] GET /compute/v2.1/servers/ee260508-cdfb-468d-9ff4-df06cc3bdadf/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 12:37:55.842086 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-53b19e3b-df42-475d-9366-6fd8e023548f tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:37:55.842656 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-53b19e3b-df42-475d-9366-6fd8e023548f tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] [instance: ee260508-cdfb-468d-9ff4-df06cc3bdadf] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:37:55.848494 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-53b19e3b-df42-475d-9366-6fd8e023548f tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:37:55.848973 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-53b19e3b-df42-475d-9366-6fd8e023548f tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:37:55.849406 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-53b19e3b-df42-475d-9366-6fd8e023548f tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:37:55.850085 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-53b19e3b-df42-475d-9366-6fd8e023548f tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:37:55.850535 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-53b19e3b-df42-475d-9366-6fd8e023548f tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:37:55.850953 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-53b19e3b-df42-475d-9366-6fd8e023548f tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:37:55.877374 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-53b19e3b-df42-475d-9366-6fd8e023548f tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] [instance: ee260508-cdfb-468d-9ff4-df06cc3bdadf] Going to try to terminate instance {{(pid=125441) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 12:37:55.954614 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-53b19e3b-df42-475d-9366-6fd8e023548f tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] 10.222.0.15 "DELETE /compute/v2.1/servers/ee260508-cdfb-468d-9ff4-df06cc3bdadf" status: 204 len: 0 microversion: 2.1 time: 0.116121 Oct 31 12:37:55.955531 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 345/702] 10.222.0.15 () {58 vars in 1239 bytes} [Mon Oct 31 12:37:55 2022] DELETE /compute/v2.1/servers/ee260508-cdfb-468d-9ff4-df06cc3bdadf => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 12:37:55.963712 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-56ed5c03-b472-4451-9eae-22dd002dbcba tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:37:55.964391 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-56ed5c03-b472-4451-9eae-22dd002dbcba tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] [instance: ee260508-cdfb-468d-9ff4-df06cc3bdadf] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:37:55.970535 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-56ed5c03-b472-4451-9eae-22dd002dbcba tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:37:55.971022 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-56ed5c03-b472-4451-9eae-22dd002dbcba tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:37:55.971540 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-56ed5c03-b472-4451-9eae-22dd002dbcba tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:37:55.972383 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-56ed5c03-b472-4451-9eae-22dd002dbcba tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:37:55.972871 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-56ed5c03-b472-4451-9eae-22dd002dbcba tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:37:55.973351 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-56ed5c03-b472-4451-9eae-22dd002dbcba tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:37:56.111134 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-56ed5c03-b472-4451-9eae-22dd002dbcba tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2e978bcb824a5e9d593b861c9e3bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7573cb9c503243ab90b1649591d550e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:37:56.128313 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-56ed5c03-b472-4451-9eae-22dd002dbcba tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] 10.222.0.15 "GET /compute/v2.1/servers/ee260508-cdfb-468d-9ff4-df06cc3bdadf" status: 200 len: 1691 microversion: 2.1 time: 0.168335 Oct 31 12:37:56.129070 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 358/703] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:37:55 2022] GET /compute/v2.1/servers/ee260508-cdfb-468d-9ff4-df06cc3bdadf => generated 1691 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 12:37:56.194390 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-c54ae729-0dc8-4848-a389-acb34134067d tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:37:56.195083 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-c54ae729-0dc8-4848-a389-acb34134067d tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] [instance: b8c93a18-ee0e-438e-823c-cf51f9d4985f] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:37:56.201799 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-c54ae729-0dc8-4848-a389-acb34134067d tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:37:56.202273 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-c54ae729-0dc8-4848-a389-acb34134067d tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:37:56.202699 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-c54ae729-0dc8-4848-a389-acb34134067d tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:37:56.203411 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-c54ae729-0dc8-4848-a389-acb34134067d tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:37:56.203865 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-c54ae729-0dc8-4848-a389-acb34134067d tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:37:56.204358 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-c54ae729-0dc8-4848-a389-acb34134067d tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:37:56.336269 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-c54ae729-0dc8-4848-a389-acb34134067d tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825059319a204b6da5bc7004b3a09361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14b98f006574deabc030c2e93c680c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:37:56.344768 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-c54ae729-0dc8-4848-a389-acb34134067d tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] 10.222.0.15 "GET /compute/v2.1/servers/b8c93a18-ee0e-438e-823c-cf51f9d4985f" status: 200 len: 1574 microversion: 2.1 time: 0.154635 Oct 31 12:37:56.345334 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 346/704] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:37:56 2022] GET /compute/v2.1/servers/b8c93a18-ee0e-438e-823c-cf51f9d4985f => generated 1574 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:37:56.575706 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-dac1ab26-6f3a-4385-83c7-93c250a278d4 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:37:56.576226 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-dac1ab26-6f3a-4385-83c7-93c250a278d4 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] [instance: 96065a23-4a5f-4ffb-8b48-746d2dc2c301] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:37:56.582141 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-dac1ab26-6f3a-4385-83c7-93c250a278d4 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:37:56.582621 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-dac1ab26-6f3a-4385-83c7-93c250a278d4 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:37:56.583057 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-dac1ab26-6f3a-4385-83c7-93c250a278d4 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:37:56.583771 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-dac1ab26-6f3a-4385-83c7-93c250a278d4 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:37:56.584232 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-dac1ab26-6f3a-4385-83c7-93c250a278d4 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:37:56.584653 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-dac1ab26-6f3a-4385-83c7-93c250a278d4 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:37:56.713886 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-dac1ab26-6f3a-4385-83c7-93c250a278d4 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c1beb321e44908ab987b17f7b74484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a2bf9a5a484523a700e4e6c568d4de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:37:56.721403 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-dac1ab26-6f3a-4385-83c7-93c250a278d4 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] 10.222.0.15 "GET /compute/v2.1/servers/96065a23-4a5f-4ffb-8b48-746d2dc2c301" status: 200 len: 1364 microversion: 2.1 time: 0.150311 Oct 31 12:37:56.722047 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 359/705] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:37:56 2022] GET /compute/v2.1/servers/96065a23-4a5f-4ffb-8b48-746d2dc2c301 => generated 1364 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:37:57.135018 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-acc73de7-b7b4-4df9-bf77-4251e020ac4d tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:37:57.135550 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-acc73de7-b7b4-4df9-bf77-4251e020ac4d tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] [instance: 46cae3a9-45e8-401c-b201-2ed4402e9e97] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:37:57.141583 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-acc73de7-b7b4-4df9-bf77-4251e020ac4d tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:37:57.142112 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-acc73de7-b7b4-4df9-bf77-4251e020ac4d tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:37:57.142539 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-acc73de7-b7b4-4df9-bf77-4251e020ac4d tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:37:57.143247 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-acc73de7-b7b4-4df9-bf77-4251e020ac4d tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:37:57.143696 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-acc73de7-b7b4-4df9-bf77-4251e020ac4d tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:37:57.144141 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-acc73de7-b7b4-4df9-bf77-4251e020ac4d tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:37:57.152310 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-56908358-935a-48e0-bc1b-d953af49cf13 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:37:57.152913 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-56908358-935a-48e0-bc1b-d953af49cf13 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] [instance: ee260508-cdfb-468d-9ff4-df06cc3bdadf] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:37:57.159221 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-56908358-935a-48e0-bc1b-d953af49cf13 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:37:57.159706 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-56908358-935a-48e0-bc1b-d953af49cf13 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:37:57.160136 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-56908358-935a-48e0-bc1b-d953af49cf13 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:37:57.160823 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-56908358-935a-48e0-bc1b-d953af49cf13 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:37:57.161311 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-56908358-935a-48e0-bc1b-d953af49cf13 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:37:57.161757 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-56908358-935a-48e0-bc1b-d953af49cf13 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:37:57.168169 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-acc73de7-b7b4-4df9-bf77-4251e020ac4d tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] 10.222.0.15 "GET /compute/v2.1/servers/46cae3a9-45e8-401c-b201-2ed4402e9e97/ips" status: 200 len: 151 microversion: 2.1 time: 0.087508 Oct 31 12:37:57.168735 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 347/706] 10.222.0.15 () {58 vars in 1248 bytes} [Mon Oct 31 12:37:57 2022] GET /compute/v2.1/servers/46cae3a9-45e8-401c-b201-2ed4402e9e97/ips => generated 151 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 12:37:57.301970 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-56908358-935a-48e0-bc1b-d953af49cf13 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2e978bcb824a5e9d593b861c9e3bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7573cb9c503243ab90b1649591d550e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:37:57.309745 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-56908358-935a-48e0-bc1b-d953af49cf13 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] 10.222.0.15 "GET /compute/v2.1/servers/ee260508-cdfb-468d-9ff4-df06cc3bdadf" status: 200 len: 1691 microversion: 2.1 time: 0.161305 Oct 31 12:37:57.310321 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 360/707] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:37:57 2022] GET /compute/v2.1/servers/ee260508-cdfb-468d-9ff4-df06cc3bdadf => generated 1691 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 12:37:57.369355 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-1973938f-c558-4ce1-a2c9-60fa9d4105a9 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:37:57.369957 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-1973938f-c558-4ce1-a2c9-60fa9d4105a9 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] [instance: b8c93a18-ee0e-438e-823c-cf51f9d4985f] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:37:57.385616 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-1973938f-c558-4ce1-a2c9-60fa9d4105a9 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:37:57.385616 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-1973938f-c558-4ce1-a2c9-60fa9d4105a9 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:37:57.385616 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-1973938f-c558-4ce1-a2c9-60fa9d4105a9 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:37:57.385616 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-1973938f-c558-4ce1-a2c9-60fa9d4105a9 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:37:57.386074 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-1973938f-c558-4ce1-a2c9-60fa9d4105a9 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:37:57.386074 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-1973938f-c558-4ce1-a2c9-60fa9d4105a9 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:37:57.517915 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-1973938f-c558-4ce1-a2c9-60fa9d4105a9 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825059319a204b6da5bc7004b3a09361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14b98f006574deabc030c2e93c680c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:37:57.526003 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-1973938f-c558-4ce1-a2c9-60fa9d4105a9 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] 10.222.0.15 "GET /compute/v2.1/servers/b8c93a18-ee0e-438e-823c-cf51f9d4985f" status: 200 len: 1574 microversion: 2.1 time: 0.160977 Oct 31 12:37:57.526585 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 348/708] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:37:57 2022] GET /compute/v2.1/servers/b8c93a18-ee0e-438e-823c-cf51f9d4985f => generated 1574 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:37:57.744095 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-92bf3a45-9c98-49af-be6c-90fa9e8b0e53 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:37:57.744700 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-92bf3a45-9c98-49af-be6c-90fa9e8b0e53 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] [instance: 96065a23-4a5f-4ffb-8b48-746d2dc2c301] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:37:57.750485 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-92bf3a45-9c98-49af-be6c-90fa9e8b0e53 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:37:57.750955 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-92bf3a45-9c98-49af-be6c-90fa9e8b0e53 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:37:57.751418 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-92bf3a45-9c98-49af-be6c-90fa9e8b0e53 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:37:57.752098 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-92bf3a45-9c98-49af-be6c-90fa9e8b0e53 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:37:57.752701 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-92bf3a45-9c98-49af-be6c-90fa9e8b0e53 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:37:57.753089 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-92bf3a45-9c98-49af-be6c-90fa9e8b0e53 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:37:57.882323 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-92bf3a45-9c98-49af-be6c-90fa9e8b0e53 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c1beb321e44908ab987b17f7b74484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a2bf9a5a484523a700e4e6c568d4de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:37:57.889949 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-92bf3a45-9c98-49af-be6c-90fa9e8b0e53 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] 10.222.0.15 "GET /compute/v2.1/servers/96065a23-4a5f-4ffb-8b48-746d2dc2c301" status: 200 len: 1364 microversion: 2.1 time: 0.150081 Oct 31 12:37:57.890519 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 361/709] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:37:57 2022] GET /compute/v2.1/servers/96065a23-4a5f-4ffb-8b48-746d2dc2c301 => generated 1364 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:37:58.172894 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [req-f3d535c3-04f7-44e2-b91a-6f7c21a6b126 req-e8784a9a-b7c5-41a0-b3fa-e44c4ec0891e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8c93a18-ee0e-438e-823c-cf51f9d4985f", "name": "network-vif-plugged", "status": "completed", "tag": "c444a742-6430-4bab-91f7-bff045443454"}]} {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 12:37:58.183539 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [req-f3d535c3-04f7-44e2-b91a-6f7c21a6b126 req-e8784a9a-b7c5-41a0-b3fa-e44c4ec0891e service nova] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:37:58.184011 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [req-f3d535c3-04f7-44e2-b91a-6f7c21a6b126 req-e8784a9a-b7c5-41a0-b3fa-e44c4ec0891e service nova] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:37:58.184430 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [req-f3d535c3-04f7-44e2-b91a-6f7c21a6b126 req-e8784a9a-b7c5-41a0-b3fa-e44c4ec0891e service nova] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:37:58.198873 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.compute.server_external_events [req-f3d535c3-04f7-44e2-b91a-6f7c21a6b126 req-e8784a9a-b7c5-41a0-b3fa-e44c4ec0891e service nova] Creating event network-vif-plugged:c444a742-6430-4bab-91f7-bff045443454 for instance b8c93a18-ee0e-438e-823c-cf51f9d4985f on hv-cinder-79617 Oct 31 12:37:58.203778 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [req-f3d535c3-04f7-44e2-b91a-6f7c21a6b126 req-e8784a9a-b7c5-41a0-b3fa-e44c4ec0891e service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034501 Oct 31 12:37:58.204377 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 349/710] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Oct 31 12:37:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 12:37:58.334445 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-daf65421-589e-4ffd-b922-be09ab18015f tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:37:58.335051 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-daf65421-589e-4ffd-b922-be09ab18015f tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] [instance: ee260508-cdfb-468d-9ff4-df06cc3bdadf] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:37:58.341708 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-daf65421-589e-4ffd-b922-be09ab18015f tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:37:58.342221 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-daf65421-589e-4ffd-b922-be09ab18015f tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:37:58.342656 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-daf65421-589e-4ffd-b922-be09ab18015f tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:37:58.343377 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-daf65421-589e-4ffd-b922-be09ab18015f tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:37:58.343827 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-daf65421-589e-4ffd-b922-be09ab18015f tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:37:58.344247 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-daf65421-589e-4ffd-b922-be09ab18015f tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:37:58.474204 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-daf65421-589e-4ffd-b922-be09ab18015f tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2e978bcb824a5e9d593b861c9e3bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7573cb9c503243ab90b1649591d550e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:37:58.482740 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-daf65421-589e-4ffd-b922-be09ab18015f tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] 10.222.0.15 "GET /compute/v2.1/servers/ee260508-cdfb-468d-9ff4-df06cc3bdadf" status: 200 len: 1691 microversion: 2.1 time: 0.152553 Oct 31 12:37:58.483379 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 362/711] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:37:58 2022] GET /compute/v2.1/servers/ee260508-cdfb-468d-9ff4-df06cc3bdadf => generated 1691 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:37:58.513487 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-dceef763-d975-442f-aced-2fc1fd67a2c9 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2cb9ef24-33be-4618-9a70-5422e7dd58fb"}} {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 12:37:58.515960 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-dceef763-d975-442f-aced-2fc1fd67a2c9 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] [instance: 46cae3a9-45e8-401c-b201-2ed4402e9e97] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:37:58.522311 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-dceef763-d975-442f-aced-2fc1fd67a2c9 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:37:58.522795 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-dceef763-d975-442f-aced-2fc1fd67a2c9 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:37:58.523261 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-dceef763-d975-442f-aced-2fc1fd67a2c9 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:37:58.523977 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-dceef763-d975-442f-aced-2fc1fd67a2c9 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:37:58.524429 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-dceef763-d975-442f-aced-2fc1fd67a2c9 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:37:58.525041 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-dceef763-d975-442f-aced-2fc1fd67a2c9 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:37:58.549930 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-41db85eb-6a57-4486-9595-561cd27dbd7c tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:37:58.550608 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-41db85eb-6a57-4486-9595-561cd27dbd7c tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] [instance: b8c93a18-ee0e-438e-823c-cf51f9d4985f] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:37:58.557600 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-41db85eb-6a57-4486-9595-561cd27dbd7c tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:37:58.558396 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-41db85eb-6a57-4486-9595-561cd27dbd7c tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:37:58.558894 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-41db85eb-6a57-4486-9595-561cd27dbd7c tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:37:58.559685 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-41db85eb-6a57-4486-9595-561cd27dbd7c tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:37:58.560226 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-41db85eb-6a57-4486-9595-561cd27dbd7c tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:37:58.560786 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-41db85eb-6a57-4486-9595-561cd27dbd7c tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:37:58.697986 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-41db85eb-6a57-4486-9595-561cd27dbd7c tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825059319a204b6da5bc7004b3a09361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14b98f006574deabc030c2e93c680c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:37:58.705608 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-41db85eb-6a57-4486-9595-561cd27dbd7c tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] 10.222.0.15 "GET /compute/v2.1/servers/b8c93a18-ee0e-438e-823c-cf51f9d4985f" status: 200 len: 1574 microversion: 2.1 time: 0.159670 Oct 31 12:37:58.706179 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 363/712] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:37:58 2022] GET /compute/v2.1/servers/b8c93a18-ee0e-438e-823c-cf51f9d4985f => generated 1574 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 12:37:58.912623 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-b7774a51-3fe9-4ff2-b23b-dc35a1cf8005 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:37:58.913239 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-b7774a51-3fe9-4ff2-b23b-dc35a1cf8005 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] [instance: 96065a23-4a5f-4ffb-8b48-746d2dc2c301] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:37:58.919741 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-b7774a51-3fe9-4ff2-b23b-dc35a1cf8005 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:37:58.920220 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-b7774a51-3fe9-4ff2-b23b-dc35a1cf8005 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:37:58.920652 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-b7774a51-3fe9-4ff2-b23b-dc35a1cf8005 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:37:58.921338 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-b7774a51-3fe9-4ff2-b23b-dc35a1cf8005 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:37:58.921793 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-b7774a51-3fe9-4ff2-b23b-dc35a1cf8005 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:37:58.922209 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-b7774a51-3fe9-4ff2-b23b-dc35a1cf8005 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:37:59.048799 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-b7774a51-3fe9-4ff2-b23b-dc35a1cf8005 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c1beb321e44908ab987b17f7b74484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a2bf9a5a484523a700e4e6c568d4de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:37:59.057034 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-b7774a51-3fe9-4ff2-b23b-dc35a1cf8005 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] 10.222.0.15 "GET /compute/v2.1/servers/96065a23-4a5f-4ffb-8b48-746d2dc2c301" status: 200 len: 1364 microversion: 2.1 time: 0.148080 Oct 31 12:37:59.057607 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 364/713] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:37:58 2022] GET /compute/v2.1/servers/96065a23-4a5f-4ffb-8b48-746d2dc2c301 => generated 1364 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 12:37:59.506340 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-14cf0b74-9953-4911-a2c3-f276a233cc36 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:37:59.506965 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-14cf0b74-9953-4911-a2c3-f276a233cc36 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] [instance: ee260508-cdfb-468d-9ff4-df06cc3bdadf] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:37:59.513268 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-14cf0b74-9953-4911-a2c3-f276a233cc36 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:37:59.513739 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-14cf0b74-9953-4911-a2c3-f276a233cc36 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:37:59.514163 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-14cf0b74-9953-4911-a2c3-f276a233cc36 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:37:59.514834 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-14cf0b74-9953-4911-a2c3-f276a233cc36 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:37:59.515316 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-14cf0b74-9953-4911-a2c3-f276a233cc36 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:37:59.515726 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-14cf0b74-9953-4911-a2c3-f276a233cc36 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:37:59.653269 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-14cf0b74-9953-4911-a2c3-f276a233cc36 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2e978bcb824a5e9d593b861c9e3bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7573cb9c503243ab90b1649591d550e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:37:59.660914 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-14cf0b74-9953-4911-a2c3-f276a233cc36 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] 10.222.0.15 "GET /compute/v2.1/servers/ee260508-cdfb-468d-9ff4-df06cc3bdadf" status: 200 len: 1691 microversion: 2.1 time: 0.158499 Oct 31 12:37:59.661479 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 365/714] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:37:59 2022] GET /compute/v2.1/servers/ee260508-cdfb-468d-9ff4-df06cc3bdadf => generated 1691 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 12:37:59.729823 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-05c372ad-c426-471d-b7bf-5b81a0cdd80f tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:37:59.730336 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-05c372ad-c426-471d-b7bf-5b81a0cdd80f tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] [instance: b8c93a18-ee0e-438e-823c-cf51f9d4985f] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:37:59.736148 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-05c372ad-c426-471d-b7bf-5b81a0cdd80f tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:37:59.736618 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-05c372ad-c426-471d-b7bf-5b81a0cdd80f tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:37:59.737040 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-05c372ad-c426-471d-b7bf-5b81a0cdd80f tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:37:59.737712 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-05c372ad-c426-471d-b7bf-5b81a0cdd80f tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:37:59.738154 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-05c372ad-c426-471d-b7bf-5b81a0cdd80f tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:37:59.738561 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-05c372ad-c426-471d-b7bf-5b81a0cdd80f tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:37:59.916265 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-05c372ad-c426-471d-b7bf-5b81a0cdd80f tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825059319a204b6da5bc7004b3a09361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14b98f006574deabc030c2e93c680c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:37:59.927959 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-05c372ad-c426-471d-b7bf-5b81a0cdd80f tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] 10.222.0.15 "GET /compute/v2.1/servers/b8c93a18-ee0e-438e-823c-cf51f9d4985f" status: 200 len: 1574 microversion: 2.1 time: 0.202472 Oct 31 12:37:59.928850 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 366/715] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:37:59 2022] GET /compute/v2.1/servers/b8c93a18-ee0e-438e-823c-cf51f9d4985f => generated 1574 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 12:37:59.946444 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-dceef763-d975-442f-aced-2fc1fd67a2c9 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] 10.222.0.15 "POST /compute/v2.1/servers/46cae3a9-45e8-401c-b201-2ed4402e9e97/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.437068 Oct 31 12:37:59.947249 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 350/716] 10.222.0.15 () {60 vars in 1323 bytes} [Mon Oct 31 12:37:58 2022] POST /compute/v2.1/servers/46cae3a9-45e8-401c-b201-2ed4402e9e97/os-volume_attachments => generated 194 bytes in 1439 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 12:38:00.080682 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-07af5310-b2b1-43a9-b58e-0530f3b1aa22 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:38:00.081431 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-07af5310-b2b1-43a9-b58e-0530f3b1aa22 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] [instance: 96065a23-4a5f-4ffb-8b48-746d2dc2c301] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:38:00.088378 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-07af5310-b2b1-43a9-b58e-0530f3b1aa22 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:38:00.088937 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-07af5310-b2b1-43a9-b58e-0530f3b1aa22 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:38:00.089597 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-07af5310-b2b1-43a9-b58e-0530f3b1aa22 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:38:00.090480 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-07af5310-b2b1-43a9-b58e-0530f3b1aa22 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:38:00.091113 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-07af5310-b2b1-43a9-b58e-0530f3b1aa22 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:38:00.091767 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-07af5310-b2b1-43a9-b58e-0530f3b1aa22 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:38:00.231127 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [req-13cdd01f-5932-4ed5-a985-9fcf5e976ed0 req-03425775-f54a-4eb3-a1c1-b594d27cee31 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96065a23-4a5f-4ffb-8b48-746d2dc2c301", "name": "network-vif-plugged", "status": "completed", "tag": "7b6ab379-5ce7-4b17-b091-dac7cbe3cfd0"}]} {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 12:38:00.241026 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [req-13cdd01f-5932-4ed5-a985-9fcf5e976ed0 req-03425775-f54a-4eb3-a1c1-b594d27cee31 service nova] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:38:00.241427 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [req-13cdd01f-5932-4ed5-a985-9fcf5e976ed0 req-03425775-f54a-4eb3-a1c1-b594d27cee31 service nova] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:38:00.241858 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [req-13cdd01f-5932-4ed5-a985-9fcf5e976ed0 req-03425775-f54a-4eb3-a1c1-b594d27cee31 service nova] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:38:00.254317 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.compute.server_external_events [req-13cdd01f-5932-4ed5-a985-9fcf5e976ed0 req-03425775-f54a-4eb3-a1c1-b594d27cee31 service nova] Creating event network-vif-plugged:7b6ab379-5ce7-4b17-b091-dac7cbe3cfd0 for instance 96065a23-4a5f-4ffb-8b48-746d2dc2c301 on hv-cinder-79617 Oct 31 12:38:00.259933 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [req-13cdd01f-5932-4ed5-a985-9fcf5e976ed0 req-03425775-f54a-4eb3-a1c1-b594d27cee31 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033624 Oct 31 12:38:00.260573 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 351/717] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Oct 31 12:38:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 12:38:00.661225 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-07af5310-b2b1-43a9-b58e-0530f3b1aa22 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c1beb321e44908ab987b17f7b74484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a2bf9a5a484523a700e4e6c568d4de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:38:00.669443 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-07af5310-b2b1-43a9-b58e-0530f3b1aa22 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] 10.222.0.15 "GET /compute/v2.1/servers/96065a23-4a5f-4ffb-8b48-746d2dc2c301" status: 200 len: 1364 microversion: 2.1 time: 0.592799 Oct 31 12:38:00.670019 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 367/718] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:38:00 2022] GET /compute/v2.1/servers/96065a23-4a5f-4ffb-8b48-746d2dc2c301 => generated 1364 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 12:38:00.684337 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG dbcounter [-] [125441] Writing DB stats nova_cell0:SELECT=2 {{(pid=125441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:38:00.684772 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG dbcounter [-] [125441] Writing DB stats nova_cell0:SELECT=10 {{(pid=125441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:38:00.689127 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-e1cfd739-3d56-47bc-af06-6f48a2c91ecb tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:38:00.689816 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-e1cfd739-3d56-47bc-af06-6f48a2c91ecb tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] [instance: ee260508-cdfb-468d-9ff4-df06cc3bdadf] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:38:00.697947 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-e1cfd739-3d56-47bc-af06-6f48a2c91ecb tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:38:00.698370 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-e1cfd739-3d56-47bc-af06-6f48a2c91ecb tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:38:00.698792 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-e1cfd739-3d56-47bc-af06-6f48a2c91ecb tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:38:00.699505 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-e1cfd739-3d56-47bc-af06-6f48a2c91ecb tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:38:00.699956 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-e1cfd739-3d56-47bc-af06-6f48a2c91ecb tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:38:00.700369 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-e1cfd739-3d56-47bc-af06-6f48a2c91ecb tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:38:00.835725 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-e1cfd739-3d56-47bc-af06-6f48a2c91ecb tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2e978bcb824a5e9d593b861c9e3bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7573cb9c503243ab90b1649591d550e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:38:00.843716 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-e1cfd739-3d56-47bc-af06-6f48a2c91ecb tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] 10.222.0.15 "GET /compute/v2.1/servers/ee260508-cdfb-468d-9ff4-df06cc3bdadf" status: 200 len: 1691 microversion: 2.1 time: 0.161380 Oct 31 12:38:00.844398 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 352/719] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:38:00 2022] GET /compute/v2.1/servers/ee260508-cdfb-468d-9ff4-df06cc3bdadf => generated 1691 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:38:00.953144 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-6e1be314-552c-4296-8e39-2f62483ad327 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:38:00.953846 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-6e1be314-552c-4296-8e39-2f62483ad327 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] [instance: b8c93a18-ee0e-438e-823c-cf51f9d4985f] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:38:00.955749 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG dbcounter [-] [125440] Writing DB stats nova_cell0:SELECT=2 {{(pid=125440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:38:00.960855 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-6e1be314-552c-4296-8e39-2f62483ad327 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:38:00.961324 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-6e1be314-552c-4296-8e39-2f62483ad327 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:38:00.961745 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-6e1be314-552c-4296-8e39-2f62483ad327 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:38:00.963195 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-6e1be314-552c-4296-8e39-2f62483ad327 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:38:00.963645 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-6e1be314-552c-4296-8e39-2f62483ad327 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:38:00.964060 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-6e1be314-552c-4296-8e39-2f62483ad327 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:38:01.157384 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-6e1be314-552c-4296-8e39-2f62483ad327 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825059319a204b6da5bc7004b3a09361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14b98f006574deabc030c2e93c680c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:38:01.165190 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-6e1be314-552c-4296-8e39-2f62483ad327 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] 10.222.0.15 "GET /compute/v2.1/servers/b8c93a18-ee0e-438e-823c-cf51f9d4985f" status: 200 len: 1574 microversion: 2.1 time: 0.215844 Oct 31 12:38:01.166214 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 368/720] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:38:00 2022] GET /compute/v2.1/servers/b8c93a18-ee0e-438e-823c-cf51f9d4985f => generated 1574 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:38:01.526424 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [req-a8c8f6b3-f03e-47c3-9e2b-cc73923b9fcb req-517981cc-4427-4bb0-a669-2aca18372bc1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee260508-cdfb-468d-9ff4-df06cc3bdadf", "name": "network-vif-deleted", "tag": "7591dba3-56f4-4739-8b1f-33a42a9073b1"}]} {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 12:38:01.537416 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [req-a8c8f6b3-f03e-47c3-9e2b-cc73923b9fcb req-517981cc-4427-4bb0-a669-2aca18372bc1 service nova] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:38:01.538046 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [req-a8c8f6b3-f03e-47c3-9e2b-cc73923b9fcb req-517981cc-4427-4bb0-a669-2aca18372bc1 service nova] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:38:01.538696 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [req-a8c8f6b3-f03e-47c3-9e2b-cc73923b9fcb req-517981cc-4427-4bb0-a669-2aca18372bc1 service nova] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:38:01.551794 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.compute.server_external_events [req-a8c8f6b3-f03e-47c3-9e2b-cc73923b9fcb req-517981cc-4427-4bb0-a669-2aca18372bc1 service nova] Creating event network-vif-deleted:7591dba3-56f4-4739-8b1f-33a42a9073b1 for instance ee260508-cdfb-468d-9ff4-df06cc3bdadf on hv-cinder-79617 Oct 31 12:38:01.558973 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [req-a8c8f6b3-f03e-47c3-9e2b-cc73923b9fcb req-517981cc-4427-4bb0-a669-2aca18372bc1 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037100 Oct 31 12:38:01.560169 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 353/721] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Oct 31 12:38:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 12:38:01.692189 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-7de1f02f-9c67-48e5-a572-26494137830a tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:38:01.692796 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-7de1f02f-9c67-48e5-a572-26494137830a tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] [instance: 96065a23-4a5f-4ffb-8b48-746d2dc2c301] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:38:01.700551 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-7de1f02f-9c67-48e5-a572-26494137830a tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:38:01.701278 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-7de1f02f-9c67-48e5-a572-26494137830a tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:38:01.701700 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-7de1f02f-9c67-48e5-a572-26494137830a tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:38:01.702392 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-7de1f02f-9c67-48e5-a572-26494137830a tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:38:01.703007 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-7de1f02f-9c67-48e5-a572-26494137830a tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:38:01.703450 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-7de1f02f-9c67-48e5-a572-26494137830a tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:38:01.836808 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-7de1f02f-9c67-48e5-a572-26494137830a tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c1beb321e44908ab987b17f7b74484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a2bf9a5a484523a700e4e6c568d4de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:38:01.845312 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-7de1f02f-9c67-48e5-a572-26494137830a tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] 10.222.0.15 "GET /compute/v2.1/servers/96065a23-4a5f-4ffb-8b48-746d2dc2c301" status: 200 len: 1364 microversion: 2.1 time: 0.157089 Oct 31 12:38:01.845886 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 369/722] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:38:01 2022] GET /compute/v2.1/servers/96065a23-4a5f-4ffb-8b48-746d2dc2c301 => generated 1364 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:38:01.868012 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-bb0b76e0-1317-45ee-ab23-a52d2e285705 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:38:01.868654 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-bb0b76e0-1317-45ee-ab23-a52d2e285705 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] [instance: ee260508-cdfb-468d-9ff4-df06cc3bdadf] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:38:01.874770 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-bb0b76e0-1317-45ee-ab23-a52d2e285705 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:38:01.875353 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-bb0b76e0-1317-45ee-ab23-a52d2e285705 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:38:01.875786 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-bb0b76e0-1317-45ee-ab23-a52d2e285705 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:38:01.876467 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-bb0b76e0-1317-45ee-ab23-a52d2e285705 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:38:01.876911 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-bb0b76e0-1317-45ee-ab23-a52d2e285705 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:38:01.877325 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-bb0b76e0-1317-45ee-ab23-a52d2e285705 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:38:01.939766 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-bb0b76e0-1317-45ee-ab23-a52d2e285705 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2e978bcb824a5e9d593b861c9e3bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7573cb9c503243ab90b1649591d550e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:38:01.947434 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-bb0b76e0-1317-45ee-ab23-a52d2e285705 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] 10.222.0.15 "GET /compute/v2.1/servers/ee260508-cdfb-468d-9ff4-df06cc3bdadf" status: 200 len: 1331 microversion: 2.1 time: 0.083601 Oct 31 12:38:01.948037 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 354/723] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:38:01 2022] GET /compute/v2.1/servers/ee260508-cdfb-468d-9ff4-df06cc3bdadf => generated 1331 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:38:02.191026 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-2920fc7f-402c-4bd6-9220-cf8ddc228912 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:38:02.191736 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-2920fc7f-402c-4bd6-9220-cf8ddc228912 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] [instance: b8c93a18-ee0e-438e-823c-cf51f9d4985f] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:38:02.198745 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-2920fc7f-402c-4bd6-9220-cf8ddc228912 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:38:02.199583 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-2920fc7f-402c-4bd6-9220-cf8ddc228912 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:38:02.200519 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-2920fc7f-402c-4bd6-9220-cf8ddc228912 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:38:02.201547 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-2920fc7f-402c-4bd6-9220-cf8ddc228912 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:38:02.202200 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-2920fc7f-402c-4bd6-9220-cf8ddc228912 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:38:02.202814 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-2920fc7f-402c-4bd6-9220-cf8ddc228912 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:38:02.349363 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-2920fc7f-402c-4bd6-9220-cf8ddc228912 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825059319a204b6da5bc7004b3a09361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14b98f006574deabc030c2e93c680c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:38:02.357744 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-2920fc7f-402c-4bd6-9220-cf8ddc228912 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] 10.222.0.15 "GET /compute/v2.1/servers/b8c93a18-ee0e-438e-823c-cf51f9d4985f" status: 200 len: 1561 microversion: 2.1 time: 0.170680 Oct 31 12:38:02.358333 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 370/724] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:38:02 2022] GET /compute/v2.1/servers/b8c93a18-ee0e-438e-823c-cf51f9d4985f => generated 1561 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:38:02.868368 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-a733beee-6ff5-4125-b0be-517e75897d4d tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:38:02.868913 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-a733beee-6ff5-4125-b0be-517e75897d4d tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] [instance: 96065a23-4a5f-4ffb-8b48-746d2dc2c301] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:38:02.875239 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-a733beee-6ff5-4125-b0be-517e75897d4d tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:38:02.875720 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-a733beee-6ff5-4125-b0be-517e75897d4d tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:38:02.876154 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-a733beee-6ff5-4125-b0be-517e75897d4d tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:38:02.876836 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-a733beee-6ff5-4125-b0be-517e75897d4d tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:38:02.877288 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-a733beee-6ff5-4125-b0be-517e75897d4d tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:38:02.877709 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-a733beee-6ff5-4125-b0be-517e75897d4d tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:38:03.003473 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-a733beee-6ff5-4125-b0be-517e75897d4d tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c1beb321e44908ab987b17f7b74484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a2bf9a5a484523a700e4e6c568d4de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:38:03.012429 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-a733beee-6ff5-4125-b0be-517e75897d4d tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] 10.222.0.15 "GET /compute/v2.1/servers/96065a23-4a5f-4ffb-8b48-746d2dc2c301" status: 200 len: 1364 microversion: 2.1 time: 0.148076 Oct 31 12:38:03.012991 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 355/725] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:38:02 2022] GET /compute/v2.1/servers/96065a23-4a5f-4ffb-8b48-746d2dc2c301 => generated 1364 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:38:03.024402 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-331e2284-b11a-437d-b4b7-b07c47b21b1c tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:38:03.026228 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-331e2284-b11a-437d-b4b7-b07c47b21b1c tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] [instance: ee260508-cdfb-468d-9ff4-df06cc3bdadf] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:38:03.032905 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-331e2284-b11a-437d-b4b7-b07c47b21b1c tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:38:03.033378 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-331e2284-b11a-437d-b4b7-b07c47b21b1c tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:38:03.033804 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-331e2284-b11a-437d-b4b7-b07c47b21b1c tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:38:03.034484 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-331e2284-b11a-437d-b4b7-b07c47b21b1c tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:38:03.034930 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-331e2284-b11a-437d-b4b7-b07c47b21b1c tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:38:03.035376 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-331e2284-b11a-437d-b4b7-b07c47b21b1c tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:38:03.065952 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-331e2284-b11a-437d-b4b7-b07c47b21b1c tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:38:03.066420 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-331e2284-b11a-437d-b4b7-b07c47b21b1c tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:38:03.066839 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-331e2284-b11a-437d-b4b7-b07c47b21b1c tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:38:03.067294 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.objects.instance [None req-331e2284-b11a-437d-b4b7-b07c47b21b1c tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lazy-loading 'fault' on Instance uuid ee260508-cdfb-468d-9ff4-df06cc3bdadf {{(pid=125440) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 12:38:03.108823 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-331e2284-b11a-437d-b4b7-b07c47b21b1c tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2e978bcb824a5e9d593b861c9e3bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7573cb9c503243ab90b1649591d550e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:38:03.116625 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-331e2284-b11a-437d-b4b7-b07c47b21b1c tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] 10.222.0.15 "GET /compute/v2.1/servers/ee260508-cdfb-468d-9ff4-df06cc3bdadf" status: 200 len: 1336 microversion: 2.1 time: 0.150749 Oct 31 12:38:03.117183 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 371/726] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:38:02 2022] GET /compute/v2.1/servers/ee260508-cdfb-468d-9ff4-df06cc3bdadf => generated 1336 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 12:38:04.037070 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-4d81f097-cd62-4716-9d5b-c3cc2de5fa0a tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:38:04.038521 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-4d81f097-cd62-4716-9d5b-c3cc2de5fa0a tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] [instance: 96065a23-4a5f-4ffb-8b48-746d2dc2c301] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:38:04.044848 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-4d81f097-cd62-4716-9d5b-c3cc2de5fa0a tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:38:04.045575 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-4d81f097-cd62-4716-9d5b-c3cc2de5fa0a tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:38:04.046232 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-4d81f097-cd62-4716-9d5b-c3cc2de5fa0a tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:38:04.047047 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-4d81f097-cd62-4716-9d5b-c3cc2de5fa0a tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:38:04.047622 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-4d81f097-cd62-4716-9d5b-c3cc2de5fa0a tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:38:04.048187 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-4d81f097-cd62-4716-9d5b-c3cc2de5fa0a tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:38:04.139570 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-129ad516-056c-4701-a7c0-396d65d5bb17 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:38:04.140298 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-129ad516-056c-4701-a7c0-396d65d5bb17 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] [instance: ee260508-cdfb-468d-9ff4-df06cc3bdadf] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:38:04.147189 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-129ad516-056c-4701-a7c0-396d65d5bb17 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:38:04.147761 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-129ad516-056c-4701-a7c0-396d65d5bb17 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:38:04.148306 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-129ad516-056c-4701-a7c0-396d65d5bb17 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:38:04.149206 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-129ad516-056c-4701-a7c0-396d65d5bb17 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:38:04.149722 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-129ad516-056c-4701-a7c0-396d65d5bb17 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:38:04.150272 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-129ad516-056c-4701-a7c0-396d65d5bb17 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:38:04.154439 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG dbcounter [-] [125440] Writing DB stats nova_cell1:SELECT=100 {{(pid=125440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:38:04.164818 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.wsgi [None req-129ad516-056c-4701-a7c0-396d65d5bb17 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] HTTP exception thrown: Instance ee260508-cdfb-468d-9ff4-df06cc3bdadf could not be found. Oct 31 12:38:04.166548 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-129ad516-056c-4701-a7c0-396d65d5bb17 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Request method failure captured: Oct 31 12:38:04.166548 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: request: GET /compute/v2.1/servers/ee260508-cdfb-468d-9ff4-df06cc3bdadf HTTP/1.1 Oct 31 12:38:04.166548 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: Accept: application/json Oct 31 12:38:04.166548 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: Accept-Encoding: identity Oct 31 12:38:04.166548 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: Connection: close Oct 31 12:38:04.166548 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: Content-Length: 0 Oct 31 12:38:04.166548 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: Content-Type: application/json Oct 31 12:38:04.166548 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: Host: 10.222.0.15 Oct 31 12:38:04.166548 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: Openstack-System-Scope: None Oct 31 12:38:04.166548 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: User-Agent: python-urllib3/1.26.12 Oct 31 12:38:04.166548 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Auth-Token: gAAAAABjX8B9TbEC4h9BQ_Pg6iyHk1PnZ6xM8QTj0p7BN52PNmExSmli9L2RQnu8wsaJHiorFY0ROJy8DFUPBMj8D1dWQd22JAoLKdxFZnWHPiWQc3-KjGpPHBlTK_jmIsaeVJlcwD00sScGPd4UgCUOBwD-FKwNC8xgXuheB5YggUWlcx9L5tw Oct 31 12:38:04.166548 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Domain-Id: None Oct 31 12:38:04.166548 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Domain-Name: None Oct 31 12:38:04.166548 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Identity-Status: Confirmed Oct 31 12:38:04.166548 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Is-Admin-Project: True Oct 31 12:38:04.166548 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Project-Domain-Id: default Oct 31 12:38:04.166548 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Project-Domain-Name: Default Oct 31 12:38:04.166548 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Project-Id: 7573cb9c503243ab90b1649591d550e6 Oct 31 12:38:04.166548 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1357722577 Oct 31 12:38:04.166548 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Role: reader,member Oct 31 12:38:04.166548 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Roles: reader,member Oct 31 12:38:04.167903 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/7573cb9c503243ab90b1649591d550e6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_7573cb9c503243ab90b1649591d550e6", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/7573cb9c503243ab90b1649591d550e6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/7573cb9c503243ab90b1649591d550e6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Oct 31 12:38:04.167903 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1357722577 Oct 31 12:38:04.167903 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Tenant-Id: 7573cb9c503243ab90b1649591d550e6 Oct 31 12:38:04.167903 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1357722577 Oct 31 12:38:04.167903 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-User: tempest-ServerRescueNegativeTestJSON-1357722577-project Oct 31 12:38:04.167903 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-User-Domain-Id: default Oct 31 12:38:04.167903 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-User-Domain-Name: Default Oct 31 12:38:04.167903 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-User-Id: db2e978bcb824a5e9d593b861c9e3bd7 Oct 31 12:38:04.167903 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1357722577-project Oct 31 12:38:04.167903 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: method: > Oct 31 12:38:04.167903 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: exception: Instance ee260508-cdfb-468d-9ff4-df06cc3bdadf could not be found. Oct 31 12:38:04.167903 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: action_args: {'id': 'ee260508-cdfb-468d-9ff4-df06cc3bdadf'} Oct 31 12:38:04.168698 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 12:38:04.168698 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 12:38:04.168698 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 12:38:04.168698 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 12:38:04.168698 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 12:38:04.168698 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 12:38:04.168698 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 12:38:04.168698 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 12:38:04.168698 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 12:38:04.168698 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 12:38:04.168698 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee260508-cdfb-468d-9ff4-df06cc3bdadf could not be found. Oct 31 12:38:04.168698 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Oct 31 12:38:04.168698 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 12:38:04.168698 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Oct 31 12:38:04.168698 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 12:38:04.168698 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 12:38:04.168698 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 12:38:04.168698 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 12:38:04.168698 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 12:38:04.168698 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 12:38:04.169869 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 12:38:04.169869 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 12:38:04.169869 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 12:38:04.169869 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 12:38:04.169869 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 12:38:04.169869 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 12:38:04.169869 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 12:38:04.169869 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee260508-cdfb-468d-9ff4-df06cc3bdadf could not be found. Oct 31 12:38:04.169869 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Oct 31 12:38:04.169869 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 12:38:04.169869 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Oct 31 12:38:04.169869 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 12:38:04.169869 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 12:38:04.169869 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 12:38:04.169869 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 12:38:04.169869 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 12:38:04.169869 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee260508-cdfb-468d-9ff4-df06cc3bdadf could not be found. Oct 31 12:38:04.169869 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Oct 31 12:38:04.170938 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-129ad516-056c-4701-a7c0-396d65d5bb17 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Returning 404 to user: Instance ee260508-cdfb-468d-9ff4-df06cc3bdadf could not be found. {{(pid=125440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 12:38:04.170938 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-129ad516-056c-4701-a7c0-396d65d5bb17 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] 10.222.0.15 "GET /compute/v2.1/servers/ee260508-cdfb-468d-9ff4-df06cc3bdadf" status: 404 len: 111 microversion: 2.1 time: 0.032188 Oct 31 12:38:04.170938 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 372/727] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:38:04 2022] GET /compute/v2.1/servers/ee260508-cdfb-468d-9ff4-df06cc3bdadf => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 12:38:04.176295 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-8914c62a-317c-41e3-bc9a-eb8c004de024 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Calling method '.version_select at 0x7f2aa89c4280>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:38:04.193347 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-4d81f097-cd62-4716-9d5b-c3cc2de5fa0a tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c1beb321e44908ab987b17f7b74484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a2bf9a5a484523a700e4e6c568d4de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:38:04.197690 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-8914c62a-317c-41e3-bc9a-eb8c004de024 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1165024382" status: 202 len: 0 microversion: 2.1 time: 0.024835 Oct 31 12:38:04.198266 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 373/728] 10.222.0.15 () {58 vars in 1221 bytes} [Mon Oct 31 12:38:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1165024382 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 12:38:04.202881 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-4d81f097-cd62-4716-9d5b-c3cc2de5fa0a tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] 10.222.0.15 "GET /compute/v2.1/servers/96065a23-4a5f-4ffb-8b48-746d2dc2c301" status: 200 len: 1549 microversion: 2.1 time: 0.169641 Oct 31 12:38:04.203621 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 356/729] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:38:04 2022] GET /compute/v2.1/servers/96065a23-4a5f-4ffb-8b48-746d2dc2c301 => generated 1549 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:38:04.226695 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-35dd6ddc-ff52-4336-a7a1-24ffe70b70a5 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:38:04.227566 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-35dd6ddc-ff52-4336-a7a1-24ffe70b70a5 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] [instance: 96065a23-4a5f-4ffb-8b48-746d2dc2c301] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:38:04.235889 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-35dd6ddc-ff52-4336-a7a1-24ffe70b70a5 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:38:04.236555 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-35dd6ddc-ff52-4336-a7a1-24ffe70b70a5 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:38:04.236998 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-35dd6ddc-ff52-4336-a7a1-24ffe70b70a5 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:38:04.237727 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-35dd6ddc-ff52-4336-a7a1-24ffe70b70a5 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:38:04.241155 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-35dd6ddc-ff52-4336-a7a1-24ffe70b70a5 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:38:04.241595 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-35dd6ddc-ff52-4336-a7a1-24ffe70b70a5 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:38:04.329802 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-35dd6ddc-ff52-4336-a7a1-24ffe70b70a5 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] 10.222.0.15 "GET /compute/v2.1/servers/96065a23-4a5f-4ffb-8b48-746d2dc2c301/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.107935 Oct 31 12:38:04.330389 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 374/730] 10.222.0.15 () {58 vars in 1275 bytes} [Mon Oct 31 12:38:04 2022] GET /compute/v2.1/servers/96065a23-4a5f-4ffb-8b48-746d2dc2c301/os-interface => generated 284 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 12:38:05.544702 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [req-97dcf2c0-56cf-4dd8-9ea6-97bfedff2551 req-68a57e5d-bef8-45e0-8511-ad071bde31a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96065a23-4a5f-4ffb-8b48-746d2dc2c301", "tag": "7b6ab379-5ce7-4b17-b091-dac7cbe3cfd0"}]} {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 12:38:05.554598 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [req-97dcf2c0-56cf-4dd8-9ea6-97bfedff2551 req-68a57e5d-bef8-45e0-8511-ad071bde31a3 service nova] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:38:05.555062 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [req-97dcf2c0-56cf-4dd8-9ea6-97bfedff2551 req-68a57e5d-bef8-45e0-8511-ad071bde31a3 service nova] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:38:05.555508 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [req-97dcf2c0-56cf-4dd8-9ea6-97bfedff2551 req-68a57e5d-bef8-45e0-8511-ad071bde31a3 service nova] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:38:05.566911 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.compute.server_external_events [req-97dcf2c0-56cf-4dd8-9ea6-97bfedff2551 req-68a57e5d-bef8-45e0-8511-ad071bde31a3 service nova] Creating event network-changed:7b6ab379-5ce7-4b17-b091-dac7cbe3cfd0 for instance 96065a23-4a5f-4ffb-8b48-746d2dc2c301 on hv-cinder-79617 Oct 31 12:38:05.572486 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [req-97dcf2c0-56cf-4dd8-9ea6-97bfedff2551 req-68a57e5d-bef8-45e0-8511-ad071bde31a3 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031041 Oct 31 12:38:05.573089 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 357/731] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Oct 31 12:38:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 12:38:07.131031 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-93fb3a27-8a9b-4ef5-9efa-3e1a91aa8e13 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:38:07.131919 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-93fb3a27-8a9b-4ef5-9efa-3e1a91aa8e13 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] [instance: d0befdd2-2ecd-4006-bfdd-86d5253a7687] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:38:07.139073 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-93fb3a27-8a9b-4ef5-9efa-3e1a91aa8e13 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:38:07.139900 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-93fb3a27-8a9b-4ef5-9efa-3e1a91aa8e13 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:38:07.140411 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-93fb3a27-8a9b-4ef5-9efa-3e1a91aa8e13 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:38:07.141319 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-93fb3a27-8a9b-4ef5-9efa-3e1a91aa8e13 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:38:07.141815 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-93fb3a27-8a9b-4ef5-9efa-3e1a91aa8e13 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:38:07.142236 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-93fb3a27-8a9b-4ef5-9efa-3e1a91aa8e13 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:38:07.172098 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-93fb3a27-8a9b-4ef5-9efa-3e1a91aa8e13 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] [instance: d0befdd2-2ecd-4006-bfdd-86d5253a7687] Going to try to terminate instance {{(pid=125440) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 12:38:07.251661 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-93fb3a27-8a9b-4ef5-9efa-3e1a91aa8e13 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] 10.222.0.15 "DELETE /compute/v2.1/servers/d0befdd2-2ecd-4006-bfdd-86d5253a7687" status: 204 len: 0 microversion: 2.1 time: 0.125494 Oct 31 12:38:07.252484 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 375/732] 10.222.0.15 () {58 vars in 1239 bytes} [Mon Oct 31 12:38:07 2022] DELETE /compute/v2.1/servers/d0befdd2-2ecd-4006-bfdd-86d5253a7687 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 12:38:07.265431 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-c2fa1a93-dbc7-4893-985c-c10434a2f44f tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:38:07.266916 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-c2fa1a93-dbc7-4893-985c-c10434a2f44f tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] [instance: d0befdd2-2ecd-4006-bfdd-86d5253a7687] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:38:07.275145 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-c2fa1a93-dbc7-4893-985c-c10434a2f44f tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:38:07.275757 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-c2fa1a93-dbc7-4893-985c-c10434a2f44f tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:38:07.276198 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-c2fa1a93-dbc7-4893-985c-c10434a2f44f tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:38:07.277214 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-c2fa1a93-dbc7-4893-985c-c10434a2f44f tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:38:07.278064 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-c2fa1a93-dbc7-4893-985c-c10434a2f44f tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:38:07.278502 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-c2fa1a93-dbc7-4893-985c-c10434a2f44f tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:38:07.416343 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-c2fa1a93-dbc7-4893-985c-c10434a2f44f tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2e978bcb824a5e9d593b861c9e3bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7573cb9c503243ab90b1649591d550e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:38:07.424461 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-c2fa1a93-dbc7-4893-985c-c10434a2f44f tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] 10.222.0.15 "GET /compute/v2.1/servers/d0befdd2-2ecd-4006-bfdd-86d5253a7687" status: 200 len: 1508 microversion: 2.1 time: 0.165678 Oct 31 12:38:07.424618 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 358/733] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:38:07 2022] GET /compute/v2.1/servers/d0befdd2-2ecd-4006-bfdd-86d5253a7687 => generated 1508 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:38:07.537053 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-24653a24-36b0-4b40-bda9-efcd85501a5e tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2cb9ef24-33be-4618-9a70-5422e7dd58fb"}} {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 12:38:07.539538 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-24653a24-36b0-4b40-bda9-efcd85501a5e tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] [instance: 46cae3a9-45e8-401c-b201-2ed4402e9e97] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:38:07.545999 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-24653a24-36b0-4b40-bda9-efcd85501a5e tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:38:07.546469 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-24653a24-36b0-4b40-bda9-efcd85501a5e tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:38:07.546900 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-24653a24-36b0-4b40-bda9-efcd85501a5e tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:38:07.547606 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-24653a24-36b0-4b40-bda9-efcd85501a5e tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:38:07.548054 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-24653a24-36b0-4b40-bda9-efcd85501a5e tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:38:07.548470 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-24653a24-36b0-4b40-bda9-efcd85501a5e tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:38:07.626721 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.wsgi [None req-24653a24-36b0-4b40-bda9-efcd85501a5e tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] HTTP exception thrown: Invalid volume: volume 2cb9ef24-33be-4618-9a70-5422e7dd58fb is already attached to instances: 46cae3a9-45e8-401c-b201-2ed4402e9e97 Oct 31 12:38:07.628483 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-24653a24-36b0-4b40-bda9-efcd85501a5e tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Request method failure captured: Oct 31 12:38:07.628483 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: request: POST /compute/v2.1/servers/46cae3a9-45e8-401c-b201-2ed4402e9e97/os-volume_attachments HTTP/1.1 Oct 31 12:38:07.628483 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: Accept: application/json Oct 31 12:38:07.628483 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: Accept-Encoding: identity Oct 31 12:38:07.628483 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: Connection: close Oct 31 12:38:07.628483 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: Content-Length: 74 Oct 31 12:38:07.628483 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: Content-Type: application/json Oct 31 12:38:07.628483 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: Host: 10.222.0.15 Oct 31 12:38:07.628483 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: Openstack-System-Scope: None Oct 31 12:38:07.628483 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: User-Agent: python-urllib3/1.26.12 Oct 31 12:38:07.628483 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Auth-Token: gAAAAABjX8B3Et2KM1ogPCTGs64pc6xLyfMw6yL0VTQe6oSz3vb_t3Nol1y36tJUXD6PegbQ8pwIEwo4L666w1x-Z79gwUGFQzXyfvvOjyyVZQL72gtR1ISe3h09afCWKpljHfxhI1Y-A2JuAkXEjCcgQXdDq6Gsj4TA71_GeBFeeItX_0KrPQA Oct 31 12:38:07.628483 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Domain-Id: None Oct 31 12:38:07.628483 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Domain-Name: None Oct 31 12:38:07.628483 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Identity-Status: Confirmed Oct 31 12:38:07.628483 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Is-Admin-Project: True Oct 31 12:38:07.628483 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Project-Domain-Id: default Oct 31 12:38:07.628483 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Project-Domain-Name: Default Oct 31 12:38:07.628483 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Project-Id: bfbc3a46f12942299b99cdd20c989e1f Oct 31 12:38:07.628483 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Project-Name: tempest-AttachVolumeNegativeTest-1648165012 Oct 31 12:38:07.628483 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Role: reader,member Oct 31 12:38:07.628483 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Roles: reader,member Oct 31 12:38:07.630153 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/bfbc3a46f12942299b99cdd20c989e1f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_bfbc3a46f12942299b99cdd20c989e1f", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/bfbc3a46f12942299b99cdd20c989e1f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/bfbc3a46f12942299b99cdd20c989e1f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Oct 31 12:38:07.630153 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Tenant: tempest-AttachVolumeNegativeTest-1648165012 Oct 31 12:38:07.630153 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Tenant-Id: bfbc3a46f12942299b99cdd20c989e1f Oct 31 12:38:07.630153 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1648165012 Oct 31 12:38:07.630153 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-User: tempest-AttachVolumeNegativeTest-1648165012-project Oct 31 12:38:07.630153 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-User-Domain-Id: default Oct 31 12:38:07.630153 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-User-Domain-Name: Default Oct 31 12:38:07.630153 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-User-Id: b2c03f0365ee4a26b8c076ae365325b2 Oct 31 12:38:07.630153 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-User-Name: tempest-AttachVolumeNegativeTest-1648165012-project Oct 31 12:38:07.630153 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: Oct 31 12:38:07.630153 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: {"volumeAttachment": {"volumeId": "2cb9ef24-33be-4618-9a70-5422e7dd58fb"}} Oct 31 12:38:07.630153 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: method: > Oct 31 12:38:07.631811 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: exception: Invalid volume: volume 2cb9ef24-33be-4618-9a70-5422e7dd58fb is already attached to instances: 46cae3a9-45e8-401c-b201-2ed4402e9e97 Oct 31 12:38:07.631811 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: action_args: {'server_id': '46cae3a9-45e8-401c-b201-2ed4402e9e97', 'body': {'volumeAttachment': {'volumeId': '2cb9ef24-33be-4618-9a70-5422e7dd58fb'}}} Oct 31 12:38:07.631811 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 12:38:07.631811 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 12:38:07.631811 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 31 12:38:07.631811 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 31 12:38:07.631811 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 31 12:38:07.631811 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 31 12:38:07.631811 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 31 12:38:07.631811 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 31 12:38:07.631811 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 31 12:38:07.631811 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 31 12:38:07.631811 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 31 12:38:07.631811 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 31 12:38:07.631811 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 2cb9ef24-33be-4618-9a70-5422e7dd58fb is already attached to instances: 46cae3a9-45e8-401c-b201-2ed4402e9e97 Oct 31 12:38:07.631811 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Oct 31 12:38:07.631811 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 12:38:07.631811 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Oct 31 12:38:07.631811 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 12:38:07.633144 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 12:38:07.633144 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 12:38:07.633144 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 12:38:07.633144 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 12:38:07.633144 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 12:38:07.633144 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 12:38:07.633144 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 12:38:07.633144 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 12:38:07.633144 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 12:38:07.633144 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 12:38:07.633144 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 12:38:07.633144 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 12:38:07.633144 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 31 12:38:07.633144 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 31 12:38:07.633144 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 2cb9ef24-33be-4618-9a70-5422e7dd58fb is already attached to instances: 46cae3a9-45e8-401c-b201-2ed4402e9e97 Oct 31 12:38:07.633144 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Oct 31 12:38:07.633144 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 12:38:07.633144 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Oct 31 12:38:07.633144 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 12:38:07.633144 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 12:38:07.636099 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 12:38:07.636099 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 12:38:07.636099 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 12:38:07.636099 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 2cb9ef24-33be-4618-9a70-5422e7dd58fb is already attached to instances: 46cae3a9-45e8-401c-b201-2ed4402e9e97 Oct 31 12:38:07.636099 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Oct 31 12:38:07.636099 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-24653a24-36b0-4b40-bda9-efcd85501a5e tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Returning 400 to user: Invalid volume: volume 2cb9ef24-33be-4618-9a70-5422e7dd58fb is already attached to instances: 46cae3a9-45e8-401c-b201-2ed4402e9e97 {{(pid=125440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 12:38:07.636099 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-24653a24-36b0-4b40-bda9-efcd85501a5e tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] 10.222.0.15 "POST /compute/v2.1/servers/46cae3a9-45e8-401c-b201-2ed4402e9e97/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.097209 Oct 31 12:38:07.636099 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 376/734] 10.222.0.15 () {60 vars in 1323 bytes} [Mon Oct 31 12:38:07 2022] POST /compute/v2.1/servers/46cae3a9-45e8-401c-b201-2ed4402e9e97/os-volume_attachments => generated 174 bytes in 99 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 31 12:38:07.697646 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-fef455de-ea5a-428c-99d0-5055f7c567c6 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:38:07.698172 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-fef455de-ea5a-428c-99d0-5055f7c567c6 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] [instance: 46cae3a9-45e8-401c-b201-2ed4402e9e97] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:38:07.704151 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-fef455de-ea5a-428c-99d0-5055f7c567c6 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:38:07.704632 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-fef455de-ea5a-428c-99d0-5055f7c567c6 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:38:07.705066 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-fef455de-ea5a-428c-99d0-5055f7c567c6 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:38:07.705752 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-fef455de-ea5a-428c-99d0-5055f7c567c6 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:38:07.706205 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-fef455de-ea5a-428c-99d0-5055f7c567c6 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:38:07.706624 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-fef455de-ea5a-428c-99d0-5055f7c567c6 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:38:07.709215 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG dbcounter [-] [125441] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=125441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:38:07.793373 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.objects.instance [None req-fef455de-ea5a-428c-99d0-5055f7c567c6 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lazy-loading 'services' on Instance uuid 46cae3a9-45e8-401c-b201-2ed4402e9e97 {{(pid=125441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 12:38:07.863368 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-fef455de-ea5a-428c-99d0-5055f7c567c6 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] 10.222.0.15 "DELETE /compute/v2.1/servers/46cae3a9-45e8-401c-b201-2ed4402e9e97/os-volume_attachments/2cb9ef24-33be-4618-9a70-5422e7dd58fb" status: 202 len: 0 microversion: 2.1 time: 0.169984 Oct 31 12:38:07.863996 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 359/735] 10.222.0.15 () {58 vars in 1416 bytes} [Mon Oct 31 12:38:07 2022] DELETE /compute/v2.1/servers/46cae3a9-45e8-401c-b201-2ed4402e9e97/os-volume_attachments/2cb9ef24-33be-4618-9a70-5422e7dd58fb => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 12:38:07.872418 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-6fd1ff00-439d-4bdc-876d-9b0a6e502375 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:38:07.874639 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-6fd1ff00-439d-4bdc-876d-9b0a6e502375 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] [instance: 46cae3a9-45e8-401c-b201-2ed4402e9e97] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:38:07.880531 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-6fd1ff00-439d-4bdc-876d-9b0a6e502375 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:38:07.881001 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-6fd1ff00-439d-4bdc-876d-9b0a6e502375 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:38:07.881431 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-6fd1ff00-439d-4bdc-876d-9b0a6e502375 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:38:07.882103 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-6fd1ff00-439d-4bdc-876d-9b0a6e502375 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:38:07.882550 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-6fd1ff00-439d-4bdc-876d-9b0a6e502375 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:38:07.882959 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-6fd1ff00-439d-4bdc-876d-9b0a6e502375 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:38:07.912802 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-6fd1ff00-439d-4bdc-876d-9b0a6e502375 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] 10.222.0.15 "GET /compute/v2.1/servers/46cae3a9-45e8-401c-b201-2ed4402e9e97/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044458 Oct 31 12:38:07.913369 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 377/736] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Oct 31 12:38:07 2022] GET /compute/v2.1/servers/46cae3a9-45e8-401c-b201-2ed4402e9e97/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 12:38:08.448220 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-91c15329-30e7-43a3-912c-41c48cfba4f6 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:38:08.448826 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-91c15329-30e7-43a3-912c-41c48cfba4f6 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] [instance: d0befdd2-2ecd-4006-bfdd-86d5253a7687] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:38:08.455358 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-91c15329-30e7-43a3-912c-41c48cfba4f6 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:38:08.455831 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-91c15329-30e7-43a3-912c-41c48cfba4f6 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:38:08.456256 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-91c15329-30e7-43a3-912c-41c48cfba4f6 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:38:08.456928 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-91c15329-30e7-43a3-912c-41c48cfba4f6 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:38:08.457374 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-91c15329-30e7-43a3-912c-41c48cfba4f6 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:38:08.457787 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-91c15329-30e7-43a3-912c-41c48cfba4f6 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:38:08.585802 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-91c15329-30e7-43a3-912c-41c48cfba4f6 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2e978bcb824a5e9d593b861c9e3bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7573cb9c503243ab90b1649591d550e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:38:08.594731 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-91c15329-30e7-43a3-912c-41c48cfba4f6 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] 10.222.0.15 "GET /compute/v2.1/servers/d0befdd2-2ecd-4006-bfdd-86d5253a7687" status: 200 len: 1508 microversion: 2.1 time: 0.151472 Oct 31 12:38:08.595376 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 360/737] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:38:08 2022] GET /compute/v2.1/servers/d0befdd2-2ecd-4006-bfdd-86d5253a7687 => generated 1508 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:38:08.925063 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-8bc6c92c-2c22-45e1-86c5-e3ab1d20fdb2 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:38:08.927255 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-8bc6c92c-2c22-45e1-86c5-e3ab1d20fdb2 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] [instance: 46cae3a9-45e8-401c-b201-2ed4402e9e97] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:38:08.934742 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-8bc6c92c-2c22-45e1-86c5-e3ab1d20fdb2 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:38:08.935247 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-8bc6c92c-2c22-45e1-86c5-e3ab1d20fdb2 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:38:08.935684 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-8bc6c92c-2c22-45e1-86c5-e3ab1d20fdb2 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:38:08.936375 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-8bc6c92c-2c22-45e1-86c5-e3ab1d20fdb2 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:38:08.936831 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-8bc6c92c-2c22-45e1-86c5-e3ab1d20fdb2 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:38:08.937252 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-8bc6c92c-2c22-45e1-86c5-e3ab1d20fdb2 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:38:08.966253 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-8bc6c92c-2c22-45e1-86c5-e3ab1d20fdb2 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] 10.222.0.15 "GET /compute/v2.1/servers/46cae3a9-45e8-401c-b201-2ed4402e9e97/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045137 Oct 31 12:38:08.966799 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 378/738] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Oct 31 12:38:08 2022] GET /compute/v2.1/servers/46cae3a9-45e8-401c-b201-2ed4402e9e97/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 12:38:09.617880 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-75cf3b84-f7a1-4ee6-97b9-f82261ea7bca tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:38:09.618489 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-75cf3b84-f7a1-4ee6-97b9-f82261ea7bca tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] [instance: d0befdd2-2ecd-4006-bfdd-86d5253a7687] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:38:09.625491 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-75cf3b84-f7a1-4ee6-97b9-f82261ea7bca tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:38:09.625974 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-75cf3b84-f7a1-4ee6-97b9-f82261ea7bca tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:38:09.626400 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-75cf3b84-f7a1-4ee6-97b9-f82261ea7bca tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:38:09.627074 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-75cf3b84-f7a1-4ee6-97b9-f82261ea7bca tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:38:09.627549 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-75cf3b84-f7a1-4ee6-97b9-f82261ea7bca tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:38:09.627972 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-75cf3b84-f7a1-4ee6-97b9-f82261ea7bca tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:38:09.754842 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-75cf3b84-f7a1-4ee6-97b9-f82261ea7bca tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2e978bcb824a5e9d593b861c9e3bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7573cb9c503243ab90b1649591d550e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:38:09.762672 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-75cf3b84-f7a1-4ee6-97b9-f82261ea7bca tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] 10.222.0.15 "GET /compute/v2.1/servers/d0befdd2-2ecd-4006-bfdd-86d5253a7687" status: 200 len: 1508 microversion: 2.1 time: 0.148606 Oct 31 12:38:09.763258 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 361/739] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:38:09 2022] GET /compute/v2.1/servers/d0befdd2-2ecd-4006-bfdd-86d5253a7687 => generated 1508 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:38:09.978160 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-efadd6af-caef-44b9-9887-9b60d0bd13e4 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:38:09.981717 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-efadd6af-caef-44b9-9887-9b60d0bd13e4 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] [instance: 46cae3a9-45e8-401c-b201-2ed4402e9e97] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:38:09.988378 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-efadd6af-caef-44b9-9887-9b60d0bd13e4 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:38:09.988862 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-efadd6af-caef-44b9-9887-9b60d0bd13e4 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:38:09.989292 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-efadd6af-caef-44b9-9887-9b60d0bd13e4 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:38:09.990016 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-efadd6af-caef-44b9-9887-9b60d0bd13e4 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:38:09.990536 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-efadd6af-caef-44b9-9887-9b60d0bd13e4 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:38:09.990951 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-efadd6af-caef-44b9-9887-9b60d0bd13e4 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:38:10.020065 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-efadd6af-caef-44b9-9887-9b60d0bd13e4 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] 10.222.0.15 "GET /compute/v2.1/servers/46cae3a9-45e8-401c-b201-2ed4402e9e97/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045988 Oct 31 12:38:10.020619 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 379/740] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Oct 31 12:38:09 2022] GET /compute/v2.1/servers/46cae3a9-45e8-401c-b201-2ed4402e9e97/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 12:38:10.461702 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [req-12527d0a-d311-438d-913e-71e60fd54153 req-c11cbe3f-2cd8-442e-92de-69bd35564176 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0befdd2-2ecd-4006-bfdd-86d5253a7687", "name": "network-vif-deleted", "tag": "8ae8e564-b3aa-4e58-8d16-d182b80edabc"}]} {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 12:38:10.475015 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [req-12527d0a-d311-438d-913e-71e60fd54153 req-c11cbe3f-2cd8-442e-92de-69bd35564176 service nova] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:38:10.476264 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [req-12527d0a-d311-438d-913e-71e60fd54153 req-c11cbe3f-2cd8-442e-92de-69bd35564176 service nova] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:38:10.476807 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [req-12527d0a-d311-438d-913e-71e60fd54153 req-c11cbe3f-2cd8-442e-92de-69bd35564176 service nova] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:38:10.490611 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.compute.server_external_events [req-12527d0a-d311-438d-913e-71e60fd54153 req-c11cbe3f-2cd8-442e-92de-69bd35564176 service nova] Creating event network-vif-deleted:8ae8e564-b3aa-4e58-8d16-d182b80edabc for instance d0befdd2-2ecd-4006-bfdd-86d5253a7687 on hv-cinder-79617 Oct 31 12:38:10.497045 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [req-12527d0a-d311-438d-913e-71e60fd54153 req-c11cbe3f-2cd8-442e-92de-69bd35564176 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039168 Oct 31 12:38:10.497795 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 362/741] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Oct 31 12:38:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 12:38:10.786070 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-647cd9de-de1b-4a01-8fff-41a173af7728 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:38:10.786648 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-647cd9de-de1b-4a01-8fff-41a173af7728 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] [instance: d0befdd2-2ecd-4006-bfdd-86d5253a7687] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:38:10.793367 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-647cd9de-de1b-4a01-8fff-41a173af7728 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:38:10.793854 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-647cd9de-de1b-4a01-8fff-41a173af7728 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:38:10.794278 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-647cd9de-de1b-4a01-8fff-41a173af7728 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:38:10.795149 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-647cd9de-de1b-4a01-8fff-41a173af7728 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:38:10.795631 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-647cd9de-de1b-4a01-8fff-41a173af7728 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:38:10.796054 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-647cd9de-de1b-4a01-8fff-41a173af7728 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:38:10.829880 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-647cd9de-de1b-4a01-8fff-41a173af7728 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:38:10.830365 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-647cd9de-de1b-4a01-8fff-41a173af7728 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:38:10.830792 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-647cd9de-de1b-4a01-8fff-41a173af7728 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:38:10.831264 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.objects.instance [None req-647cd9de-de1b-4a01-8fff-41a173af7728 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lazy-loading 'fault' on Instance uuid d0befdd2-2ecd-4006-bfdd-86d5253a7687 {{(pid=125440) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 12:38:10.875511 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-647cd9de-de1b-4a01-8fff-41a173af7728 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2e978bcb824a5e9d593b861c9e3bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7573cb9c503243ab90b1649591d550e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:38:10.883305 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-647cd9de-de1b-4a01-8fff-41a173af7728 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] 10.222.0.15 "GET /compute/v2.1/servers/d0befdd2-2ecd-4006-bfdd-86d5253a7687" status: 200 len: 1311 microversion: 2.1 time: 0.101305 Oct 31 12:38:10.883867 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 380/742] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:38:10 2022] GET /compute/v2.1/servers/d0befdd2-2ecd-4006-bfdd-86d5253a7687 => generated 1311 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:38:11.033707 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-30c4edd6-ab7f-4950-bb7d-bba2c51481b6 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:38:11.036066 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-30c4edd6-ab7f-4950-bb7d-bba2c51481b6 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] [instance: 46cae3a9-45e8-401c-b201-2ed4402e9e97] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:38:11.043379 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-30c4edd6-ab7f-4950-bb7d-bba2c51481b6 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:38:11.043857 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-30c4edd6-ab7f-4950-bb7d-bba2c51481b6 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:38:11.044284 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-30c4edd6-ab7f-4950-bb7d-bba2c51481b6 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:38:11.044967 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-30c4edd6-ab7f-4950-bb7d-bba2c51481b6 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:38:11.045412 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-30c4edd6-ab7f-4950-bb7d-bba2c51481b6 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:38:11.045827 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-30c4edd6-ab7f-4950-bb7d-bba2c51481b6 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:38:11.079536 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-30c4edd6-ab7f-4950-bb7d-bba2c51481b6 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] 10.222.0.15 "GET /compute/v2.1/servers/46cae3a9-45e8-401c-b201-2ed4402e9e97/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050038 Oct 31 12:38:11.080426 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 363/743] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Oct 31 12:38:11 2022] GET /compute/v2.1/servers/46cae3a9-45e8-401c-b201-2ed4402e9e97/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 12:38:11.145454 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-49773641-b6cb-4a6d-8edb-376d33203fc0 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:38:11.145853 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-49773641-b6cb-4a6d-8edb-376d33203fc0 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] [instance: 46cae3a9-45e8-401c-b201-2ed4402e9e97] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:38:11.154648 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-49773641-b6cb-4a6d-8edb-376d33203fc0 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:38:11.155496 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-49773641-b6cb-4a6d-8edb-376d33203fc0 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:38:11.155970 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-49773641-b6cb-4a6d-8edb-376d33203fc0 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:38:11.156694 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-49773641-b6cb-4a6d-8edb-376d33203fc0 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:38:11.157167 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-49773641-b6cb-4a6d-8edb-376d33203fc0 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:38:11.157794 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-49773641-b6cb-4a6d-8edb-376d33203fc0 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:38:11.183599 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-49773641-b6cb-4a6d-8edb-376d33203fc0 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] [instance: 46cae3a9-45e8-401c-b201-2ed4402e9e97] Going to try to terminate instance {{(pid=125440) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 12:38:11.256433 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-49773641-b6cb-4a6d-8edb-376d33203fc0 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] 10.222.0.15 "DELETE /compute/v2.1/servers/46cae3a9-45e8-401c-b201-2ed4402e9e97" status: 204 len: 0 microversion: 2.1 time: 0.115124 Oct 31 12:38:11.257033 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 381/744] 10.222.0.15 () {58 vars in 1239 bytes} [Mon Oct 31 12:38:11 2022] DELETE /compute/v2.1/servers/46cae3a9-45e8-401c-b201-2ed4402e9e97 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 12:38:11.266043 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-b5746b84-88f8-468d-9f77-7f2ddd008061 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:38:11.266646 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-b5746b84-88f8-468d-9f77-7f2ddd008061 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] [instance: 46cae3a9-45e8-401c-b201-2ed4402e9e97] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:38:11.272776 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-b5746b84-88f8-468d-9f77-7f2ddd008061 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:38:11.273254 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-b5746b84-88f8-468d-9f77-7f2ddd008061 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:38:11.273682 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-b5746b84-88f8-468d-9f77-7f2ddd008061 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:38:11.274355 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-b5746b84-88f8-468d-9f77-7f2ddd008061 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:38:11.274807 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-b5746b84-88f8-468d-9f77-7f2ddd008061 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:38:11.275251 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-b5746b84-88f8-468d-9f77-7f2ddd008061 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:38:11.406995 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-b5746b84-88f8-468d-9f77-7f2ddd008061 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c03f0365ee4a26b8c076ae365325b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfbc3a46f12942299b99cdd20c989e1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:38:11.414755 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-b5746b84-88f8-468d-9f77-7f2ddd008061 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] 10.222.0.15 "GET /compute/v2.1/servers/46cae3a9-45e8-401c-b201-2ed4402e9e97" status: 200 len: 1683 microversion: 2.1 time: 0.152742 Oct 31 12:38:11.415343 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 364/745] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:38:11 2022] GET /compute/v2.1/servers/46cae3a9-45e8-401c-b201-2ed4402e9e97 => generated 1683 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:38:11.907602 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-58386ea3-bfd8-45ac-b28c-084aef629789 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:38:11.908287 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-58386ea3-bfd8-45ac-b28c-084aef629789 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] [instance: d0befdd2-2ecd-4006-bfdd-86d5253a7687] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:38:11.914072 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-58386ea3-bfd8-45ac-b28c-084aef629789 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:38:11.914538 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-58386ea3-bfd8-45ac-b28c-084aef629789 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:38:11.914957 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-58386ea3-bfd8-45ac-b28c-084aef629789 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:38:11.915658 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-58386ea3-bfd8-45ac-b28c-084aef629789 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:38:11.916137 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-58386ea3-bfd8-45ac-b28c-084aef629789 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:38:11.916544 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-58386ea3-bfd8-45ac-b28c-084aef629789 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:38:11.929453 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.wsgi [None req-58386ea3-bfd8-45ac-b28c-084aef629789 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] HTTP exception thrown: Instance d0befdd2-2ecd-4006-bfdd-86d5253a7687 could not be found. Oct 31 12:38:11.931006 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-58386ea3-bfd8-45ac-b28c-084aef629789 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Request method failure captured: Oct 31 12:38:11.931006 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: request: GET /compute/v2.1/servers/d0befdd2-2ecd-4006-bfdd-86d5253a7687 HTTP/1.1 Oct 31 12:38:11.931006 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: Accept: application/json Oct 31 12:38:11.931006 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: Accept-Encoding: identity Oct 31 12:38:11.931006 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: Connection: close Oct 31 12:38:11.931006 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: Content-Length: 0 Oct 31 12:38:11.931006 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: Content-Type: application/json Oct 31 12:38:11.931006 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: Host: 10.222.0.15 Oct 31 12:38:11.931006 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: Openstack-System-Scope: None Oct 31 12:38:11.931006 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: User-Agent: python-urllib3/1.26.12 Oct 31 12:38:11.931006 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Auth-Token: gAAAAABjX8B9TbEC4h9BQ_Pg6iyHk1PnZ6xM8QTj0p7BN52PNmExSmli9L2RQnu8wsaJHiorFY0ROJy8DFUPBMj8D1dWQd22JAoLKdxFZnWHPiWQc3-KjGpPHBlTK_jmIsaeVJlcwD00sScGPd4UgCUOBwD-FKwNC8xgXuheB5YggUWlcx9L5tw Oct 31 12:38:11.931006 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Domain-Id: None Oct 31 12:38:11.931006 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Domain-Name: None Oct 31 12:38:11.931006 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Identity-Status: Confirmed Oct 31 12:38:11.931006 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Is-Admin-Project: True Oct 31 12:38:11.931006 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Project-Domain-Id: default Oct 31 12:38:11.931006 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Project-Domain-Name: Default Oct 31 12:38:11.931006 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Project-Id: 7573cb9c503243ab90b1649591d550e6 Oct 31 12:38:11.931006 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1357722577 Oct 31 12:38:11.931006 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Role: reader,member Oct 31 12:38:11.931006 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Roles: reader,member Oct 31 12:38:11.933067 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/7573cb9c503243ab90b1649591d550e6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_7573cb9c503243ab90b1649591d550e6", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/7573cb9c503243ab90b1649591d550e6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/7573cb9c503243ab90b1649591d550e6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Oct 31 12:38:11.933067 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1357722577 Oct 31 12:38:11.933067 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Tenant-Id: 7573cb9c503243ab90b1649591d550e6 Oct 31 12:38:11.933067 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1357722577 Oct 31 12:38:11.933067 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-User: tempest-ServerRescueNegativeTestJSON-1357722577-project Oct 31 12:38:11.933067 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-User-Domain-Id: default Oct 31 12:38:11.933067 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-User-Domain-Name: Default Oct 31 12:38:11.933067 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-User-Id: db2e978bcb824a5e9d593b861c9e3bd7 Oct 31 12:38:11.933067 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1357722577-project Oct 31 12:38:11.933067 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: method: > Oct 31 12:38:11.933067 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: exception: Instance d0befdd2-2ecd-4006-bfdd-86d5253a7687 could not be found. Oct 31 12:38:11.933067 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: action_args: {'id': 'd0befdd2-2ecd-4006-bfdd-86d5253a7687'} Oct 31 12:38:11.933913 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 12:38:11.933913 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 12:38:11.933913 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 12:38:11.933913 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 12:38:11.933913 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 12:38:11.933913 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 12:38:11.933913 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 12:38:11.933913 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 12:38:11.933913 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 12:38:11.933913 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 12:38:11.933913 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d0befdd2-2ecd-4006-bfdd-86d5253a7687 could not be found. Oct 31 12:38:11.933913 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Oct 31 12:38:11.933913 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 12:38:11.933913 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Oct 31 12:38:11.933913 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 12:38:11.933913 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 12:38:11.933913 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 12:38:11.933913 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 12:38:11.933913 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 12:38:11.933913 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 12:38:11.935394 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 12:38:11.935394 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 12:38:11.935394 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 12:38:11.935394 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 12:38:11.935394 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 12:38:11.935394 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 12:38:11.935394 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 12:38:11.935394 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d0befdd2-2ecd-4006-bfdd-86d5253a7687 could not be found. Oct 31 12:38:11.935394 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Oct 31 12:38:11.935394 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 12:38:11.935394 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Oct 31 12:38:11.935394 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 12:38:11.935394 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 12:38:11.935394 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 12:38:11.935394 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 12:38:11.935394 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 12:38:11.935394 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d0befdd2-2ecd-4006-bfdd-86d5253a7687 could not be found. Oct 31 12:38:11.935394 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Oct 31 12:38:11.936611 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-58386ea3-bfd8-45ac-b28c-084aef629789 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Returning 404 to user: Instance d0befdd2-2ecd-4006-bfdd-86d5253a7687 could not be found. {{(pid=125440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 12:38:11.936611 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-58386ea3-bfd8-45ac-b28c-084aef629789 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] 10.222.0.15 "GET /compute/v2.1/servers/d0befdd2-2ecd-4006-bfdd-86d5253a7687" status: 404 len: 111 microversion: 2.1 time: 0.029018 Oct 31 12:38:11.936611 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 382/746] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:38:11 2022] GET /compute/v2.1/servers/d0befdd2-2ecd-4006-bfdd-86d5253a7687 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 12:38:11.940945 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-a83db14e-4ec1-46c8-a11f-a8a71f2b37a9 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:38:11.941441 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-a83db14e-4ec1-46c8-a11f-a8a71f2b37a9 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] [instance: d33a2d6b-f17c-4ce3-ad33-9086d790495d] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:38:11.948322 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-a83db14e-4ec1-46c8-a11f-a8a71f2b37a9 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:38:11.948824 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-a83db14e-4ec1-46c8-a11f-a8a71f2b37a9 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:38:11.949279 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-a83db14e-4ec1-46c8-a11f-a8a71f2b37a9 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:38:11.949967 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-a83db14e-4ec1-46c8-a11f-a8a71f2b37a9 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:38:11.950420 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-a83db14e-4ec1-46c8-a11f-a8a71f2b37a9 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:38:11.950841 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-a83db14e-4ec1-46c8-a11f-a8a71f2b37a9 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:38:11.976139 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-a83db14e-4ec1-46c8-a11f-a8a71f2b37a9 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] [instance: d33a2d6b-f17c-4ce3-ad33-9086d790495d] Going to try to terminate instance {{(pid=125441) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 12:38:12.039623 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG dbcounter [-] [125441] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=125441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:38:12.055545 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-a83db14e-4ec1-46c8-a11f-a8a71f2b37a9 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] 10.222.0.15 "DELETE /compute/v2.1/servers/d33a2d6b-f17c-4ce3-ad33-9086d790495d" status: 204 len: 0 microversion: 2.1 time: 0.118130 Oct 31 12:38:12.056129 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 365/747] 10.222.0.15 () {58 vars in 1239 bytes} [Mon Oct 31 12:38:11 2022] DELETE /compute/v2.1/servers/d33a2d6b-f17c-4ce3-ad33-9086d790495d => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 12:38:12.064067 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-b911ed46-c0d6-4a95-935c-e0210ef5fea9 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:38:12.064680 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-b911ed46-c0d6-4a95-935c-e0210ef5fea9 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] [instance: d33a2d6b-f17c-4ce3-ad33-9086d790495d] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:38:12.070440 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-b911ed46-c0d6-4a95-935c-e0210ef5fea9 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:38:12.070908 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-b911ed46-c0d6-4a95-935c-e0210ef5fea9 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:38:12.071371 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-b911ed46-c0d6-4a95-935c-e0210ef5fea9 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:38:12.072045 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-b911ed46-c0d6-4a95-935c-e0210ef5fea9 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:38:12.073090 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-b911ed46-c0d6-4a95-935c-e0210ef5fea9 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:38:12.073504 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-b911ed46-c0d6-4a95-935c-e0210ef5fea9 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:38:12.210057 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-b911ed46-c0d6-4a95-935c-e0210ef5fea9 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2e978bcb824a5e9d593b861c9e3bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7573cb9c503243ab90b1649591d550e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:38:12.217737 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-b911ed46-c0d6-4a95-935c-e0210ef5fea9 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] 10.222.0.15 "GET /compute/v2.1/servers/d33a2d6b-f17c-4ce3-ad33-9086d790495d" status: 200 len: 1522 microversion: 2.1 time: 0.157488 Oct 31 12:38:12.218768 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 383/748] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:38:12 2022] GET /compute/v2.1/servers/d33a2d6b-f17c-4ce3-ad33-9086d790495d => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:38:12.439364 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-46e50ca8-921c-46f8-b668-f26a93d9d36b tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:38:12.440057 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-46e50ca8-921c-46f8-b668-f26a93d9d36b tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] [instance: 46cae3a9-45e8-401c-b201-2ed4402e9e97] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:38:12.445921 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-46e50ca8-921c-46f8-b668-f26a93d9d36b tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:38:12.446399 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-46e50ca8-921c-46f8-b668-f26a93d9d36b tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:38:12.446829 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-46e50ca8-921c-46f8-b668-f26a93d9d36b tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:38:12.448367 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-46e50ca8-921c-46f8-b668-f26a93d9d36b tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:38:12.448901 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-46e50ca8-921c-46f8-b668-f26a93d9d36b tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:38:12.449323 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-46e50ca8-921c-46f8-b668-f26a93d9d36b tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:38:12.577698 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-46e50ca8-921c-46f8-b668-f26a93d9d36b tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c03f0365ee4a26b8c076ae365325b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfbc3a46f12942299b99cdd20c989e1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:38:12.585465 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-46e50ca8-921c-46f8-b668-f26a93d9d36b tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] 10.222.0.15 "GET /compute/v2.1/servers/46cae3a9-45e8-401c-b201-2ed4402e9e97" status: 200 len: 1683 microversion: 2.1 time: 0.150302 Oct 31 12:38:12.586048 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 366/749] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:38:12 2022] GET /compute/v2.1/servers/46cae3a9-45e8-401c-b201-2ed4402e9e97 => generated 1683 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:38:13.240569 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-cc28616b-c51e-417c-9a6c-836789374a02 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:38:13.241188 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-cc28616b-c51e-417c-9a6c-836789374a02 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] [instance: d33a2d6b-f17c-4ce3-ad33-9086d790495d] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:38:13.247614 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-cc28616b-c51e-417c-9a6c-836789374a02 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:38:13.248087 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-cc28616b-c51e-417c-9a6c-836789374a02 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:38:13.248514 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-cc28616b-c51e-417c-9a6c-836789374a02 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:38:13.249204 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-cc28616b-c51e-417c-9a6c-836789374a02 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:38:13.249637 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-cc28616b-c51e-417c-9a6c-836789374a02 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:38:13.250051 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-cc28616b-c51e-417c-9a6c-836789374a02 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:38:13.381026 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-cc28616b-c51e-417c-9a6c-836789374a02 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2e978bcb824a5e9d593b861c9e3bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7573cb9c503243ab90b1649591d550e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:38:13.389056 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-cc28616b-c51e-417c-9a6c-836789374a02 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] 10.222.0.15 "GET /compute/v2.1/servers/d33a2d6b-f17c-4ce3-ad33-9086d790495d" status: 200 len: 1522 microversion: 2.1 time: 0.152356 Oct 31 12:38:13.389612 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 384/750] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:38:13 2022] GET /compute/v2.1/servers/d33a2d6b-f17c-4ce3-ad33-9086d790495d => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:38:13.609564 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-cb946305-66e6-4bbc-9525-e8a3681756eb tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:38:13.610099 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-cb946305-66e6-4bbc-9525-e8a3681756eb tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] [instance: 46cae3a9-45e8-401c-b201-2ed4402e9e97] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:38:13.616471 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-cb946305-66e6-4bbc-9525-e8a3681756eb tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:38:13.616945 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-cb946305-66e6-4bbc-9525-e8a3681756eb tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:38:13.617372 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-cb946305-66e6-4bbc-9525-e8a3681756eb tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:38:13.618050 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-cb946305-66e6-4bbc-9525-e8a3681756eb tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:38:13.618499 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-cb946305-66e6-4bbc-9525-e8a3681756eb tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:38:13.618913 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-cb946305-66e6-4bbc-9525-e8a3681756eb tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:38:13.749180 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-cb946305-66e6-4bbc-9525-e8a3681756eb tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c03f0365ee4a26b8c076ae365325b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfbc3a46f12942299b99cdd20c989e1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:38:13.756707 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-cb946305-66e6-4bbc-9525-e8a3681756eb tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] 10.222.0.15 "GET /compute/v2.1/servers/46cae3a9-45e8-401c-b201-2ed4402e9e97" status: 200 len: 1683 microversion: 2.1 time: 0.151034 Oct 31 12:38:13.757275 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 367/751] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:38:13 2022] GET /compute/v2.1/servers/46cae3a9-45e8-401c-b201-2ed4402e9e97 => generated 1683 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:38:14.411864 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-7bccba20-a13f-44ac-819d-dbaa01ca8507 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:38:14.412527 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-7bccba20-a13f-44ac-819d-dbaa01ca8507 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] [instance: d33a2d6b-f17c-4ce3-ad33-9086d790495d] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:38:14.418912 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-7bccba20-a13f-44ac-819d-dbaa01ca8507 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:38:14.419413 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-7bccba20-a13f-44ac-819d-dbaa01ca8507 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:38:14.419840 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-7bccba20-a13f-44ac-819d-dbaa01ca8507 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:38:14.420514 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-7bccba20-a13f-44ac-819d-dbaa01ca8507 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:38:14.420959 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-7bccba20-a13f-44ac-819d-dbaa01ca8507 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:38:14.421370 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-7bccba20-a13f-44ac-819d-dbaa01ca8507 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:38:14.546944 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-7bccba20-a13f-44ac-819d-dbaa01ca8507 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2e978bcb824a5e9d593b861c9e3bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7573cb9c503243ab90b1649591d550e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:38:14.554482 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-7bccba20-a13f-44ac-819d-dbaa01ca8507 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] 10.222.0.15 "GET /compute/v2.1/servers/d33a2d6b-f17c-4ce3-ad33-9086d790495d" status: 200 len: 1522 microversion: 2.1 time: 0.146500 Oct 31 12:38:14.555036 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 385/752] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:38:14 2022] GET /compute/v2.1/servers/d33a2d6b-f17c-4ce3-ad33-9086d790495d => generated 1522 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:38:14.780401 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-6797bd77-b432-43e3-a1e8-33dabe1a9335 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:38:14.781060 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-6797bd77-b432-43e3-a1e8-33dabe1a9335 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] [instance: 46cae3a9-45e8-401c-b201-2ed4402e9e97] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:38:14.788145 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-6797bd77-b432-43e3-a1e8-33dabe1a9335 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:38:14.788626 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-6797bd77-b432-43e3-a1e8-33dabe1a9335 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:38:14.789053 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-6797bd77-b432-43e3-a1e8-33dabe1a9335 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:38:14.789738 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-6797bd77-b432-43e3-a1e8-33dabe1a9335 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:38:14.790184 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-6797bd77-b432-43e3-a1e8-33dabe1a9335 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:38:14.790614 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-6797bd77-b432-43e3-a1e8-33dabe1a9335 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:38:14.917645 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-6797bd77-b432-43e3-a1e8-33dabe1a9335 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c03f0365ee4a26b8c076ae365325b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfbc3a46f12942299b99cdd20c989e1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:38:14.925200 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-6797bd77-b432-43e3-a1e8-33dabe1a9335 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] 10.222.0.15 "GET /compute/v2.1/servers/46cae3a9-45e8-401c-b201-2ed4402e9e97" status: 200 len: 1683 microversion: 2.1 time: 0.148886 Oct 31 12:38:14.925770 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 368/753] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:38:14 2022] GET /compute/v2.1/servers/46cae3a9-45e8-401c-b201-2ed4402e9e97 => generated 1683 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:38:15.577715 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-e6b2e5b5-0eb8-4bf0-b691-016edbd95a47 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:38:15.578314 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-e6b2e5b5-0eb8-4bf0-b691-016edbd95a47 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] [instance: d33a2d6b-f17c-4ce3-ad33-9086d790495d] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:38:15.584585 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-e6b2e5b5-0eb8-4bf0-b691-016edbd95a47 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:38:15.585053 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-e6b2e5b5-0eb8-4bf0-b691-016edbd95a47 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:38:15.585475 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-e6b2e5b5-0eb8-4bf0-b691-016edbd95a47 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:38:15.586136 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-e6b2e5b5-0eb8-4bf0-b691-016edbd95a47 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:38:15.586584 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-e6b2e5b5-0eb8-4bf0-b691-016edbd95a47 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:38:15.586995 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-e6b2e5b5-0eb8-4bf0-b691-016edbd95a47 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:38:15.717706 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-e6b2e5b5-0eb8-4bf0-b691-016edbd95a47 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2e978bcb824a5e9d593b861c9e3bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7573cb9c503243ab90b1649591d550e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:38:15.725284 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-e6b2e5b5-0eb8-4bf0-b691-016edbd95a47 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] 10.222.0.15 "GET /compute/v2.1/servers/d33a2d6b-f17c-4ce3-ad33-9086d790495d" status: 200 len: 1522 microversion: 2.1 time: 0.151459 Oct 31 12:38:15.725853 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 386/754] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:38:15 2022] GET /compute/v2.1/servers/d33a2d6b-f17c-4ce3-ad33-9086d790495d => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:38:15.948371 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-9ab7291f-292d-4303-828e-488611b5f360 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:38:15.948973 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-9ab7291f-292d-4303-828e-488611b5f360 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] [instance: 46cae3a9-45e8-401c-b201-2ed4402e9e97] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:38:15.955393 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-9ab7291f-292d-4303-828e-488611b5f360 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:38:15.955871 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-9ab7291f-292d-4303-828e-488611b5f360 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:38:15.956297 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-9ab7291f-292d-4303-828e-488611b5f360 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:38:15.957006 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-9ab7291f-292d-4303-828e-488611b5f360 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:38:15.957453 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-9ab7291f-292d-4303-828e-488611b5f360 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:38:15.957893 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-9ab7291f-292d-4303-828e-488611b5f360 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:38:16.090026 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-9ab7291f-292d-4303-828e-488611b5f360 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c03f0365ee4a26b8c076ae365325b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfbc3a46f12942299b99cdd20c989e1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:38:16.097863 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-9ab7291f-292d-4303-828e-488611b5f360 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] 10.222.0.15 "GET /compute/v2.1/servers/46cae3a9-45e8-401c-b201-2ed4402e9e97" status: 200 len: 1683 microversion: 2.1 time: 0.153461 Oct 31 12:38:16.098440 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 369/755] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:38:15 2022] GET /compute/v2.1/servers/46cae3a9-45e8-401c-b201-2ed4402e9e97 => generated 1683 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 12:38:16.749664 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-31ace9fd-afd4-4efc-9c62-c8dee0c0b7c2 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:38:16.750810 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-31ace9fd-afd4-4efc-9c62-c8dee0c0b7c2 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] [instance: d33a2d6b-f17c-4ce3-ad33-9086d790495d] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:38:16.757333 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-31ace9fd-afd4-4efc-9c62-c8dee0c0b7c2 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:38:16.757871 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-31ace9fd-afd4-4efc-9c62-c8dee0c0b7c2 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:38:16.758354 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-31ace9fd-afd4-4efc-9c62-c8dee0c0b7c2 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:38:16.759059 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-31ace9fd-afd4-4efc-9c62-c8dee0c0b7c2 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:38:16.759558 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-31ace9fd-afd4-4efc-9c62-c8dee0c0b7c2 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:38:16.760641 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-31ace9fd-afd4-4efc-9c62-c8dee0c0b7c2 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:38:17.120272 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-8799bb7e-6d35-4e4f-975b-d1b9b87a9527 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:38:17.120794 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-8799bb7e-6d35-4e4f-975b-d1b9b87a9527 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] [instance: 46cae3a9-45e8-401c-b201-2ed4402e9e97] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:38:17.127027 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-8799bb7e-6d35-4e4f-975b-d1b9b87a9527 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:38:17.127512 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-8799bb7e-6d35-4e4f-975b-d1b9b87a9527 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:38:17.127963 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-8799bb7e-6d35-4e4f-975b-d1b9b87a9527 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:38:17.128646 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-8799bb7e-6d35-4e4f-975b-d1b9b87a9527 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:38:17.129092 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-8799bb7e-6d35-4e4f-975b-d1b9b87a9527 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:38:17.129530 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-8799bb7e-6d35-4e4f-975b-d1b9b87a9527 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:38:17.250843 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-31ace9fd-afd4-4efc-9c62-c8dee0c0b7c2 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2e978bcb824a5e9d593b861c9e3bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7573cb9c503243ab90b1649591d550e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:38:17.254363 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG dbcounter [-] [125440] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=125440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:38:17.262705 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-31ace9fd-afd4-4efc-9c62-c8dee0c0b7c2 tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] 10.222.0.15 "GET /compute/v2.1/servers/d33a2d6b-f17c-4ce3-ad33-9086d790495d" status: 200 len: 1522 microversion: 2.1 time: 0.516915 Oct 31 12:38:17.263746 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 387/756] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:38:16 2022] GET /compute/v2.1/servers/d33a2d6b-f17c-4ce3-ad33-9086d790495d => generated 1522 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:38:17.265689 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-8799bb7e-6d35-4e4f-975b-d1b9b87a9527 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c03f0365ee4a26b8c076ae365325b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfbc3a46f12942299b99cdd20c989e1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:38:17.275367 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-8799bb7e-6d35-4e4f-975b-d1b9b87a9527 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] 10.222.0.15 "GET /compute/v2.1/servers/46cae3a9-45e8-401c-b201-2ed4402e9e97" status: 200 len: 1683 microversion: 2.1 time: 0.158993 Oct 31 12:38:17.276692 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 370/757] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:38:17 2022] GET /compute/v2.1/servers/46cae3a9-45e8-401c-b201-2ed4402e9e97 => generated 1683 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 12:38:17.407271 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [req-1f8bcb7c-7013-4434-9273-637ee2ea9402 req-a98dc83d-9fa8-4038-bad0-7b95f6b3185f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d33a2d6b-f17c-4ce3-ad33-9086d790495d", "name": "network-vif-deleted", "tag": "a33f2616-bbbf-49fa-87ab-2b1769bc0111"}]} {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 12:38:17.419916 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [req-1f8bcb7c-7013-4434-9273-637ee2ea9402 req-a98dc83d-9fa8-4038-bad0-7b95f6b3185f service nova] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:38:17.420386 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [req-1f8bcb7c-7013-4434-9273-637ee2ea9402 req-a98dc83d-9fa8-4038-bad0-7b95f6b3185f service nova] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:38:17.420804 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [req-1f8bcb7c-7013-4434-9273-637ee2ea9402 req-a98dc83d-9fa8-4038-bad0-7b95f6b3185f service nova] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:38:17.432519 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.compute.server_external_events [req-1f8bcb7c-7013-4434-9273-637ee2ea9402 req-a98dc83d-9fa8-4038-bad0-7b95f6b3185f service nova] Creating event network-vif-deleted:a33f2616-bbbf-49fa-87ab-2b1769bc0111 for instance d33a2d6b-f17c-4ce3-ad33-9086d790495d on hv-cinder-79617 Oct 31 12:38:17.438458 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [req-1f8bcb7c-7013-4434-9273-637ee2ea9402 req-a98dc83d-9fa8-4038-bad0-7b95f6b3185f service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034874 Oct 31 12:38:17.440342 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 388/758] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Oct 31 12:38:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 12:38:18.285938 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-adc28b79-4b17-4477-96b4-a782a29f129d tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:38:18.286550 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-adc28b79-4b17-4477-96b4-a782a29f129d tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] [instance: d33a2d6b-f17c-4ce3-ad33-9086d790495d] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:38:18.293780 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-adc28b79-4b17-4477-96b4-a782a29f129d tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:38:18.294268 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-adc28b79-4b17-4477-96b4-a782a29f129d tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:38:18.294693 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-adc28b79-4b17-4477-96b4-a782a29f129d tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:38:18.295448 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-adc28b79-4b17-4477-96b4-a782a29f129d tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:38:18.295898 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-adc28b79-4b17-4477-96b4-a782a29f129d tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:38:18.296314 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-adc28b79-4b17-4477-96b4-a782a29f129d tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:38:18.300274 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-6874dce0-a4d7-439a-885d-f9fa44cacd32 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:38:18.301661 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-6874dce0-a4d7-439a-885d-f9fa44cacd32 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] [instance: 46cae3a9-45e8-401c-b201-2ed4402e9e97] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:38:18.308916 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-6874dce0-a4d7-439a-885d-f9fa44cacd32 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:38:18.309490 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-6874dce0-a4d7-439a-885d-f9fa44cacd32 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:38:18.310228 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-6874dce0-a4d7-439a-885d-f9fa44cacd32 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:38:18.310992 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-6874dce0-a4d7-439a-885d-f9fa44cacd32 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:38:18.311145 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.wsgi [None req-adc28b79-4b17-4477-96b4-a782a29f129d tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] HTTP exception thrown: Instance d33a2d6b-f17c-4ce3-ad33-9086d790495d could not be found. Oct 31 12:38:18.311598 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-6874dce0-a4d7-439a-885d-f9fa44cacd32 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:38:18.312174 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-6874dce0-a4d7-439a-885d-f9fa44cacd32 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:38:18.316730 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-adc28b79-4b17-4477-96b4-a782a29f129d tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Request method failure captured: Oct 31 12:38:18.316730 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: request: GET /compute/v2.1/servers/d33a2d6b-f17c-4ce3-ad33-9086d790495d HTTP/1.1 Oct 31 12:38:18.316730 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: Accept: application/json Oct 31 12:38:18.316730 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: Accept-Encoding: identity Oct 31 12:38:18.316730 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: Connection: close Oct 31 12:38:18.316730 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: Content-Length: 0 Oct 31 12:38:18.316730 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: Content-Type: application/json Oct 31 12:38:18.316730 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: Host: 10.222.0.15 Oct 31 12:38:18.316730 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: Openstack-System-Scope: None Oct 31 12:38:18.316730 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: User-Agent: python-urllib3/1.26.12 Oct 31 12:38:18.316730 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Auth-Token: gAAAAABjX8B9TbEC4h9BQ_Pg6iyHk1PnZ6xM8QTj0p7BN52PNmExSmli9L2RQnu8wsaJHiorFY0ROJy8DFUPBMj8D1dWQd22JAoLKdxFZnWHPiWQc3-KjGpPHBlTK_jmIsaeVJlcwD00sScGPd4UgCUOBwD-FKwNC8xgXuheB5YggUWlcx9L5tw Oct 31 12:38:18.316730 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Domain-Id: None Oct 31 12:38:18.316730 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Domain-Name: None Oct 31 12:38:18.316730 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Identity-Status: Confirmed Oct 31 12:38:18.316730 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Is-Admin-Project: True Oct 31 12:38:18.316730 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Project-Domain-Id: default Oct 31 12:38:18.316730 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Project-Domain-Name: Default Oct 31 12:38:18.316730 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Project-Id: 7573cb9c503243ab90b1649591d550e6 Oct 31 12:38:18.316730 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1357722577 Oct 31 12:38:18.316730 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Role: reader,member Oct 31 12:38:18.316730 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Roles: reader,member Oct 31 12:38:18.318288 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/7573cb9c503243ab90b1649591d550e6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_7573cb9c503243ab90b1649591d550e6", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/7573cb9c503243ab90b1649591d550e6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/7573cb9c503243ab90b1649591d550e6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Oct 31 12:38:18.318288 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1357722577 Oct 31 12:38:18.318288 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Tenant-Id: 7573cb9c503243ab90b1649591d550e6 Oct 31 12:38:18.318288 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1357722577 Oct 31 12:38:18.318288 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-User: tempest-ServerRescueNegativeTestJSON-1357722577-project Oct 31 12:38:18.318288 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-User-Domain-Id: default Oct 31 12:38:18.318288 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-User-Domain-Name: Default Oct 31 12:38:18.318288 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-User-Id: db2e978bcb824a5e9d593b861c9e3bd7 Oct 31 12:38:18.318288 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1357722577-project Oct 31 12:38:18.318288 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: method: > Oct 31 12:38:18.318288 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: exception: Instance d33a2d6b-f17c-4ce3-ad33-9086d790495d could not be found. Oct 31 12:38:18.318288 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: action_args: {'id': 'd33a2d6b-f17c-4ce3-ad33-9086d790495d'} Oct 31 12:38:18.319189 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 12:38:18.319189 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 12:38:18.319189 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 12:38:18.319189 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 12:38:18.319189 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 12:38:18.319189 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 12:38:18.319189 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 12:38:18.319189 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 12:38:18.319189 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 12:38:18.319189 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 12:38:18.319189 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d33a2d6b-f17c-4ce3-ad33-9086d790495d could not be found. Oct 31 12:38:18.319189 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Oct 31 12:38:18.319189 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 12:38:18.319189 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Oct 31 12:38:18.319189 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 12:38:18.319189 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 12:38:18.319189 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 12:38:18.319189 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 12:38:18.319189 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 12:38:18.319189 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 12:38:18.321076 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 12:38:18.321076 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 12:38:18.321076 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 12:38:18.321076 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 12:38:18.321076 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 12:38:18.321076 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 12:38:18.321076 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 12:38:18.321076 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d33a2d6b-f17c-4ce3-ad33-9086d790495d could not be found. Oct 31 12:38:18.321076 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Oct 31 12:38:18.321076 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 12:38:18.321076 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Oct 31 12:38:18.321076 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 12:38:18.321076 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 12:38:18.321076 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 12:38:18.321076 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 12:38:18.321076 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 12:38:18.321076 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d33a2d6b-f17c-4ce3-ad33-9086d790495d could not be found. Oct 31 12:38:18.321076 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Oct 31 12:38:18.322786 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-adc28b79-4b17-4477-96b4-a782a29f129d tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] Returning 404 to user: Instance d33a2d6b-f17c-4ce3-ad33-9086d790495d could not be found. {{(pid=125441) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 12:38:18.322786 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-adc28b79-4b17-4477-96b4-a782a29f129d tempest-ServerRescueNegativeTestJSON-1357722577 tempest-ServerRescueNegativeTestJSON-1357722577-project] 10.222.0.15 "GET /compute/v2.1/servers/d33a2d6b-f17c-4ce3-ad33-9086d790495d" status: 404 len: 111 microversion: 2.1 time: 0.032461 Oct 31 12:38:18.322786 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 371/759] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:38:18 2022] GET /compute/v2.1/servers/d33a2d6b-f17c-4ce3-ad33-9086d790495d => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 12:38:18.351633 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-6874dce0-a4d7-439a-885d-f9fa44cacd32 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:38:18.352683 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-6874dce0-a4d7-439a-885d-f9fa44cacd32 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:38:18.353929 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-6874dce0-a4d7-439a-885d-f9fa44cacd32 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:38:18.354556 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.objects.instance [None req-6874dce0-a4d7-439a-885d-f9fa44cacd32 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lazy-loading 'fault' on Instance uuid 46cae3a9-45e8-401c-b201-2ed4402e9e97 {{(pid=125440) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 12:38:18.398494 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-6874dce0-a4d7-439a-885d-f9fa44cacd32 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c03f0365ee4a26b8c076ae365325b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfbc3a46f12942299b99cdd20c989e1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:38:18.409679 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-6874dce0-a4d7-439a-885d-f9fa44cacd32 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] 10.222.0.15 "GET /compute/v2.1/servers/46cae3a9-45e8-401c-b201-2ed4402e9e97" status: 200 len: 1331 microversion: 2.1 time: 0.113591 Oct 31 12:38:18.410249 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 389/760] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:38:18 2022] GET /compute/v2.1/servers/46cae3a9-45e8-401c-b201-2ed4402e9e97 => generated 1331 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 12:38:19.434242 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-e5c15f85-218e-41f9-b0b9-a4714f049521 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:38:19.435212 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-e5c15f85-218e-41f9-b0b9-a4714f049521 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] [instance: 46cae3a9-45e8-401c-b201-2ed4402e9e97] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:38:19.443430 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-e5c15f85-218e-41f9-b0b9-a4714f049521 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:38:19.444191 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-e5c15f85-218e-41f9-b0b9-a4714f049521 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:38:19.444869 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-e5c15f85-218e-41f9-b0b9-a4714f049521 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:38:19.445714 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-e5c15f85-218e-41f9-b0b9-a4714f049521 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:38:19.446274 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-e5c15f85-218e-41f9-b0b9-a4714f049521 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:38:19.447100 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-e5c15f85-218e-41f9-b0b9-a4714f049521 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:38:19.466224 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.wsgi [None req-e5c15f85-218e-41f9-b0b9-a4714f049521 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] HTTP exception thrown: Instance 46cae3a9-45e8-401c-b201-2ed4402e9e97 could not be found. Oct 31 12:38:19.467429 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [req-d9ee0ce8-c89d-4153-b4d2-8f8fd6f4c69b req-d55b7819-235a-4f48-b629-2e83c54af6e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46cae3a9-45e8-401c-b201-2ed4402e9e97", "name": "network-vif-deleted", "tag": "81273f70-32ad-4271-bbb8-913808f06f34"}]} {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 12:38:19.468473 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-e5c15f85-218e-41f9-b0b9-a4714f049521 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Request method failure captured: Oct 31 12:38:19.468473 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: request: GET /compute/v2.1/servers/46cae3a9-45e8-401c-b201-2ed4402e9e97 HTTP/1.1 Oct 31 12:38:19.468473 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: Accept: application/json Oct 31 12:38:19.468473 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: Accept-Encoding: identity Oct 31 12:38:19.468473 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: Connection: close Oct 31 12:38:19.468473 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: Content-Length: 0 Oct 31 12:38:19.468473 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: Content-Type: application/json Oct 31 12:38:19.468473 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: Host: 10.222.0.15 Oct 31 12:38:19.468473 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: Openstack-System-Scope: None Oct 31 12:38:19.468473 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: User-Agent: python-urllib3/1.26.12 Oct 31 12:38:19.468473 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Auth-Token: gAAAAABjX8B3Et2KM1ogPCTGs64pc6xLyfMw6yL0VTQe6oSz3vb_t3Nol1y36tJUXD6PegbQ8pwIEwo4L666w1x-Z79gwUGFQzXyfvvOjyyVZQL72gtR1ISe3h09afCWKpljHfxhI1Y-A2JuAkXEjCcgQXdDq6Gsj4TA71_GeBFeeItX_0KrPQA Oct 31 12:38:19.468473 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Domain-Id: None Oct 31 12:38:19.468473 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Domain-Name: None Oct 31 12:38:19.468473 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Identity-Status: Confirmed Oct 31 12:38:19.468473 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Is-Admin-Project: True Oct 31 12:38:19.468473 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Project-Domain-Id: default Oct 31 12:38:19.468473 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Project-Domain-Name: Default Oct 31 12:38:19.468473 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Project-Id: bfbc3a46f12942299b99cdd20c989e1f Oct 31 12:38:19.468473 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Project-Name: tempest-AttachVolumeNegativeTest-1648165012 Oct 31 12:38:19.468473 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Role: reader,member Oct 31 12:38:19.468473 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Roles: reader,member Oct 31 12:38:19.469809 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/bfbc3a46f12942299b99cdd20c989e1f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_bfbc3a46f12942299b99cdd20c989e1f", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/bfbc3a46f12942299b99cdd20c989e1f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/bfbc3a46f12942299b99cdd20c989e1f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Oct 31 12:38:19.469809 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Tenant: tempest-AttachVolumeNegativeTest-1648165012 Oct 31 12:38:19.469809 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Tenant-Id: bfbc3a46f12942299b99cdd20c989e1f Oct 31 12:38:19.469809 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1648165012 Oct 31 12:38:19.469809 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-User: tempest-AttachVolumeNegativeTest-1648165012-project Oct 31 12:38:19.469809 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-User-Domain-Id: default Oct 31 12:38:19.469809 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-User-Domain-Name: Default Oct 31 12:38:19.469809 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-User-Id: b2c03f0365ee4a26b8c076ae365325b2 Oct 31 12:38:19.469809 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-User-Name: tempest-AttachVolumeNegativeTest-1648165012-project Oct 31 12:38:19.469809 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: method: > Oct 31 12:38:19.469809 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: exception: Instance 46cae3a9-45e8-401c-b201-2ed4402e9e97 could not be found. Oct 31 12:38:19.469809 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: action_args: {'id': '46cae3a9-45e8-401c-b201-2ed4402e9e97'} Oct 31 12:38:19.470569 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 12:38:19.470569 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 12:38:19.470569 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 12:38:19.470569 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 12:38:19.470569 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 12:38:19.470569 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 12:38:19.470569 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 12:38:19.470569 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 12:38:19.470569 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 12:38:19.470569 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 12:38:19.470569 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 46cae3a9-45e8-401c-b201-2ed4402e9e97 could not be found. Oct 31 12:38:19.470569 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Oct 31 12:38:19.470569 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 12:38:19.470569 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Oct 31 12:38:19.470569 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 12:38:19.470569 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 12:38:19.470569 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 12:38:19.470569 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 12:38:19.470569 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 12:38:19.470569 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 12:38:19.471920 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 12:38:19.471920 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 12:38:19.471920 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 12:38:19.471920 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 12:38:19.471920 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 12:38:19.471920 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 12:38:19.471920 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 12:38:19.471920 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 46cae3a9-45e8-401c-b201-2ed4402e9e97 could not be found. Oct 31 12:38:19.471920 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Oct 31 12:38:19.471920 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 12:38:19.471920 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Oct 31 12:38:19.471920 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 12:38:19.471920 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 12:38:19.471920 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 12:38:19.471920 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 12:38:19.471920 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 12:38:19.471920 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 46cae3a9-45e8-401c-b201-2ed4402e9e97 could not be found. Oct 31 12:38:19.471920 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Oct 31 12:38:19.474741 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-e5c15f85-218e-41f9-b0b9-a4714f049521 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Returning 404 to user: Instance 46cae3a9-45e8-401c-b201-2ed4402e9e97 could not be found. {{(pid=125441) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 12:38:19.475832 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-e5c15f85-218e-41f9-b0b9-a4714f049521 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] 10.222.0.15 "GET /compute/v2.1/servers/46cae3a9-45e8-401c-b201-2ed4402e9e97" status: 404 len: 111 microversion: 2.1 time: 0.046919 Oct 31 12:38:19.480933 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 372/761] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:38:19 2022] GET /compute/v2.1/servers/46cae3a9-45e8-401c-b201-2ed4402e9e97 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 12:38:19.486482 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-1a99e3bf-1753-4601-9757-5751177ed16e tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Calling method '.version_select at 0x7f2aa5022550>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:38:19.489025 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [req-d9ee0ce8-c89d-4153-b4d2-8f8fd6f4c69b req-d55b7819-235a-4f48-b629-2e83c54af6e6 service nova] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:38:19.489520 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [req-d9ee0ce8-c89d-4153-b4d2-8f8fd6f4c69b req-d55b7819-235a-4f48-b629-2e83c54af6e6 service nova] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:38:19.489969 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [req-d9ee0ce8-c89d-4153-b4d2-8f8fd6f4c69b req-d55b7819-235a-4f48-b629-2e83c54af6e6 service nova] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:38:19.511430 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-1a99e3bf-1753-4601-9757-5751177ed16e tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1094411431" status: 202 len: 0 microversion: 2.1 time: 0.029091 Oct 31 12:38:19.516453 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 373/762] 10.222.0.15 () {58 vars in 1221 bytes} [Mon Oct 31 12:38:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1094411431 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 12:38:19.535492 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.compute.server_external_events [req-d9ee0ce8-c89d-4153-b4d2-8f8fd6f4c69b req-d55b7819-235a-4f48-b629-2e83c54af6e6 service nova] Creating event network-vif-deleted:81273f70-32ad-4271-bbb8-913808f06f34 for instance 46cae3a9-45e8-401c-b201-2ed4402e9e97 on hv-cinder-79617 Oct 31 12:38:19.542501 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [req-d9ee0ce8-c89d-4153-b4d2-8f8fd6f4c69b req-d55b7819-235a-4f48-b629-2e83c54af6e6 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083451 Oct 31 12:38:19.543113 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 390/763] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Oct 31 12:38:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 12:38:20.210514 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-cb4aad60-e045-4270-9040-4a16caab48b3 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Action: 'create', calling method: .version_select at 0x7f2aa4ee6670>, body: {"keypair": {"name": "tempest-keypair-51787476", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCcQj3rcRwMXshDRm6vd89HkqVRW3SiA2/yE1EM9IyXt19TFZlOw74V37NrNQG/MCfD1XOsTWqzA+z+yE5c9NgC9CHZZN1Kybv2LuQE3qtbiO0wDiqudxmcLmyKcVK6dbA=="}} {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 12:38:20.234610 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.quota [None req-cb4aad60-e045-4270-9040-4a16caab48b3 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Getting quotas for project bfbc3a46f12942299b99cdd20c989e1f. Resources: {'key_pairs'} {{(pid=125441) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 12:38:20.239020 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.quota [None req-cb4aad60-e045-4270-9040-4a16caab48b3 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Getting quotas for user b2c03f0365ee4a26b8c076ae365325b2 and project bfbc3a46f12942299b99cdd20c989e1f. Resources: {'key_pairs'} {{(pid=125441) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 12:38:20.277505 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-cb4aad60-e045-4270-9040-4a16caab48b3 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.072615 Oct 31 12:38:20.278148 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 374/764] 10.222.0.15 () {60 vars in 1159 bytes} [Mon Oct 31 12:38:20 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 12:38:22.124662 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-137951eb-a2ed-49e2-894d-54fd49b8f386 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1138184801", "imageRef": "fbbea321-8f0d-4092-b070-b67a6931d610", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6630ddc4-dc53-4e5a-8b9d-7632c3075289"}], "security_groups": [{"name": "tempest-securitygroup--1976253305"}], "key_name": "tempest-keypair-51787476", "user_data": "}} {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 12:38:22.249598 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.network.neutron [None req-137951eb-a2ed-49e2-894d-54fd49b8f386 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] validate_networks() for [('6630ddc4-dc53-4e5a-8b9d-7632c3075289', None, None, None, None, None)] {{(pid=125440) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 12:38:22.737851 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.virt.hardware [None req-137951eb-a2ed-49e2-894d-54fd49b8f386 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Flavor limits 0:0:0 {{(pid=125440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 12:38:22.738268 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.virt.hardware [None req-137951eb-a2ed-49e2-894d-54fd49b8f386 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Image limits 0:0:0 {{(pid=125440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 12:38:22.738741 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.virt.hardware [None req-137951eb-a2ed-49e2-894d-54fd49b8f386 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Flavor pref 0:0:0 {{(pid=125440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 12:38:22.739146 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.virt.hardware [None req-137951eb-a2ed-49e2-894d-54fd49b8f386 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Image pref 0:0:0 {{(pid=125440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 12:38:22.739581 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.virt.hardware [None req-137951eb-a2ed-49e2-894d-54fd49b8f386 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 12:38:22.749423 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-137951eb-a2ed-49e2-894d-54fd49b8f386 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:38:22.749903 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-137951eb-a2ed-49e2-894d-54fd49b8f386 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:38:22.750604 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-137951eb-a2ed-49e2-894d-54fd49b8f386 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:38:22.751370 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-137951eb-a2ed-49e2-894d-54fd49b8f386 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:38:22.751822 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-137951eb-a2ed-49e2-894d-54fd49b8f386 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:38:22.752246 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-137951eb-a2ed-49e2-894d-54fd49b8f386 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:38:22.769524 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.quota [None req-137951eb-a2ed-49e2-894d-54fd49b8f386 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Getting quotas for project bfbc3a46f12942299b99cdd20c989e1f. Resources: {'instances', 'cores', 'ram'} {{(pid=125440) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 12:38:22.773471 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.quota [None req-137951eb-a2ed-49e2-894d-54fd49b8f386 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Getting quotas for user b2c03f0365ee4a26b8c076ae365325b2 and project bfbc3a46f12942299b99cdd20c989e1f. Resources: {'instances', 'cores', 'ram'} {{(pid=125440) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 12:38:22.783905 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG dbcounter [-] [125440] Writing DB stats nova_api:SELECT=97,nova_api:DELETE=1,nova_api:UPDATE=2 {{(pid=125440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:38:22.788087 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-137951eb-a2ed-49e2-894d-54fd49b8f386 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Going to run 1 instances... {{(pid=125440) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 12:38:22.790730 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-137951eb-a2ed-49e2-894d-54fd49b8f386 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] [instance: 0a62e143-71fb-4080-9691-fea9a84eaaca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fbbea321-8f0d-4092-b070-b67a6931d610',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125440) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 12:38:22.842995 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-137951eb-a2ed-49e2-894d-54fd49b8f386 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.723534 Oct 31 12:38:22.849886 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 391/765] 10.222.0.15 () {60 vars in 1147 bytes} [Mon Oct 31 12:38:22 2022] POST /compute/v2.1/servers => generated 402 bytes in 725 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 12:38:22.855501 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-ba1b9061-6633-45a4-a742-31d33dc40227 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:38:22.856264 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-ba1b9061-6633-45a4-a742-31d33dc40227 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] [instance: 0a62e143-71fb-4080-9691-fea9a84eaaca] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:38:22.919450 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-ba1b9061-6633-45a4-a742-31d33dc40227 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c03f0365ee4a26b8c076ae365325b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfbc3a46f12942299b99cdd20c989e1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:38:22.926065 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-ba1b9061-6633-45a4-a742-31d33dc40227 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] 10.222.0.15 "GET /compute/v2.1/servers/0a62e143-71fb-4080-9691-fea9a84eaaca" status: 200 len: 1240 microversion: 2.1 time: 0.075081 Oct 31 12:38:22.932737 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 375/766] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:38:22 2022] GET /compute/v2.1/servers/0a62e143-71fb-4080-9691-fea9a84eaaca => generated 1240 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:38:23.949806 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-3eb84129-0d3e-487b-81cf-c563e1d1360f tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:38:23.951146 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-3eb84129-0d3e-487b-81cf-c563e1d1360f tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] [instance: 0a62e143-71fb-4080-9691-fea9a84eaaca] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:38:23.959977 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-3eb84129-0d3e-487b-81cf-c563e1d1360f tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:38:23.960700 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-3eb84129-0d3e-487b-81cf-c563e1d1360f tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:38:23.961303 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-3eb84129-0d3e-487b-81cf-c563e1d1360f tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:38:23.962226 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-3eb84129-0d3e-487b-81cf-c563e1d1360f tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:38:23.963422 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-3eb84129-0d3e-487b-81cf-c563e1d1360f tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:38:23.964006 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-3eb84129-0d3e-487b-81cf-c563e1d1360f tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:38:24.036282 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-3eb84129-0d3e-487b-81cf-c563e1d1360f tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c03f0365ee4a26b8c076ae365325b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfbc3a46f12942299b99cdd20c989e1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:38:24.044103 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-3eb84129-0d3e-487b-81cf-c563e1d1360f tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] 10.222.0.15 "GET /compute/v2.1/servers/0a62e143-71fb-4080-9691-fea9a84eaaca" status: 200 len: 1292 microversion: 2.1 time: 0.098689 Oct 31 12:38:24.045054 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 392/767] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:38:23 2022] GET /compute/v2.1/servers/0a62e143-71fb-4080-9691-fea9a84eaaca => generated 1292 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:38:25.068056 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-f52f903d-4721-49af-a193-94bbee29d865 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:38:25.068669 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-f52f903d-4721-49af-a193-94bbee29d865 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] [instance: 0a62e143-71fb-4080-9691-fea9a84eaaca] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:38:25.076617 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-f52f903d-4721-49af-a193-94bbee29d865 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:38:25.077089 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-f52f903d-4721-49af-a193-94bbee29d865 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:38:25.077575 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-f52f903d-4721-49af-a193-94bbee29d865 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:38:25.078354 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-f52f903d-4721-49af-a193-94bbee29d865 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:38:25.078843 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-f52f903d-4721-49af-a193-94bbee29d865 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:38:25.079324 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-f52f903d-4721-49af-a193-94bbee29d865 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:38:25.221337 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-f52f903d-4721-49af-a193-94bbee29d865 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c03f0365ee4a26b8c076ae365325b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfbc3a46f12942299b99cdd20c989e1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:38:25.230205 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-f52f903d-4721-49af-a193-94bbee29d865 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] 10.222.0.15 "GET /compute/v2.1/servers/0a62e143-71fb-4080-9691-fea9a84eaaca" status: 200 len: 1366 microversion: 2.1 time: 0.165985 Oct 31 12:38:25.230866 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 376/768] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:38:25 2022] GET /compute/v2.1/servers/0a62e143-71fb-4080-9691-fea9a84eaaca => generated 1366 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:38:26.254141 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-50ca5a90-ba49-49d9-8c12-5faad908979a tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:38:26.255426 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-50ca5a90-ba49-49d9-8c12-5faad908979a tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] [instance: 0a62e143-71fb-4080-9691-fea9a84eaaca] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:38:26.261653 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-50ca5a90-ba49-49d9-8c12-5faad908979a tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:38:26.262127 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-50ca5a90-ba49-49d9-8c12-5faad908979a tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:38:26.262594 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-50ca5a90-ba49-49d9-8c12-5faad908979a tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:38:26.263542 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-50ca5a90-ba49-49d9-8c12-5faad908979a tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:38:26.264142 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-50ca5a90-ba49-49d9-8c12-5faad908979a tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:38:26.264694 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-50ca5a90-ba49-49d9-8c12-5faad908979a tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:38:26.490267 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-50ca5a90-ba49-49d9-8c12-5faad908979a tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c03f0365ee4a26b8c076ae365325b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfbc3a46f12942299b99cdd20c989e1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:38:26.500013 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-50ca5a90-ba49-49d9-8c12-5faad908979a tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] 10.222.0.15 "GET /compute/v2.1/servers/0a62e143-71fb-4080-9691-fea9a84eaaca" status: 200 len: 1366 microversion: 2.1 time: 0.249773 Oct 31 12:38:26.500603 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 393/769] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:38:26 2022] GET /compute/v2.1/servers/0a62e143-71fb-4080-9691-fea9a84eaaca => generated 1366 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:38:26.785518 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [req-c235ea76-25c8-4935-8c53-867a897bbdd7 req-4ddc3c4c-0404-4350-bcd7-38a269d5a79c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a62e143-71fb-4080-9691-fea9a84eaaca", "tag": "49446827-3823-4653-b9b1-9419ae249ec6"}]} {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 12:38:26.795733 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [req-c235ea76-25c8-4935-8c53-867a897bbdd7 req-4ddc3c4c-0404-4350-bcd7-38a269d5a79c service nova] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:38:26.796519 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [req-c235ea76-25c8-4935-8c53-867a897bbdd7 req-4ddc3c4c-0404-4350-bcd7-38a269d5a79c service nova] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:38:26.797172 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [req-c235ea76-25c8-4935-8c53-867a897bbdd7 req-4ddc3c4c-0404-4350-bcd7-38a269d5a79c service nova] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:38:26.808451 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.compute.server_external_events [req-c235ea76-25c8-4935-8c53-867a897bbdd7 req-4ddc3c4c-0404-4350-bcd7-38a269d5a79c service nova] Creating event network-changed:49446827-3823-4653-b9b1-9419ae249ec6 for instance 0a62e143-71fb-4080-9691-fea9a84eaaca on hv-cinder-79617 Oct 31 12:38:26.814578 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [req-c235ea76-25c8-4935-8c53-867a897bbdd7 req-4ddc3c4c-0404-4350-bcd7-38a269d5a79c service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.181673 Oct 31 12:38:26.815778 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 377/770] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Oct 31 12:38:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 12:38:27.525487 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-84d9026d-233e-47a3-8082-bac949435abb tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:38:27.526216 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-84d9026d-233e-47a3-8082-bac949435abb tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] [instance: 0a62e143-71fb-4080-9691-fea9a84eaaca] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:38:27.532491 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-84d9026d-233e-47a3-8082-bac949435abb tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:38:27.532997 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-84d9026d-233e-47a3-8082-bac949435abb tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:38:27.533426 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-84d9026d-233e-47a3-8082-bac949435abb tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:38:27.534110 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-84d9026d-233e-47a3-8082-bac949435abb tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:38:27.534586 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-84d9026d-233e-47a3-8082-bac949435abb tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:38:27.535003 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-84d9026d-233e-47a3-8082-bac949435abb tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:38:27.672223 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-84d9026d-233e-47a3-8082-bac949435abb tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c03f0365ee4a26b8c076ae365325b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfbc3a46f12942299b99cdd20c989e1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:38:27.679702 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-84d9026d-233e-47a3-8082-bac949435abb tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] 10.222.0.15 "GET /compute/v2.1/servers/0a62e143-71fb-4080-9691-fea9a84eaaca" status: 200 len: 1366 microversion: 2.1 time: 0.158193 Oct 31 12:38:27.680449 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 394/771] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:38:27 2022] GET /compute/v2.1/servers/0a62e143-71fb-4080-9691-fea9a84eaaca => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:38:28.704456 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-4e95b1ba-017b-4800-9889-74dabe5b4a49 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:38:28.705200 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-4e95b1ba-017b-4800-9889-74dabe5b4a49 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] [instance: 0a62e143-71fb-4080-9691-fea9a84eaaca] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:38:28.711221 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-4e95b1ba-017b-4800-9889-74dabe5b4a49 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:38:28.711702 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-4e95b1ba-017b-4800-9889-74dabe5b4a49 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:38:28.712195 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-4e95b1ba-017b-4800-9889-74dabe5b4a49 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:38:28.712886 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-4e95b1ba-017b-4800-9889-74dabe5b4a49 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:38:28.713523 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-4e95b1ba-017b-4800-9889-74dabe5b4a49 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:38:28.713947 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-4e95b1ba-017b-4800-9889-74dabe5b4a49 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:38:28.854863 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-4e95b1ba-017b-4800-9889-74dabe5b4a49 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c03f0365ee4a26b8c076ae365325b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfbc3a46f12942299b99cdd20c989e1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:38:28.863681 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-4e95b1ba-017b-4800-9889-74dabe5b4a49 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] 10.222.0.15 "GET /compute/v2.1/servers/0a62e143-71fb-4080-9691-fea9a84eaaca" status: 200 len: 1366 microversion: 2.1 time: 0.163812 Oct 31 12:38:28.864539 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 378/772] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:38:28 2022] GET /compute/v2.1/servers/0a62e143-71fb-4080-9691-fea9a84eaaca => generated 1366 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:38:29.106402 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-161b09fe-8361-4234-832c-890ec1139bb5 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:38:29.106965 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-161b09fe-8361-4234-832c-890ec1139bb5 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] [instance: b3800adf-8cae-407e-9a5e-9eb107bff58d] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:38:29.113071 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-161b09fe-8361-4234-832c-890ec1139bb5 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:38:29.113548 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-161b09fe-8361-4234-832c-890ec1139bb5 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:38:29.113977 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-161b09fe-8361-4234-832c-890ec1139bb5 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:38:29.114664 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-161b09fe-8361-4234-832c-890ec1139bb5 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:38:29.115118 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-161b09fe-8361-4234-832c-890ec1139bb5 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:38:29.115565 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-161b09fe-8361-4234-832c-890ec1139bb5 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:38:29.139554 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-161b09fe-8361-4234-832c-890ec1139bb5 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] 10.222.0.15 "GET /compute/v2.1/servers/b3800adf-8cae-407e-9a5e-9eb107bff58d/ips" status: 200 len: 152 microversion: 2.20 time: 0.276731 Oct 31 12:38:29.140111 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 395/773] 10.222.0.15 () {60 vars in 1289 bytes} [Mon Oct 31 12:38:28 2022] GET /compute/v2.1/servers/b3800adf-8cae-407e-9a5e-9eb107bff58d/ips => generated 152 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 12:38:29.887378 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-a22fa130-01e0-4c98-b7cf-453ed12fd9be tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:38:29.887992 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-a22fa130-01e0-4c98-b7cf-453ed12fd9be tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] [instance: 0a62e143-71fb-4080-9691-fea9a84eaaca] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:38:29.894744 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-a22fa130-01e0-4c98-b7cf-453ed12fd9be tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:38:29.895243 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-a22fa130-01e0-4c98-b7cf-453ed12fd9be tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:38:29.895672 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-a22fa130-01e0-4c98-b7cf-453ed12fd9be tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:38:29.896362 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-a22fa130-01e0-4c98-b7cf-453ed12fd9be tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:38:29.896812 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-a22fa130-01e0-4c98-b7cf-453ed12fd9be tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:38:29.897234 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-a22fa130-01e0-4c98-b7cf-453ed12fd9be tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:38:29.901630 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG dbcounter [-] [125441] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=125441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:38:30.032593 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-a22fa130-01e0-4c98-b7cf-453ed12fd9be tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c03f0365ee4a26b8c076ae365325b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfbc3a46f12942299b99cdd20c989e1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:38:30.040344 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-a22fa130-01e0-4c98-b7cf-453ed12fd9be tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] 10.222.0.15 "GET /compute/v2.1/servers/0a62e143-71fb-4080-9691-fea9a84eaaca" status: 200 len: 1366 microversion: 2.1 time: 0.157255 Oct 31 12:38:30.040958 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 379/774] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:38:29 2022] GET /compute/v2.1/servers/0a62e143-71fb-4080-9691-fea9a84eaaca => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:38:30.224644 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [req-d3e2b756-7e7b-44dc-902f-1c17b55a9da7 req-0d402a41-080d-4fc7-8ec5-d22f7e4b9610 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a62e143-71fb-4080-9691-fea9a84eaaca", "name": "network-vif-plugged", "status": "completed", "tag": "49446827-3823-4653-b9b1-9419ae249ec6"}]} {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 12:38:30.235282 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [req-d3e2b756-7e7b-44dc-902f-1c17b55a9da7 req-0d402a41-080d-4fc7-8ec5-d22f7e4b9610 service nova] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:38:30.235969 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [req-d3e2b756-7e7b-44dc-902f-1c17b55a9da7 req-0d402a41-080d-4fc7-8ec5-d22f7e4b9610 service nova] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:38:30.236616 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [req-d3e2b756-7e7b-44dc-902f-1c17b55a9da7 req-0d402a41-080d-4fc7-8ec5-d22f7e4b9610 service nova] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:38:30.247921 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.compute.server_external_events [req-d3e2b756-7e7b-44dc-902f-1c17b55a9da7 req-0d402a41-080d-4fc7-8ec5-d22f7e4b9610 service nova] Creating event network-vif-plugged:49446827-3823-4653-b9b1-9419ae249ec6 for instance 0a62e143-71fb-4080-9691-fea9a84eaaca on hv-cinder-79617 Oct 31 12:38:30.252717 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [req-d3e2b756-7e7b-44dc-902f-1c17b55a9da7 req-0d402a41-080d-4fc7-8ec5-d22f7e4b9610 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031682 Oct 31 12:38:30.253576 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 396/775] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Oct 31 12:38:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 12:38:31.036960 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-c6e1eaf3-9d59-4409-9cff-2e16cd1420b2 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 12:38:31.037554 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-c6e1eaf3-9d59-4409-9cff-2e16cd1420b2 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] [instance: b3800adf-8cae-407e-9a5e-9eb107bff58d] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:38:31.043961 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-c6e1eaf3-9d59-4409-9cff-2e16cd1420b2 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:38:31.044514 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-c6e1eaf3-9d59-4409-9cff-2e16cd1420b2 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:38:31.044945 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-c6e1eaf3-9d59-4409-9cff-2e16cd1420b2 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:38:31.045648 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-c6e1eaf3-9d59-4409-9cff-2e16cd1420b2 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:38:31.046101 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-c6e1eaf3-9d59-4409-9cff-2e16cd1420b2 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:38:31.046515 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-c6e1eaf3-9d59-4409-9cff-2e16cd1420b2 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:38:31.065175 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-abac3ea6-8b63-4aa0-8ba5-7b818c994189 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:38:31.066160 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-abac3ea6-8b63-4aa0-8ba5-7b818c994189 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] [instance: 0a62e143-71fb-4080-9691-fea9a84eaaca] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:38:31.070451 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.objects.instance [None req-c6e1eaf3-9d59-4409-9cff-2e16cd1420b2 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lazy-loading 'flavor' on Instance uuid b3800adf-8cae-407e-9a5e-9eb107bff58d {{(pid=125441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 12:38:31.073432 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-abac3ea6-8b63-4aa0-8ba5-7b818c994189 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:38:31.073912 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-abac3ea6-8b63-4aa0-8ba5-7b818c994189 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:38:31.074575 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-abac3ea6-8b63-4aa0-8ba5-7b818c994189 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:38:31.075405 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-abac3ea6-8b63-4aa0-8ba5-7b818c994189 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:38:31.075925 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-abac3ea6-8b63-4aa0-8ba5-7b818c994189 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:38:31.076347 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-abac3ea6-8b63-4aa0-8ba5-7b818c994189 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:38:31.256086 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-abac3ea6-8b63-4aa0-8ba5-7b818c994189 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c03f0365ee4a26b8c076ae365325b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfbc3a46f12942299b99cdd20c989e1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:38:31.265073 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-abac3ea6-8b63-4aa0-8ba5-7b818c994189 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] 10.222.0.15 "GET /compute/v2.1/servers/0a62e143-71fb-4080-9691-fea9a84eaaca" status: 200 len: 1366 microversion: 2.1 time: 0.204442 Oct 31 12:38:31.265915 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 397/776] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:38:31 2022] GET /compute/v2.1/servers/0a62e143-71fb-4080-9691-fea9a84eaaca => generated 1366 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 12:38:31.279907 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-c6e1eaf3-9d59-4409-9cff-2e16cd1420b2 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] 10.222.0.15 "POST /compute/v2.1/servers/b3800adf-8cae-407e-9a5e-9eb107bff58d/action" status: 202 len: 0 microversion: 2.20 time: 0.246460 Oct 31 12:38:31.283709 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 380/777] 10.222.0.15 () {62 vars in 1319 bytes} [Mon Oct 31 12:38:31 2022] POST /compute/v2.1/servers/b3800adf-8cae-407e-9a5e-9eb107bff58d/action => generated 0 bytes in 248 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 31 12:38:31.289276 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-0c4973cc-b8b2-4a1e-bea9-d338083d6b78 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:38:31.289747 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-0c4973cc-b8b2-4a1e-bea9-d338083d6b78 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] [instance: b3800adf-8cae-407e-9a5e-9eb107bff58d] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:38:31.297205 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-0c4973cc-b8b2-4a1e-bea9-d338083d6b78 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:38:31.297709 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-0c4973cc-b8b2-4a1e-bea9-d338083d6b78 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:38:31.298138 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-0c4973cc-b8b2-4a1e-bea9-d338083d6b78 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:38:31.298834 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-0c4973cc-b8b2-4a1e-bea9-d338083d6b78 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:38:31.299317 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-0c4973cc-b8b2-4a1e-bea9-d338083d6b78 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:38:31.299738 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-0c4973cc-b8b2-4a1e-bea9-d338083d6b78 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:38:31.434049 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-0c4973cc-b8b2-4a1e-bea9-d338083d6b78 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:38:31.442544 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-0c4973cc-b8b2-4a1e-bea9-d338083d6b78 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:38:31.444337 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-0c4973cc-b8b2-4a1e-bea9-d338083d6b78 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:38:31.445715 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-0c4973cc-b8b2-4a1e-bea9-d338083d6b78 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] 10.222.0.15 "GET /compute/v2.1/servers/b3800adf-8cae-407e-9a5e-9eb107bff58d" status: 200 len: 1724 microversion: 2.20 time: 0.160708 Oct 31 12:38:31.446587 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 398/778] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Oct 31 12:38:31 2022] GET /compute/v2.1/servers/b3800adf-8cae-407e-9a5e-9eb107bff58d => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 12:38:32.292275 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-36962b7a-2dec-4e06-b827-042bbd123725 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:38:32.293648 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-36962b7a-2dec-4e06-b827-042bbd123725 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] [instance: 0a62e143-71fb-4080-9691-fea9a84eaaca] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:38:32.300940 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-36962b7a-2dec-4e06-b827-042bbd123725 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:38:32.301421 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-36962b7a-2dec-4e06-b827-042bbd123725 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:38:32.302046 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-36962b7a-2dec-4e06-b827-042bbd123725 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:38:32.302842 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-36962b7a-2dec-4e06-b827-042bbd123725 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:38:32.303480 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-36962b7a-2dec-4e06-b827-042bbd123725 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:38:32.303896 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-36962b7a-2dec-4e06-b827-042bbd123725 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:38:32.441502 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-36962b7a-2dec-4e06-b827-042bbd123725 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c03f0365ee4a26b8c076ae365325b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfbc3a46f12942299b99cdd20c989e1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:38:32.451417 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-36962b7a-2dec-4e06-b827-042bbd123725 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] 10.222.0.15 "GET /compute/v2.1/servers/0a62e143-71fb-4080-9691-fea9a84eaaca" status: 200 len: 1556 microversion: 2.1 time: 0.164909 Oct 31 12:38:32.452151 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 381/779] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:38:32 2022] GET /compute/v2.1/servers/0a62e143-71fb-4080-9691-fea9a84eaaca => generated 1556 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:38:32.473851 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-597509ef-5507-4d1b-9bc1-39696292d990 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:38:32.473851 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-597509ef-5507-4d1b-9bc1-39696292d990 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] [instance: b3800adf-8cae-407e-9a5e-9eb107bff58d] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:38:32.476819 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-ac728a2e-2cae-4e69-b007-b4887bbdaa0c tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:38:32.477315 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-ac728a2e-2cae-4e69-b007-b4887bbdaa0c tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] [instance: 0a62e143-71fb-4080-9691-fea9a84eaaca] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:38:32.480713 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-597509ef-5507-4d1b-9bc1-39696292d990 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:38:32.481321 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-597509ef-5507-4d1b-9bc1-39696292d990 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:38:32.481842 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-597509ef-5507-4d1b-9bc1-39696292d990 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:38:32.482630 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-597509ef-5507-4d1b-9bc1-39696292d990 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:38:32.483185 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-597509ef-5507-4d1b-9bc1-39696292d990 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:38:32.483709 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-597509ef-5507-4d1b-9bc1-39696292d990 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:38:32.484318 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-ac728a2e-2cae-4e69-b007-b4887bbdaa0c tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:38:32.484856 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-ac728a2e-2cae-4e69-b007-b4887bbdaa0c tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:38:32.485293 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-ac728a2e-2cae-4e69-b007-b4887bbdaa0c tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:38:32.486190 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-ac728a2e-2cae-4e69-b007-b4887bbdaa0c tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:38:32.486646 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-ac728a2e-2cae-4e69-b007-b4887bbdaa0c tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:38:32.487277 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-ac728a2e-2cae-4e69-b007-b4887bbdaa0c tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:38:32.575896 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-ac728a2e-2cae-4e69-b007-b4887bbdaa0c tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] 10.222.0.15 "GET /compute/v2.1/servers/0a62e143-71fb-4080-9691-fea9a84eaaca/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.103387 Oct 31 12:38:32.576495 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 382/780] 10.222.0.15 () {58 vars in 1275 bytes} [Mon Oct 31 12:38:32 2022] GET /compute/v2.1/servers/0a62e143-71fb-4080-9691-fea9a84eaaca/os-interface => generated 284 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 12:38:32.633771 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-597509ef-5507-4d1b-9bc1-39696292d990 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:38:32.643648 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-597509ef-5507-4d1b-9bc1-39696292d990 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:38:32.645342 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-597509ef-5507-4d1b-9bc1-39696292d990 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:38:32.646496 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-597509ef-5507-4d1b-9bc1-39696292d990 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] 10.222.0.15 "GET /compute/v2.1/servers/b3800adf-8cae-407e-9a5e-9eb107bff58d" status: 200 len: 1724 microversion: 2.20 time: 0.178848 Oct 31 12:38:32.647256 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 399/781] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Oct 31 12:38:32 2022] GET /compute/v2.1/servers/b3800adf-8cae-407e-9a5e-9eb107bff58d => generated 1724 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 12:38:33.549011 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG dbcounter [-] [125441] Writing DB stats nova_cell0:SELECT=6 {{(pid=125441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:38:33.673587 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-db0ca777-9d28-4397-aefc-b58427bd755e tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:38:33.675227 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-db0ca777-9d28-4397-aefc-b58427bd755e tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] [instance: b3800adf-8cae-407e-9a5e-9eb107bff58d] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:38:33.678800 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [req-d96378b8-c469-488a-a295-c81dcfd6c658 req-63ed9e39-45ee-40f7-aafa-934d3820baba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a62e143-71fb-4080-9691-fea9a84eaaca", "tag": "49446827-3823-4653-b9b1-9419ae249ec6"}]} {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 12:38:33.681600 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG dbcounter [-] [125440] Writing DB stats nova_cell0:SELECT=2 {{(pid=125440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:38:33.682629 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG dbcounter [-] [125440] Writing DB stats nova_cell0:SELECT=6 {{(pid=125440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:38:33.685915 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-db0ca777-9d28-4397-aefc-b58427bd755e tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:38:33.686520 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-db0ca777-9d28-4397-aefc-b58427bd755e tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:38:33.687054 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-db0ca777-9d28-4397-aefc-b58427bd755e tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:38:33.687887 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-db0ca777-9d28-4397-aefc-b58427bd755e tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:38:33.688435 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-db0ca777-9d28-4397-aefc-b58427bd755e tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:38:33.688949 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-db0ca777-9d28-4397-aefc-b58427bd755e tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:38:33.689530 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [req-d96378b8-c469-488a-a295-c81dcfd6c658 req-63ed9e39-45ee-40f7-aafa-934d3820baba service nova] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:38:33.689997 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [req-d96378b8-c469-488a-a295-c81dcfd6c658 req-63ed9e39-45ee-40f7-aafa-934d3820baba service nova] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:38:33.690586 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [req-d96378b8-c469-488a-a295-c81dcfd6c658 req-63ed9e39-45ee-40f7-aafa-934d3820baba service nova] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:38:33.702690 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.compute.server_external_events [req-d96378b8-c469-488a-a295-c81dcfd6c658 req-63ed9e39-45ee-40f7-aafa-934d3820baba service nova] Creating event network-changed:49446827-3823-4653-b9b1-9419ae249ec6 for instance 0a62e143-71fb-4080-9691-fea9a84eaaca on hv-cinder-79617 Oct 31 12:38:33.707745 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [req-d96378b8-c469-488a-a295-c81dcfd6c658 req-63ed9e39-45ee-40f7-aafa-934d3820baba service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.159355 Oct 31 12:38:33.708343 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 383/782] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Oct 31 12:38:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 12:38:33.885963 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-db0ca777-9d28-4397-aefc-b58427bd755e tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:38:33.894920 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-db0ca777-9d28-4397-aefc-b58427bd755e tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:38:33.896540 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-db0ca777-9d28-4397-aefc-b58427bd755e tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:38:33.897824 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-db0ca777-9d28-4397-aefc-b58427bd755e tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] 10.222.0.15 "GET /compute/v2.1/servers/b3800adf-8cae-407e-9a5e-9eb107bff58d" status: 200 len: 1724 microversion: 2.20 time: 0.228368 Oct 31 12:38:33.898497 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 400/783] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Oct 31 12:38:33 2022] GET /compute/v2.1/servers/b3800adf-8cae-407e-9a5e-9eb107bff58d => generated 1724 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 12:38:34.924676 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-847b8af7-5405-49d8-ad1f-74c6383ad27d tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:38:34.925392 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-847b8af7-5405-49d8-ad1f-74c6383ad27d tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] [instance: b3800adf-8cae-407e-9a5e-9eb107bff58d] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:38:34.932665 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-847b8af7-5405-49d8-ad1f-74c6383ad27d tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:38:34.933143 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-847b8af7-5405-49d8-ad1f-74c6383ad27d tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:38:34.933568 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-847b8af7-5405-49d8-ad1f-74c6383ad27d tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:38:34.934245 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-847b8af7-5405-49d8-ad1f-74c6383ad27d tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:38:34.934684 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-847b8af7-5405-49d8-ad1f-74c6383ad27d tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:38:34.935097 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-847b8af7-5405-49d8-ad1f-74c6383ad27d tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:38:35.074772 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-847b8af7-5405-49d8-ad1f-74c6383ad27d tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:38:35.082971 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-847b8af7-5405-49d8-ad1f-74c6383ad27d tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:38:35.084456 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-847b8af7-5405-49d8-ad1f-74c6383ad27d tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:38:35.085690 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-847b8af7-5405-49d8-ad1f-74c6383ad27d tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] 10.222.0.15 "GET /compute/v2.1/servers/b3800adf-8cae-407e-9a5e-9eb107bff58d" status: 200 len: 1724 microversion: 2.20 time: 0.165157 Oct 31 12:38:35.086253 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 384/784] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Oct 31 12:38:34 2022] GET /compute/v2.1/servers/b3800adf-8cae-407e-9a5e-9eb107bff58d => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 12:38:36.113157 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-fdafe678-dbeb-4300-9da0-cc2d1732fd69 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:38:36.113749 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-fdafe678-dbeb-4300-9da0-cc2d1732fd69 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] [instance: b3800adf-8cae-407e-9a5e-9eb107bff58d] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:38:36.120153 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-fdafe678-dbeb-4300-9da0-cc2d1732fd69 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:38:36.120656 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-fdafe678-dbeb-4300-9da0-cc2d1732fd69 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:38:36.121056 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-fdafe678-dbeb-4300-9da0-cc2d1732fd69 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:38:36.121759 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-fdafe678-dbeb-4300-9da0-cc2d1732fd69 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:38:36.122199 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-fdafe678-dbeb-4300-9da0-cc2d1732fd69 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:38:36.122607 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-fdafe678-dbeb-4300-9da0-cc2d1732fd69 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:38:36.253056 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-fdafe678-dbeb-4300-9da0-cc2d1732fd69 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:38:36.261309 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-fdafe678-dbeb-4300-9da0-cc2d1732fd69 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:38:36.262813 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-fdafe678-dbeb-4300-9da0-cc2d1732fd69 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:38:36.264074 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-fdafe678-dbeb-4300-9da0-cc2d1732fd69 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] 10.222.0.15 "GET /compute/v2.1/servers/b3800adf-8cae-407e-9a5e-9eb107bff58d" status: 200 len: 1724 microversion: 2.20 time: 0.154823 Oct 31 12:38:36.264631 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 401/785] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Oct 31 12:38:36 2022] GET /compute/v2.1/servers/b3800adf-8cae-407e-9a5e-9eb107bff58d => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 12:38:37.291224 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-0f331296-c63b-4fce-8e97-9eb81c60cc86 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:38:37.291835 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-0f331296-c63b-4fce-8e97-9eb81c60cc86 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] [instance: b3800adf-8cae-407e-9a5e-9eb107bff58d] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:38:37.298194 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-0f331296-c63b-4fce-8e97-9eb81c60cc86 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:38:37.298692 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-0f331296-c63b-4fce-8e97-9eb81c60cc86 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:38:37.299107 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-0f331296-c63b-4fce-8e97-9eb81c60cc86 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:38:37.299811 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-0f331296-c63b-4fce-8e97-9eb81c60cc86 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:38:37.300260 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-0f331296-c63b-4fce-8e97-9eb81c60cc86 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:38:37.300688 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-0f331296-c63b-4fce-8e97-9eb81c60cc86 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:38:37.591147 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-0f331296-c63b-4fce-8e97-9eb81c60cc86 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:38:37.599765 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-0f331296-c63b-4fce-8e97-9eb81c60cc86 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:38:37.601278 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-0f331296-c63b-4fce-8e97-9eb81c60cc86 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:38:37.602478 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-0f331296-c63b-4fce-8e97-9eb81c60cc86 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] 10.222.0.15 "GET /compute/v2.1/servers/b3800adf-8cae-407e-9a5e-9eb107bff58d" status: 200 len: 1724 microversion: 2.20 time: 0.315798 Oct 31 12:38:37.604253 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 385/786] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Oct 31 12:38:37 2022] GET /compute/v2.1/servers/b3800adf-8cae-407e-9a5e-9eb107bff58d => generated 1724 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 12:38:38.629541 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-6174f135-47fa-476d-8e0b-c576795e8400 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:38:38.630273 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-6174f135-47fa-476d-8e0b-c576795e8400 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] [instance: b3800adf-8cae-407e-9a5e-9eb107bff58d] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:38:38.637341 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-6174f135-47fa-476d-8e0b-c576795e8400 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:38:38.637810 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-6174f135-47fa-476d-8e0b-c576795e8400 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:38:38.638233 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-6174f135-47fa-476d-8e0b-c576795e8400 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:38:38.638912 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-6174f135-47fa-476d-8e0b-c576795e8400 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:38:38.639386 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-6174f135-47fa-476d-8e0b-c576795e8400 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:38:38.639796 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-6174f135-47fa-476d-8e0b-c576795e8400 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:38:38.773177 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-6174f135-47fa-476d-8e0b-c576795e8400 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:38:38.781765 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-6174f135-47fa-476d-8e0b-c576795e8400 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:38:38.783375 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-6174f135-47fa-476d-8e0b-c576795e8400 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:38:38.784608 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-6174f135-47fa-476d-8e0b-c576795e8400 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] 10.222.0.15 "GET /compute/v2.1/servers/b3800adf-8cae-407e-9a5e-9eb107bff58d" status: 200 len: 1724 microversion: 2.20 time: 0.158849 Oct 31 12:38:38.785189 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 402/787] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Oct 31 12:38:38 2022] GET /compute/v2.1/servers/b3800adf-8cae-407e-9a5e-9eb107bff58d => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 12:38:39.810308 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-5579d4a7-882f-4460-a961-60d0afe87aa7 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:38:39.811222 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-5579d4a7-882f-4460-a961-60d0afe87aa7 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] [instance: b3800adf-8cae-407e-9a5e-9eb107bff58d] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:38:39.818083 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-5579d4a7-882f-4460-a961-60d0afe87aa7 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:38:39.818209 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-5579d4a7-882f-4460-a961-60d0afe87aa7 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:38:39.818789 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-5579d4a7-882f-4460-a961-60d0afe87aa7 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:38:39.819509 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-5579d4a7-882f-4460-a961-60d0afe87aa7 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:38:39.819965 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-5579d4a7-882f-4460-a961-60d0afe87aa7 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:38:39.820383 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-5579d4a7-882f-4460-a961-60d0afe87aa7 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:38:39.971089 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-5579d4a7-882f-4460-a961-60d0afe87aa7 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:38:39.980437 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-5579d4a7-882f-4460-a961-60d0afe87aa7 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:38:39.981881 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-5579d4a7-882f-4460-a961-60d0afe87aa7 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:38:39.983040 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-5579d4a7-882f-4460-a961-60d0afe87aa7 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] 10.222.0.15 "GET /compute/v2.1/servers/b3800adf-8cae-407e-9a5e-9eb107bff58d" status: 200 len: 1724 microversion: 2.20 time: 0.176550 Oct 31 12:38:39.983621 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 386/788] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Oct 31 12:38:39 2022] GET /compute/v2.1/servers/b3800adf-8cae-407e-9a5e-9eb107bff58d => generated 1724 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 12:38:41.008219 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-a964b4f3-6b33-4ce3-b41c-41f3ae38fec8 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:38:41.008856 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-a964b4f3-6b33-4ce3-b41c-41f3ae38fec8 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] [instance: b3800adf-8cae-407e-9a5e-9eb107bff58d] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:38:41.017992 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-a964b4f3-6b33-4ce3-b41c-41f3ae38fec8 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:38:41.018479 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-a964b4f3-6b33-4ce3-b41c-41f3ae38fec8 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:38:41.019144 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-a964b4f3-6b33-4ce3-b41c-41f3ae38fec8 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:38:41.020083 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-a964b4f3-6b33-4ce3-b41c-41f3ae38fec8 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:38:41.020649 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-a964b4f3-6b33-4ce3-b41c-41f3ae38fec8 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:38:41.021203 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-a964b4f3-6b33-4ce3-b41c-41f3ae38fec8 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:38:41.162269 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-a964b4f3-6b33-4ce3-b41c-41f3ae38fec8 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:38:41.172023 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-a964b4f3-6b33-4ce3-b41c-41f3ae38fec8 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:38:41.176882 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-a964b4f3-6b33-4ce3-b41c-41f3ae38fec8 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:38:41.178063 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-a964b4f3-6b33-4ce3-b41c-41f3ae38fec8 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] 10.222.0.15 "GET /compute/v2.1/servers/b3800adf-8cae-407e-9a5e-9eb107bff58d" status: 200 len: 1724 microversion: 2.20 time: 0.173766 Oct 31 12:38:41.178756 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 403/789] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Oct 31 12:38:41 2022] GET /compute/v2.1/servers/b3800adf-8cae-407e-9a5e-9eb107bff58d => generated 1724 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 12:38:42.205377 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-783cecb8-1e1a-4738-b3ad-f26fbe30445f tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:38:42.205985 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-783cecb8-1e1a-4738-b3ad-f26fbe30445f tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] [instance: b3800adf-8cae-407e-9a5e-9eb107bff58d] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:38:42.208417 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG dbcounter [-] [125441] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=125441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:38:42.213860 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-783cecb8-1e1a-4738-b3ad-f26fbe30445f tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:38:42.214334 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-783cecb8-1e1a-4738-b3ad-f26fbe30445f tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:38:42.214763 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-783cecb8-1e1a-4738-b3ad-f26fbe30445f tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:38:42.215476 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-783cecb8-1e1a-4738-b3ad-f26fbe30445f tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:38:42.215931 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-783cecb8-1e1a-4738-b3ad-f26fbe30445f tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:38:42.216353 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-783cecb8-1e1a-4738-b3ad-f26fbe30445f tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:38:42.346166 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-783cecb8-1e1a-4738-b3ad-f26fbe30445f tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:38:42.355301 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-783cecb8-1e1a-4738-b3ad-f26fbe30445f tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:38:42.356764 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-783cecb8-1e1a-4738-b3ad-f26fbe30445f tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:38:42.357925 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-783cecb8-1e1a-4738-b3ad-f26fbe30445f tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] 10.222.0.15 "GET /compute/v2.1/servers/b3800adf-8cae-407e-9a5e-9eb107bff58d" status: 200 len: 1724 microversion: 2.20 time: 0.156467 Oct 31 12:38:42.358474 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 387/790] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Oct 31 12:38:42 2022] GET /compute/v2.1/servers/b3800adf-8cae-407e-9a5e-9eb107bff58d => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 12:38:43.384856 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-d8b7e928-91f3-40cc-b9a3-19309165bfd5 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:38:43.385731 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-d8b7e928-91f3-40cc-b9a3-19309165bfd5 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] [instance: b3800adf-8cae-407e-9a5e-9eb107bff58d] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:38:43.392338 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-d8b7e928-91f3-40cc-b9a3-19309165bfd5 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:38:43.392820 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-d8b7e928-91f3-40cc-b9a3-19309165bfd5 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:38:43.393248 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-d8b7e928-91f3-40cc-b9a3-19309165bfd5 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:38:43.394196 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-d8b7e928-91f3-40cc-b9a3-19309165bfd5 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:38:43.394640 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-d8b7e928-91f3-40cc-b9a3-19309165bfd5 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:38:43.395053 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-d8b7e928-91f3-40cc-b9a3-19309165bfd5 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:38:43.534503 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-d8b7e928-91f3-40cc-b9a3-19309165bfd5 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:38:43.544292 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-d8b7e928-91f3-40cc-b9a3-19309165bfd5 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:38:43.545723 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-d8b7e928-91f3-40cc-b9a3-19309165bfd5 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:38:43.546869 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-d8b7e928-91f3-40cc-b9a3-19309165bfd5 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] 10.222.0.15 "GET /compute/v2.1/servers/b3800adf-8cae-407e-9a5e-9eb107bff58d" status: 200 len: 1724 microversion: 2.20 time: 0.166156 Oct 31 12:38:43.547475 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 404/791] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Oct 31 12:38:43 2022] GET /compute/v2.1/servers/b3800adf-8cae-407e-9a5e-9eb107bff58d => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 12:38:44.572937 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-84554468-e5bf-4539-842b-4aecb77dae5a tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:38:44.573548 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-84554468-e5bf-4539-842b-4aecb77dae5a tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] [instance: b3800adf-8cae-407e-9a5e-9eb107bff58d] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:38:44.579961 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-84554468-e5bf-4539-842b-4aecb77dae5a tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:38:44.580444 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-84554468-e5bf-4539-842b-4aecb77dae5a tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:38:44.580878 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-84554468-e5bf-4539-842b-4aecb77dae5a tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:38:44.581567 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-84554468-e5bf-4539-842b-4aecb77dae5a tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:38:44.582025 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-84554468-e5bf-4539-842b-4aecb77dae5a tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:38:44.582446 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-84554468-e5bf-4539-842b-4aecb77dae5a tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:38:44.719708 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-84554468-e5bf-4539-842b-4aecb77dae5a tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:38:44.731104 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-84554468-e5bf-4539-842b-4aecb77dae5a tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:38:44.732646 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-84554468-e5bf-4539-842b-4aecb77dae5a tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:38:44.733835 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-84554468-e5bf-4539-842b-4aecb77dae5a tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] 10.222.0.15 "GET /compute/v2.1/servers/b3800adf-8cae-407e-9a5e-9eb107bff58d" status: 200 len: 1724 microversion: 2.20 time: 0.165359 Oct 31 12:38:44.734387 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 388/792] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Oct 31 12:38:44 2022] GET /compute/v2.1/servers/b3800adf-8cae-407e-9a5e-9eb107bff58d => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 12:38:45.759399 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-70c968a8-bcd0-4083-abcc-b94efe45b714 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:38:45.760000 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-70c968a8-bcd0-4083-abcc-b94efe45b714 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] [instance: b3800adf-8cae-407e-9a5e-9eb107bff58d] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:38:45.766491 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-70c968a8-bcd0-4083-abcc-b94efe45b714 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:38:45.766970 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-70c968a8-bcd0-4083-abcc-b94efe45b714 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:38:45.767444 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-70c968a8-bcd0-4083-abcc-b94efe45b714 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:38:45.768130 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-70c968a8-bcd0-4083-abcc-b94efe45b714 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:38:45.768576 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-70c968a8-bcd0-4083-abcc-b94efe45b714 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:38:45.769273 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-70c968a8-bcd0-4083-abcc-b94efe45b714 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:38:45.941590 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-70c968a8-bcd0-4083-abcc-b94efe45b714 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:38:45.951963 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-70c968a8-bcd0-4083-abcc-b94efe45b714 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:38:45.953308 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-70c968a8-bcd0-4083-abcc-b94efe45b714 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:38:45.954473 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-70c968a8-bcd0-4083-abcc-b94efe45b714 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] 10.222.0.15 "GET /compute/v2.1/servers/b3800adf-8cae-407e-9a5e-9eb107bff58d" status: 200 len: 1724 microversion: 2.20 time: 0.199074 Oct 31 12:38:45.955385 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 405/793] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Oct 31 12:38:45 2022] GET /compute/v2.1/servers/b3800adf-8cae-407e-9a5e-9eb107bff58d => generated 1724 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 12:38:46.981172 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-f4a03568-a9d2-42d8-8230-982873ca93e0 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:38:46.981775 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-f4a03568-a9d2-42d8-8230-982873ca93e0 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] [instance: b3800adf-8cae-407e-9a5e-9eb107bff58d] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:38:46.988161 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-f4a03568-a9d2-42d8-8230-982873ca93e0 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:38:46.988633 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-f4a03568-a9d2-42d8-8230-982873ca93e0 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:38:46.989062 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-f4a03568-a9d2-42d8-8230-982873ca93e0 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:38:46.989738 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-f4a03568-a9d2-42d8-8230-982873ca93e0 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:38:46.990186 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-f4a03568-a9d2-42d8-8230-982873ca93e0 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:38:46.990598 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-f4a03568-a9d2-42d8-8230-982873ca93e0 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:38:47.124972 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-f4a03568-a9d2-42d8-8230-982873ca93e0 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:38:47.132974 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-f4a03568-a9d2-42d8-8230-982873ca93e0 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:38:47.135289 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-f4a03568-a9d2-42d8-8230-982873ca93e0 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:38:47.136553 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-f4a03568-a9d2-42d8-8230-982873ca93e0 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] 10.222.0.15 "GET /compute/v2.1/servers/b3800adf-8cae-407e-9a5e-9eb107bff58d" status: 200 len: 1745 microversion: 2.20 time: 0.159432 Oct 31 12:38:47.137180 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 389/794] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Oct 31 12:38:46 2022] GET /compute/v2.1/servers/b3800adf-8cae-407e-9a5e-9eb107bff58d => generated 1745 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 12:38:48.162986 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-8df9fcdf-0450-4022-9cb4-22609edf0e51 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:38:48.163613 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-8df9fcdf-0450-4022-9cb4-22609edf0e51 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] [instance: b3800adf-8cae-407e-9a5e-9eb107bff58d] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:38:48.169648 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-8df9fcdf-0450-4022-9cb4-22609edf0e51 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:38:48.170128 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-8df9fcdf-0450-4022-9cb4-22609edf0e51 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:38:48.170553 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-8df9fcdf-0450-4022-9cb4-22609edf0e51 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:38:48.171385 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-8df9fcdf-0450-4022-9cb4-22609edf0e51 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:38:48.171844 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-8df9fcdf-0450-4022-9cb4-22609edf0e51 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:38:48.172259 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-8df9fcdf-0450-4022-9cb4-22609edf0e51 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:38:48.174803 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG dbcounter [-] [125440] Writing DB stats nova_cell1:SELECT=93 {{(pid=125440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:38:48.302504 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-8df9fcdf-0450-4022-9cb4-22609edf0e51 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:38:48.311518 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-8df9fcdf-0450-4022-9cb4-22609edf0e51 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:38:48.312863 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-8df9fcdf-0450-4022-9cb4-22609edf0e51 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:38:48.314024 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-8df9fcdf-0450-4022-9cb4-22609edf0e51 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] 10.222.0.15 "GET /compute/v2.1/servers/b3800adf-8cae-407e-9a5e-9eb107bff58d" status: 200 len: 1745 microversion: 2.20 time: 0.154918 Oct 31 12:38:48.314587 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 406/795] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Oct 31 12:38:48 2022] GET /compute/v2.1/servers/b3800adf-8cae-407e-9a5e-9eb107bff58d => generated 1745 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 12:38:49.318196 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-794ed60c-b34b-43bf-9344-95782b63232e tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:38:49.319921 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-794ed60c-b34b-43bf-9344-95782b63232e tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] [instance: 96065a23-4a5f-4ffb-8b48-746d2dc2c301] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:38:49.327891 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-794ed60c-b34b-43bf-9344-95782b63232e tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:38:49.328381 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-794ed60c-b34b-43bf-9344-95782b63232e tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:38:49.328855 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-794ed60c-b34b-43bf-9344-95782b63232e tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:38:49.329561 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-794ed60c-b34b-43bf-9344-95782b63232e tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:38:49.330068 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-794ed60c-b34b-43bf-9344-95782b63232e tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:38:49.330487 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-794ed60c-b34b-43bf-9344-95782b63232e tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:38:49.340845 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-a60dabd6-2769-4e20-accc-054cd25ef185 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:38:49.341466 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-a60dabd6-2769-4e20-accc-054cd25ef185 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] [instance: b3800adf-8cae-407e-9a5e-9eb107bff58d] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:38:49.347965 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-a60dabd6-2769-4e20-accc-054cd25ef185 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:38:49.348648 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-a60dabd6-2769-4e20-accc-054cd25ef185 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:38:49.349255 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-a60dabd6-2769-4e20-accc-054cd25ef185 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:38:49.349953 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-a60dabd6-2769-4e20-accc-054cd25ef185 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:38:49.350403 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-a60dabd6-2769-4e20-accc-054cd25ef185 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:38:49.350822 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-a60dabd6-2769-4e20-accc-054cd25ef185 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:38:49.358643 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-794ed60c-b34b-43bf-9344-95782b63232e tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] 10.222.0.15 "GET /compute/v2.1/servers/96065a23-4a5f-4ffb-8b48-746d2dc2c301/ips" status: 200 len: 145 microversion: 2.1 time: 0.046490 Oct 31 12:38:49.359258 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 390/796] 10.222.0.15 () {58 vars in 1248 bytes} [Mon Oct 31 12:38:49 2022] GET /compute/v2.1/servers/96065a23-4a5f-4ffb-8b48-746d2dc2c301/ips => generated 145 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 12:38:49.534615 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-a60dabd6-2769-4e20-accc-054cd25ef185 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:38:49.543631 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-a60dabd6-2769-4e20-accc-054cd25ef185 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:38:49.545051 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-a60dabd6-2769-4e20-accc-054cd25ef185 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:38:49.546415 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-a60dabd6-2769-4e20-accc-054cd25ef185 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] 10.222.0.15 "GET /compute/v2.1/servers/b3800adf-8cae-407e-9a5e-9eb107bff58d" status: 200 len: 1740 microversion: 2.20 time: 0.209690 Oct 31 12:38:49.547581 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 407/797] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Oct 31 12:38:49 2022] GET /compute/v2.1/servers/b3800adf-8cae-407e-9a5e-9eb107bff58d => generated 1740 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 12:38:50.527089 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [req-93b44e53-ae5c-477b-82af-3a381f72a1ea req-6fc7e0a5-5a56-4dd9-a68a-fcb650f6bce5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3800adf-8cae-407e-9a5e-9eb107bff58d", "name": "network-vif-plugged", "status": "completed", "tag": "360a1655-b233-4d4d-a557-dc89ddf2b18e"}]} {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 12:38:50.537120 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [req-93b44e53-ae5c-477b-82af-3a381f72a1ea req-6fc7e0a5-5a56-4dd9-a68a-fcb650f6bce5 service nova] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:38:50.537766 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [req-93b44e53-ae5c-477b-82af-3a381f72a1ea req-6fc7e0a5-5a56-4dd9-a68a-fcb650f6bce5 service nova] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:38:50.538400 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [req-93b44e53-ae5c-477b-82af-3a381f72a1ea req-6fc7e0a5-5a56-4dd9-a68a-fcb650f6bce5 service nova] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:38:50.549829 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.compute.server_external_events [req-93b44e53-ae5c-477b-82af-3a381f72a1ea req-6fc7e0a5-5a56-4dd9-a68a-fcb650f6bce5 service nova] Creating event network-vif-plugged:360a1655-b233-4d4d-a557-dc89ddf2b18e for instance b3800adf-8cae-407e-9a5e-9eb107bff58d on hv-cinder-79617 Oct 31 12:38:50.555516 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [req-93b44e53-ae5c-477b-82af-3a381f72a1ea req-6fc7e0a5-5a56-4dd9-a68a-fcb650f6bce5 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.193300 Oct 31 12:38:50.560672 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 391/798] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Oct 31 12:38:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 12:38:50.574624 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-1a422fd2-3bf5-4076-97fc-aeb3454678dc tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:38:50.575264 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-1a422fd2-3bf5-4076-97fc-aeb3454678dc tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] [instance: b3800adf-8cae-407e-9a5e-9eb107bff58d] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:38:50.581650 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-1a422fd2-3bf5-4076-97fc-aeb3454678dc tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:38:50.582433 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-1a422fd2-3bf5-4076-97fc-aeb3454678dc tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:38:50.582944 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-1a422fd2-3bf5-4076-97fc-aeb3454678dc tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:38:50.583878 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-1a422fd2-3bf5-4076-97fc-aeb3454678dc tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:38:50.584550 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-1a422fd2-3bf5-4076-97fc-aeb3454678dc tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:38:50.585181 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-1a422fd2-3bf5-4076-97fc-aeb3454678dc tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:38:50.661439 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-f81ec717-50db-4d71-8866-8f3b799cfd8c tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:38:50.662292 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-f81ec717-50db-4d71-8866-8f3b799cfd8c tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] [instance: d7643c7c-0218-427f-876a-cf89c932dd11] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:38:50.671061 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-f81ec717-50db-4d71-8866-8f3b799cfd8c tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:38:50.674093 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-f81ec717-50db-4d71-8866-8f3b799cfd8c tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:38:50.676973 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-f81ec717-50db-4d71-8866-8f3b799cfd8c tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:38:50.677929 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-f81ec717-50db-4d71-8866-8f3b799cfd8c tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:38:50.678559 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-f81ec717-50db-4d71-8866-8f3b799cfd8c tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:38:50.679191 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-f81ec717-50db-4d71-8866-8f3b799cfd8c tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:38:50.707575 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-f81ec717-50db-4d71-8866-8f3b799cfd8c tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] [instance: d7643c7c-0218-427f-876a-cf89c932dd11] Going to try to terminate instance {{(pid=125441) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 12:38:50.784499 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-1a422fd2-3bf5-4076-97fc-aeb3454678dc tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:38:50.810921 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-1a422fd2-3bf5-4076-97fc-aeb3454678dc tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:38:50.812914 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-1a422fd2-3bf5-4076-97fc-aeb3454678dc tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:38:50.814312 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-1a422fd2-3bf5-4076-97fc-aeb3454678dc tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] 10.222.0.15 "GET /compute/v2.1/servers/b3800adf-8cae-407e-9a5e-9eb107bff58d" status: 200 len: 1740 microversion: 2.20 time: 0.244498 Oct 31 12:38:50.815792 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 408/799] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Oct 31 12:38:50 2022] GET /compute/v2.1/servers/b3800adf-8cae-407e-9a5e-9eb107bff58d => generated 1740 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 12:38:50.822356 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-fd998464-27a9-4968-83e2-672924a0289f tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "96cdc07c-d303-40fe-bf84-df0948c2012f"}} {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 12:38:50.825630 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-fd998464-27a9-4968-83e2-672924a0289f tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] [instance: 96065a23-4a5f-4ffb-8b48-746d2dc2c301] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:38:50.831645 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-f81ec717-50db-4d71-8866-8f3b799cfd8c tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] 10.222.0.15 "DELETE /compute/v2.1/servers/d7643c7c-0218-427f-876a-cf89c932dd11" status: 204 len: 0 microversion: 2.1 time: 0.174128 Oct 31 12:38:50.832843 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 392/800] 10.222.0.15 () {58 vars in 1239 bytes} [Mon Oct 31 12:38:50 2022] DELETE /compute/v2.1/servers/d7643c7c-0218-427f-876a-cf89c932dd11 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 31 12:38:50.837562 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-fd998464-27a9-4968-83e2-672924a0289f tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:38:50.839026 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-fd998464-27a9-4968-83e2-672924a0289f tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:38:50.839687 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-fd998464-27a9-4968-83e2-672924a0289f tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:38:50.842601 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-fd998464-27a9-4968-83e2-672924a0289f tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:38:50.843086 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-fd998464-27a9-4968-83e2-672924a0289f tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:38:50.843553 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-fd998464-27a9-4968-83e2-672924a0289f tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:38:50.849824 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-5cf24c1e-f205-417d-b194-8235199c3267 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:38:50.850530 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-5cf24c1e-f205-417d-b194-8235199c3267 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] [instance: d7643c7c-0218-427f-876a-cf89c932dd11] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:38:50.857244 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-5cf24c1e-f205-417d-b194-8235199c3267 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:38:50.857723 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-5cf24c1e-f205-417d-b194-8235199c3267 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:38:50.858330 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-5cf24c1e-f205-417d-b194-8235199c3267 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:38:50.859254 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-5cf24c1e-f205-417d-b194-8235199c3267 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:38:50.859876 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-5cf24c1e-f205-417d-b194-8235199c3267 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:38:50.860321 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-5cf24c1e-f205-417d-b194-8235199c3267 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:38:51.010259 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-5cf24c1e-f205-417d-b194-8235199c3267 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b76d81ee9446cf9014a2e695ef03e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae8c589d0b84ce096451a10717fc601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:38:51.018059 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-5cf24c1e-f205-417d-b194-8235199c3267 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] 10.222.0.15 "GET /compute/v2.1/servers/d7643c7c-0218-427f-876a-cf89c932dd11" status: 200 len: 1576 microversion: 2.1 time: 0.180846 Oct 31 12:38:51.018611 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 393/801] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:38:50 2022] GET /compute/v2.1/servers/d7643c7c-0218-427f-876a-cf89c932dd11 => generated 1576 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:38:51.847251 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-d567c5d6-195a-4c78-b6b5-607a159936a6 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:38:51.847904 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-d567c5d6-195a-4c78-b6b5-607a159936a6 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] [instance: b3800adf-8cae-407e-9a5e-9eb107bff58d] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:38:51.855058 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-d567c5d6-195a-4c78-b6b5-607a159936a6 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:38:51.855968 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-d567c5d6-195a-4c78-b6b5-607a159936a6 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:38:51.856485 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-d567c5d6-195a-4c78-b6b5-607a159936a6 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:38:51.857267 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-d567c5d6-195a-4c78-b6b5-607a159936a6 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:38:51.857889 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-d567c5d6-195a-4c78-b6b5-607a159936a6 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:38:51.858429 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-d567c5d6-195a-4c78-b6b5-607a159936a6 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:38:51.863244 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG dbcounter [-] [125441] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=125441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:38:52.029906 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-d567c5d6-195a-4c78-b6b5-607a159936a6 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:38:52.043819 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-d567c5d6-195a-4c78-b6b5-607a159936a6 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:38:52.045731 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-d567c5d6-195a-4c78-b6b5-607a159936a6 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:38:52.047276 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-d567c5d6-195a-4c78-b6b5-607a159936a6 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] 10.222.0.15 "GET /compute/v2.1/servers/b3800adf-8cae-407e-9a5e-9eb107bff58d" status: 200 len: 1740 microversion: 2.20 time: 0.204342 Oct 31 12:38:52.048491 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 394/802] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Oct 31 12:38:51 2022] GET /compute/v2.1/servers/b3800adf-8cae-407e-9a5e-9eb107bff58d => generated 1740 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 12:38:52.053156 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-7406f618-6778-403f-a84c-4ff381b85720 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:38:52.053975 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-7406f618-6778-403f-a84c-4ff381b85720 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] [instance: d7643c7c-0218-427f-876a-cf89c932dd11] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:38:52.074342 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-7406f618-6778-403f-a84c-4ff381b85720 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:38:52.075258 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-7406f618-6778-403f-a84c-4ff381b85720 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:38:52.075937 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-7406f618-6778-403f-a84c-4ff381b85720 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:38:52.076872 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-7406f618-6778-403f-a84c-4ff381b85720 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:38:52.077550 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-7406f618-6778-403f-a84c-4ff381b85720 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:38:52.078538 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-7406f618-6778-403f-a84c-4ff381b85720 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:38:52.277842 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-7406f618-6778-403f-a84c-4ff381b85720 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b76d81ee9446cf9014a2e695ef03e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae8c589d0b84ce096451a10717fc601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:38:52.286278 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-7406f618-6778-403f-a84c-4ff381b85720 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] 10.222.0.15 "GET /compute/v2.1/servers/d7643c7c-0218-427f-876a-cf89c932dd11" status: 200 len: 1576 microversion: 2.1 time: 0.236445 Oct 31 12:38:52.286868 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 395/803] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:38:52 2022] GET /compute/v2.1/servers/d7643c7c-0218-427f-876a-cf89c932dd11 => generated 1576 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:38:52.298582 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-fd998464-27a9-4968-83e2-672924a0289f tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] 10.222.0.15 "POST /compute/v2.1/servers/96065a23-4a5f-4ffb-8b48-746d2dc2c301/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.481232 Oct 31 12:38:52.299759 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 409/804] 10.222.0.15 () {60 vars in 1323 bytes} [Mon Oct 31 12:38:50 2022] POST /compute/v2.1/servers/96065a23-4a5f-4ffb-8b48-746d2dc2c301/os-volume_attachments => generated 194 bytes in 1483 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 12:38:53.080785 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-06d8bf59-0093-42fc-ac2e-a5928eb39a19 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:38:53.082221 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-06d8bf59-0093-42fc-ac2e-a5928eb39a19 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] [instance: b3800adf-8cae-407e-9a5e-9eb107bff58d] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:38:53.093010 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-06d8bf59-0093-42fc-ac2e-a5928eb39a19 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:38:53.101216 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-06d8bf59-0093-42fc-ac2e-a5928eb39a19 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:38:53.102824 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-06d8bf59-0093-42fc-ac2e-a5928eb39a19 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:38:53.105570 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-06d8bf59-0093-42fc-ac2e-a5928eb39a19 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:38:53.119943 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-06d8bf59-0093-42fc-ac2e-a5928eb39a19 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:38:53.120714 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-06d8bf59-0093-42fc-ac2e-a5928eb39a19 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:38:53.296438 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-06d8bf59-0093-42fc-ac2e-a5928eb39a19 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:38:53.307879 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-06d8bf59-0093-42fc-ac2e-a5928eb39a19 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:38:53.310407 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-06d8bf59-0093-42fc-ac2e-a5928eb39a19 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:38:53.311974 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-06d8bf59-0093-42fc-ac2e-a5928eb39a19 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] 10.222.0.15 "GET /compute/v2.1/servers/b3800adf-8cae-407e-9a5e-9eb107bff58d" status: 200 len: 1740 microversion: 2.20 time: 0.235878 Oct 31 12:38:53.312123 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-e16097aa-377e-4b92-9b61-49ad3e77c8b3 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:38:53.313132 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-e16097aa-377e-4b92-9b61-49ad3e77c8b3 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] [instance: d7643c7c-0218-427f-876a-cf89c932dd11] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:38:53.313363 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 396/805] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Oct 31 12:38:53 2022] GET /compute/v2.1/servers/b3800adf-8cae-407e-9a5e-9eb107bff58d => generated 1740 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 12:38:53.321467 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG dbcounter [-] [125440] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=125440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:38:53.324111 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-e16097aa-377e-4b92-9b61-49ad3e77c8b3 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:38:53.324856 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-e16097aa-377e-4b92-9b61-49ad3e77c8b3 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:38:53.330802 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-e16097aa-377e-4b92-9b61-49ad3e77c8b3 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:38:53.331870 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-e16097aa-377e-4b92-9b61-49ad3e77c8b3 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:38:53.332552 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-e16097aa-377e-4b92-9b61-49ad3e77c8b3 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:38:53.333190 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-e16097aa-377e-4b92-9b61-49ad3e77c8b3 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:38:53.510500 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-e16097aa-377e-4b92-9b61-49ad3e77c8b3 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b76d81ee9446cf9014a2e695ef03e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae8c589d0b84ce096451a10717fc601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:38:53.520202 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-e16097aa-377e-4b92-9b61-49ad3e77c8b3 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] 10.222.0.15 "GET /compute/v2.1/servers/d7643c7c-0218-427f-876a-cf89c932dd11" status: 200 len: 1508 microversion: 2.1 time: 0.213572 Oct 31 12:38:53.520776 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 410/806] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:38:53 2022] GET /compute/v2.1/servers/d7643c7c-0218-427f-876a-cf89c932dd11 => generated 1508 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:38:53.722184 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [req-c29471ce-47cf-4799-bc9c-0aa965ea3190 req-d909b9ad-b188-4961-90fe-e6c2102a244e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7643c7c-0218-427f-876a-cf89c932dd11", "name": "network-vif-deleted", "tag": "76712093-6a65-4766-8171-79fff21ef102"}]} {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 12:38:53.747300 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [req-c29471ce-47cf-4799-bc9c-0aa965ea3190 req-d909b9ad-b188-4961-90fe-e6c2102a244e service nova] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:38:53.747799 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [req-c29471ce-47cf-4799-bc9c-0aa965ea3190 req-d909b9ad-b188-4961-90fe-e6c2102a244e service nova] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:38:53.753241 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [req-c29471ce-47cf-4799-bc9c-0aa965ea3190 req-d909b9ad-b188-4961-90fe-e6c2102a244e service nova] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:38:53.773473 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.compute.server_external_events [req-c29471ce-47cf-4799-bc9c-0aa965ea3190 req-d909b9ad-b188-4961-90fe-e6c2102a244e service nova] Creating event network-vif-deleted:76712093-6a65-4766-8171-79fff21ef102 for instance d7643c7c-0218-427f-876a-cf89c932dd11 on hv-cinder-79617 Oct 31 12:38:53.779494 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [req-c29471ce-47cf-4799-bc9c-0aa965ea3190 req-d909b9ad-b188-4961-90fe-e6c2102a244e service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061477 Oct 31 12:38:53.780446 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 397/807] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Oct 31 12:38:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 12:38:54.343481 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-1a32b0de-f839-4a41-9d05-3fe6ff32f46f tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:38:54.344754 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-1a32b0de-f839-4a41-9d05-3fe6ff32f46f tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] [instance: b3800adf-8cae-407e-9a5e-9eb107bff58d] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:38:54.355912 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-1a32b0de-f839-4a41-9d05-3fe6ff32f46f tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:38:54.356392 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-1a32b0de-f839-4a41-9d05-3fe6ff32f46f tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:38:54.356815 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-1a32b0de-f839-4a41-9d05-3fe6ff32f46f tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:38:54.357529 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-1a32b0de-f839-4a41-9d05-3fe6ff32f46f tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:38:54.357972 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-1a32b0de-f839-4a41-9d05-3fe6ff32f46f tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:38:54.358384 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-1a32b0de-f839-4a41-9d05-3fe6ff32f46f tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:38:54.549934 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-28b05cbc-6988-4d3d-ad8b-c53e6613f8a8 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:38:54.550635 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-28b05cbc-6988-4d3d-ad8b-c53e6613f8a8 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] [instance: d7643c7c-0218-427f-876a-cf89c932dd11] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:38:54.568605 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-1a32b0de-f839-4a41-9d05-3fe6ff32f46f tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:38:54.570877 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-28b05cbc-6988-4d3d-ad8b-c53e6613f8a8 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:38:54.572600 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-28b05cbc-6988-4d3d-ad8b-c53e6613f8a8 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:38:54.573174 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-28b05cbc-6988-4d3d-ad8b-c53e6613f8a8 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:38:54.573895 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-28b05cbc-6988-4d3d-ad8b-c53e6613f8a8 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:38:54.574357 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-28b05cbc-6988-4d3d-ad8b-c53e6613f8a8 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:38:54.574783 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-28b05cbc-6988-4d3d-ad8b-c53e6613f8a8 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:38:54.578459 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-1a32b0de-f839-4a41-9d05-3fe6ff32f46f tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:38:54.580215 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-1a32b0de-f839-4a41-9d05-3fe6ff32f46f tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:38:54.581614 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-1a32b0de-f839-4a41-9d05-3fe6ff32f46f tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] 10.222.0.15 "GET /compute/v2.1/servers/b3800adf-8cae-407e-9a5e-9eb107bff58d" status: 200 len: 1740 microversion: 2.20 time: 0.242388 Oct 31 12:38:54.582686 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 411/808] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Oct 31 12:38:54 2022] GET /compute/v2.1/servers/b3800adf-8cae-407e-9a5e-9eb107bff58d => generated 1740 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 12:38:54.621346 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-28b05cbc-6988-4d3d-ad8b-c53e6613f8a8 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:38:54.622215 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-28b05cbc-6988-4d3d-ad8b-c53e6613f8a8 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:38:54.622799 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-28b05cbc-6988-4d3d-ad8b-c53e6613f8a8 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:38:54.623424 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.objects.instance [None req-28b05cbc-6988-4d3d-ad8b-c53e6613f8a8 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lazy-loading 'fault' on Instance uuid d7643c7c-0218-427f-876a-cf89c932dd11 {{(pid=125441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 12:38:54.676442 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-28b05cbc-6988-4d3d-ad8b-c53e6613f8a8 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b76d81ee9446cf9014a2e695ef03e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae8c589d0b84ce096451a10717fc601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:38:54.690273 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-28b05cbc-6988-4d3d-ad8b-c53e6613f8a8 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] 10.222.0.15 "GET /compute/v2.1/servers/d7643c7c-0218-427f-876a-cf89c932dd11" status: 200 len: 1230 microversion: 2.1 time: 0.145183 Oct 31 12:38:54.691549 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 398/809] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:38:54 2022] GET /compute/v2.1/servers/d7643c7c-0218-427f-876a-cf89c932dd11 => generated 1230 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 12:38:55.610839 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-562239e0-8bc4-4531-ac20-284143784c92 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:38:55.612654 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-562239e0-8bc4-4531-ac20-284143784c92 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] [instance: b3800adf-8cae-407e-9a5e-9eb107bff58d] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:38:55.642128 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-562239e0-8bc4-4531-ac20-284143784c92 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:38:55.643316 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-562239e0-8bc4-4531-ac20-284143784c92 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:38:55.644390 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-562239e0-8bc4-4531-ac20-284143784c92 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:38:55.645657 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-562239e0-8bc4-4531-ac20-284143784c92 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:38:55.646219 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-562239e0-8bc4-4531-ac20-284143784c92 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:38:55.646701 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-562239e0-8bc4-4531-ac20-284143784c92 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:38:55.718885 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-1b765fb1-9d33-4a19-a124-7d461cc346bb tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:38:55.719571 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-1b765fb1-9d33-4a19-a124-7d461cc346bb tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] [instance: d7643c7c-0218-427f-876a-cf89c932dd11] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:38:55.730538 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-1b765fb1-9d33-4a19-a124-7d461cc346bb tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:38:55.731608 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-1b765fb1-9d33-4a19-a124-7d461cc346bb tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:38:55.732067 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-1b765fb1-9d33-4a19-a124-7d461cc346bb tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:38:55.732799 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-1b765fb1-9d33-4a19-a124-7d461cc346bb tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:38:55.733263 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-1b765fb1-9d33-4a19-a124-7d461cc346bb tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:38:55.733690 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-1b765fb1-9d33-4a19-a124-7d461cc346bb tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:38:55.756451 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.wsgi [None req-1b765fb1-9d33-4a19-a124-7d461cc346bb tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] HTTP exception thrown: Instance d7643c7c-0218-427f-876a-cf89c932dd11 could not be found. Oct 31 12:38:55.758209 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-1b765fb1-9d33-4a19-a124-7d461cc346bb tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Request method failure captured: Oct 31 12:38:55.758209 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: request: GET /compute/v2.1/servers/d7643c7c-0218-427f-876a-cf89c932dd11 HTTP/1.1 Oct 31 12:38:55.758209 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: Accept: application/json Oct 31 12:38:55.758209 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: Accept-Encoding: identity Oct 31 12:38:55.758209 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: Connection: close Oct 31 12:38:55.758209 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: Content-Length: 0 Oct 31 12:38:55.758209 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: Content-Type: application/json Oct 31 12:38:55.758209 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: Host: 10.222.0.15 Oct 31 12:38:55.758209 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: Openstack-System-Scope: None Oct 31 12:38:55.758209 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: User-Agent: python-urllib3/1.26.12 Oct 31 12:38:55.758209 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Auth-Token: gAAAAABjX8ElwiFia2OI6O2RwJPy13K8nl1mdQGDt5jidBRDNGeqwFGcRjHqSs1tV4YxvMZwm4l_cN5yDtW5rP-Ot8FzzhasSqmv9N_z3tYT2ENYznM5T_zZzKCsfaeDRYhOtFgoGAe6dzPXmQXXZPqOFj5aUjRHbuKqJUx252eFjU7wD3PCLR0 Oct 31 12:38:55.758209 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Domain-Id: None Oct 31 12:38:55.758209 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Domain-Name: None Oct 31 12:38:55.758209 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Identity-Status: Confirmed Oct 31 12:38:55.758209 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Is-Admin-Project: True Oct 31 12:38:55.758209 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Project-Domain-Id: default Oct 31 12:38:55.758209 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Project-Domain-Name: Default Oct 31 12:38:55.758209 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Project-Id: 8ae8c589d0b84ce096451a10717fc601 Oct 31 12:38:55.758209 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Project-Name: tempest-TestVolumeBootPattern-1228930348 Oct 31 12:38:55.758209 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Role: reader,member Oct 31 12:38:55.758209 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Roles: reader,member Oct 31 12:38:55.759651 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/8ae8c589d0b84ce096451a10717fc601"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_8ae8c589d0b84ce096451a10717fc601", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/8ae8c589d0b84ce096451a10717fc601"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/8ae8c589d0b84ce096451a10717fc601"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Oct 31 12:38:55.759651 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Tenant: tempest-TestVolumeBootPattern-1228930348 Oct 31 12:38:55.759651 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Tenant-Id: 8ae8c589d0b84ce096451a10717fc601 Oct 31 12:38:55.759651 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Tenant-Name: tempest-TestVolumeBootPattern-1228930348 Oct 31 12:38:55.759651 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-User: tempest-TestVolumeBootPattern-1228930348-project Oct 31 12:38:55.759651 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-User-Domain-Id: default Oct 31 12:38:55.759651 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-User-Domain-Name: Default Oct 31 12:38:55.759651 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-User-Id: 49b76d81ee9446cf9014a2e695ef03e7 Oct 31 12:38:55.759651 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-User-Name: tempest-TestVolumeBootPattern-1228930348-project Oct 31 12:38:55.759651 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: method: > Oct 31 12:38:55.759651 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: exception: Instance d7643c7c-0218-427f-876a-cf89c932dd11 could not be found. Oct 31 12:38:55.759651 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: action_args: {'id': 'd7643c7c-0218-427f-876a-cf89c932dd11'} Oct 31 12:38:55.760571 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 12:38:55.760571 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 12:38:55.760571 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 12:38:55.760571 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 12:38:55.760571 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 12:38:55.760571 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 12:38:55.760571 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 12:38:55.760571 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 12:38:55.760571 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 12:38:55.760571 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 12:38:55.760571 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d7643c7c-0218-427f-876a-cf89c932dd11 could not be found. Oct 31 12:38:55.760571 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Oct 31 12:38:55.760571 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 12:38:55.760571 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Oct 31 12:38:55.760571 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 12:38:55.760571 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 12:38:55.760571 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 12:38:55.760571 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 12:38:55.760571 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 12:38:55.760571 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 12:38:55.761847 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 12:38:55.761847 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 12:38:55.761847 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 12:38:55.761847 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 12:38:55.761847 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 12:38:55.761847 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 12:38:55.761847 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 12:38:55.761847 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d7643c7c-0218-427f-876a-cf89c932dd11 could not be found. Oct 31 12:38:55.761847 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Oct 31 12:38:55.761847 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 12:38:55.761847 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Oct 31 12:38:55.761847 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 12:38:55.761847 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 12:38:55.761847 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 12:38:55.761847 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 12:38:55.761847 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 12:38:55.761847 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d7643c7c-0218-427f-876a-cf89c932dd11 could not be found. Oct 31 12:38:55.761847 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Oct 31 12:38:55.762972 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-1b765fb1-9d33-4a19-a124-7d461cc346bb tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Returning 404 to user: Instance d7643c7c-0218-427f-876a-cf89c932dd11 could not be found. {{(pid=125441) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 12:38:55.762972 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-1b765fb1-9d33-4a19-a124-7d461cc346bb tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] 10.222.0.15 "GET /compute/v2.1/servers/d7643c7c-0218-427f-876a-cf89c932dd11" status: 404 len: 111 microversion: 2.1 time: 0.046545 Oct 31 12:38:55.767491 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 399/810] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:38:55 2022] GET /compute/v2.1/servers/d7643c7c-0218-427f-876a-cf89c932dd11 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 12:38:55.901712 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-b3c7208d-53be-402f-af8e-b774b0dea6a2 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1276248657", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-899997443", "security_groups": [{"name": "tempest-secgroup-smoke-1289635870"}], "block_device_mapping_v2": [{"uuid": "c167739f-31b8-4d1c-beb2-639f5c4d7a0f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "77732bf9-8ee2-480e-8cb2-0d5455add01d"}]}} {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 12:38:56.059795 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-562239e0-8bc4-4531-ac20-284143784c92 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:38:56.074489 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-562239e0-8bc4-4531-ac20-284143784c92 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:38:56.076576 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-562239e0-8bc4-4531-ac20-284143784c92 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:38:56.079750 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-562239e0-8bc4-4531-ac20-284143784c92 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] 10.222.0.15 "GET /compute/v2.1/servers/b3800adf-8cae-407e-9a5e-9eb107bff58d" status: 200 len: 1740 microversion: 2.20 time: 0.474103 Oct 31 12:38:56.095261 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 412/811] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Oct 31 12:38:55 2022] GET /compute/v2.1/servers/b3800adf-8cae-407e-9a5e-9eb107bff58d => generated 1740 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 12:38:56.108890 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.network.neutron [None req-b3c7208d-53be-402f-af8e-b774b0dea6a2 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] validate_networks() for [('77732bf9-8ee2-480e-8cb2-0d5455add01d', None, None, None, None, None)] {{(pid=125441) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 12:38:56.769918 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.virt.hardware [None req-b3c7208d-53be-402f-af8e-b774b0dea6a2 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Flavor limits 0:0:0 {{(pid=125441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 12:38:56.770518 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.virt.hardware [None req-b3c7208d-53be-402f-af8e-b774b0dea6a2 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Image limits 0:0:0 {{(pid=125441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 12:38:56.771010 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.virt.hardware [None req-b3c7208d-53be-402f-af8e-b774b0dea6a2 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Flavor pref 0:0:0 {{(pid=125441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 12:38:56.771567 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.virt.hardware [None req-b3c7208d-53be-402f-af8e-b774b0dea6a2 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Image pref 0:0:0 {{(pid=125441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 12:38:56.772548 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.virt.hardware [None req-b3c7208d-53be-402f-af8e-b774b0dea6a2 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 12:38:56.787196 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-b3c7208d-53be-402f-af8e-b774b0dea6a2 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:38:56.788081 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-b3c7208d-53be-402f-af8e-b774b0dea6a2 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:38:56.788879 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-b3c7208d-53be-402f-af8e-b774b0dea6a2 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:38:56.790264 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-b3c7208d-53be-402f-af8e-b774b0dea6a2 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:38:56.792030 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-b3c7208d-53be-402f-af8e-b774b0dea6a2 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:38:56.792719 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-b3c7208d-53be-402f-af8e-b774b0dea6a2 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:38:56.815685 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.quota [None req-b3c7208d-53be-402f-af8e-b774b0dea6a2 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Getting quotas for project 8ae8c589d0b84ce096451a10717fc601. Resources: {'instances', 'cores', 'ram'} {{(pid=125441) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 12:38:56.820757 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.quota [None req-b3c7208d-53be-402f-af8e-b774b0dea6a2 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Getting quotas for user 49b76d81ee9446cf9014a2e695ef03e7 and project 8ae8c589d0b84ce096451a10717fc601. Resources: {'instances', 'cores', 'ram'} {{(pid=125441) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 12:38:56.902628 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-b3c7208d-53be-402f-af8e-b774b0dea6a2 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Going to run 1 instances... {{(pid=125441) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 12:38:56.906068 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-b3c7208d-53be-402f-af8e-b774b0dea6a2 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] [instance: 4400e455-f03f-48be-a78e-c4886ef878c6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c167739f-31b8-4d1c-beb2-639f5c4d7a0f',volume_size=None,volume_type=None)] {{(pid=125441) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 12:38:57.109051 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-5a651223-6198-49be-974a-2e3815c0d93a tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:38:57.110551 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-5a651223-6198-49be-974a-2e3815c0d93a tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] [instance: b3800adf-8cae-407e-9a5e-9eb107bff58d] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:38:57.120580 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-5a651223-6198-49be-974a-2e3815c0d93a tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:38:57.122794 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-b3c7208d-53be-402f-af8e-b774b0dea6a2 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.225671 Oct 31 12:38:57.123547 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-5a651223-6198-49be-974a-2e3815c0d93a tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:38:57.124200 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-5a651223-6198-49be-974a-2e3815c0d93a tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:38:57.125960 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-5a651223-6198-49be-974a-2e3815c0d93a tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:38:57.126215 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 400/812] 10.222.0.15 () {60 vars in 1147 bytes} [Mon Oct 31 12:38:55 2022] POST /compute/v2.1/servers => generated 406 bytes in 1230 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 31 12:38:57.126853 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-5a651223-6198-49be-974a-2e3815c0d93a tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:38:57.127497 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-5a651223-6198-49be-974a-2e3815c0d93a tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:38:57.136951 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-61edc712-8033-4586-b1f2-24d8f2fdd6ce tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:38:57.138515 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-61edc712-8033-4586-b1f2-24d8f2fdd6ce tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] [instance: 4400e455-f03f-48be-a78e-c4886ef878c6] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:38:57.194974 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-61edc712-8033-4586-b1f2-24d8f2fdd6ce tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b76d81ee9446cf9014a2e695ef03e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae8c589d0b84ce096451a10717fc601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:38:57.206816 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-61edc712-8033-4586-b1f2-24d8f2fdd6ce tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] 10.222.0.15 "GET /compute/v2.1/servers/4400e455-f03f-48be-a78e-c4886ef878c6" status: 200 len: 1094 microversion: 2.1 time: 0.074266 Oct 31 12:38:57.207734 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 401/813] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:38:57 2022] GET /compute/v2.1/servers/4400e455-f03f-48be-a78e-c4886ef878c6 => generated 1094 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 12:38:57.367187 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-5a651223-6198-49be-974a-2e3815c0d93a tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:38:57.376711 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-5a651223-6198-49be-974a-2e3815c0d93a tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:38:57.378546 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-5a651223-6198-49be-974a-2e3815c0d93a tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:38:57.379933 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-5a651223-6198-49be-974a-2e3815c0d93a tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] 10.222.0.15 "GET /compute/v2.1/servers/b3800adf-8cae-407e-9a5e-9eb107bff58d" status: 200 len: 1740 microversion: 2.20 time: 0.275553 Oct 31 12:38:57.380637 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 413/814] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Oct 31 12:38:57 2022] GET /compute/v2.1/servers/b3800adf-8cae-407e-9a5e-9eb107bff58d => generated 1740 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 12:38:58.234386 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-eb9ea830-096b-4dce-ab30-e8d4415a3784 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:38:58.234991 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-eb9ea830-096b-4dce-ab30-e8d4415a3784 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] [instance: 4400e455-f03f-48be-a78e-c4886ef878c6] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:38:58.242906 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-eb9ea830-096b-4dce-ab30-e8d4415a3784 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:38:58.243421 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-eb9ea830-096b-4dce-ab30-e8d4415a3784 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:38:58.244552 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-eb9ea830-096b-4dce-ab30-e8d4415a3784 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:38:58.245548 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-eb9ea830-096b-4dce-ab30-e8d4415a3784 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:38:58.246154 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-eb9ea830-096b-4dce-ab30-e8d4415a3784 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:38:58.246742 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-eb9ea830-096b-4dce-ab30-e8d4415a3784 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:38:58.329146 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-eb9ea830-096b-4dce-ab30-e8d4415a3784 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b76d81ee9446cf9014a2e695ef03e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae8c589d0b84ce096451a10717fc601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:38:58.339822 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-eb9ea830-096b-4dce-ab30-e8d4415a3784 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] 10.222.0.15 "GET /compute/v2.1/servers/4400e455-f03f-48be-a78e-c4886ef878c6" status: 200 len: 1192 microversion: 2.1 time: 0.108884 Oct 31 12:38:58.341020 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 402/815] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:38:58 2022] GET /compute/v2.1/servers/4400e455-f03f-48be-a78e-c4886ef878c6 => generated 1192 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:38:58.411144 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-86de88e1-5539-4dc7-92cd-89bbc156d230 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:38:58.413791 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-86de88e1-5539-4dc7-92cd-89bbc156d230 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] [instance: b3800adf-8cae-407e-9a5e-9eb107bff58d] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:38:58.422578 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-86de88e1-5539-4dc7-92cd-89bbc156d230 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:38:58.423063 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-86de88e1-5539-4dc7-92cd-89bbc156d230 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:38:58.423521 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-86de88e1-5539-4dc7-92cd-89bbc156d230 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:38:58.424208 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-86de88e1-5539-4dc7-92cd-89bbc156d230 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:38:58.424657 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-86de88e1-5539-4dc7-92cd-89bbc156d230 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:38:58.425073 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-86de88e1-5539-4dc7-92cd-89bbc156d230 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:38:58.921261 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-86de88e1-5539-4dc7-92cd-89bbc156d230 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:38:58.933706 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-86de88e1-5539-4dc7-92cd-89bbc156d230 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:38:58.935991 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-86de88e1-5539-4dc7-92cd-89bbc156d230 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:38:58.938033 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-86de88e1-5539-4dc7-92cd-89bbc156d230 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] 10.222.0.15 "GET /compute/v2.1/servers/b3800adf-8cae-407e-9a5e-9eb107bff58d" status: 200 len: 1740 microversion: 2.20 time: 0.533338 Oct 31 12:38:58.939063 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 414/816] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Oct 31 12:38:58 2022] GET /compute/v2.1/servers/b3800adf-8cae-407e-9a5e-9eb107bff58d => generated 1740 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 12:38:59.380247 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-e2d7b541-7e78-4b9d-948c-ed68065c1ca2 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:38:59.380858 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-e2d7b541-7e78-4b9d-948c-ed68065c1ca2 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] [instance: 4400e455-f03f-48be-a78e-c4886ef878c6] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:38:59.388533 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-e2d7b541-7e78-4b9d-948c-ed68065c1ca2 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:38:59.389012 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-e2d7b541-7e78-4b9d-948c-ed68065c1ca2 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:38:59.389453 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-e2d7b541-7e78-4b9d-948c-ed68065c1ca2 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:38:59.390146 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-e2d7b541-7e78-4b9d-948c-ed68065c1ca2 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:38:59.390591 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-e2d7b541-7e78-4b9d-948c-ed68065c1ca2 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:38:59.394516 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-e2d7b541-7e78-4b9d-948c-ed68065c1ca2 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:38:59.514361 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-e2d7b541-7e78-4b9d-948c-ed68065c1ca2 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b76d81ee9446cf9014a2e695ef03e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae8c589d0b84ce096451a10717fc601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:38:59.523286 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-e2d7b541-7e78-4b9d-948c-ed68065c1ca2 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] 10.222.0.15 "GET /compute/v2.1/servers/4400e455-f03f-48be-a78e-c4886ef878c6" status: 200 len: 1192 microversion: 2.1 time: 0.147027 Oct 31 12:38:59.524093 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 403/817] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:38:59 2022] GET /compute/v2.1/servers/4400e455-f03f-48be-a78e-c4886ef878c6 => generated 1192 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 12:38:59.967937 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-b3eacff0-6978-4d33-9b25-0b616fe13a1d tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:38:59.968612 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-b3eacff0-6978-4d33-9b25-0b616fe13a1d tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] [instance: b3800adf-8cae-407e-9a5e-9eb107bff58d] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:39:00.016376 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-b3eacff0-6978-4d33-9b25-0b616fe13a1d tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:00.017209 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-b3eacff0-6978-4d33-9b25-0b616fe13a1d tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:00.017758 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-b3eacff0-6978-4d33-9b25-0b616fe13a1d tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:00.018697 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-b3eacff0-6978-4d33-9b25-0b616fe13a1d tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:00.020262 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-b3eacff0-6978-4d33-9b25-0b616fe13a1d tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:00.020784 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-b3eacff0-6978-4d33-9b25-0b616fe13a1d tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:00.151426 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-33ba9308-def8-4877-a733-340aac41eee1 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:39:00.174262 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-33ba9308-def8-4877-a733-340aac41eee1 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] [instance: 96065a23-4a5f-4ffb-8b48-746d2dc2c301] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:39:00.188340 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-33ba9308-def8-4877-a733-340aac41eee1 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:00.189839 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-33ba9308-def8-4877-a733-340aac41eee1 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:00.191056 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-33ba9308-def8-4877-a733-340aac41eee1 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:00.193842 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-33ba9308-def8-4877-a733-340aac41eee1 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:00.194555 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-33ba9308-def8-4877-a733-340aac41eee1 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:00.195375 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-33ba9308-def8-4877-a733-340aac41eee1 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:00.271207 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-33ba9308-def8-4877-a733-340aac41eee1 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] 10.222.0.15 "GET /compute/v2.1/servers/96065a23-4a5f-4ffb-8b48-746d2dc2c301/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.132347 Oct 31 12:39:00.271792 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 404/818] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Oct 31 12:39:00 2022] GET /compute/v2.1/servers/96065a23-4a5f-4ffb-8b48-746d2dc2c301/os-volume_attachments => generated 197 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 12:39:00.290290 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-1b67856f-bea4-4843-bf38-0209b95a0ca0 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:39:00.291435 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-1b67856f-bea4-4843-bf38-0209b95a0ca0 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] [instance: 96065a23-4a5f-4ffb-8b48-746d2dc2c301] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:39:00.299187 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-1b67856f-bea4-4843-bf38-0209b95a0ca0 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:00.299873 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-1b67856f-bea4-4843-bf38-0209b95a0ca0 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:00.300477 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-1b67856f-bea4-4843-bf38-0209b95a0ca0 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:00.301330 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-1b67856f-bea4-4843-bf38-0209b95a0ca0 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:00.301789 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-1b67856f-bea4-4843-bf38-0209b95a0ca0 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:00.302215 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-1b67856f-bea4-4843-bf38-0209b95a0ca0 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:00.311347 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-b3eacff0-6978-4d33-9b25-0b616fe13a1d tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:39:00.323019 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-b3eacff0-6978-4d33-9b25-0b616fe13a1d tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:39:00.325476 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-b3eacff0-6978-4d33-9b25-0b616fe13a1d tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:39:00.329900 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-b3eacff0-6978-4d33-9b25-0b616fe13a1d tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] 10.222.0.15 "GET /compute/v2.1/servers/b3800adf-8cae-407e-9a5e-9eb107bff58d" status: 200 len: 1740 microversion: 2.20 time: 0.365571 Oct 31 12:39:00.330958 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 415/819] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Oct 31 12:38:59 2022] GET /compute/v2.1/servers/b3800adf-8cae-407e-9a5e-9eb107bff58d => generated 1740 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 12:39:00.358260 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-1b67856f-bea4-4843-bf38-0209b95a0ca0 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] 10.222.0.15 "GET /compute/v2.1/servers/96065a23-4a5f-4ffb-8b48-746d2dc2c301/os-volume_attachments/96cdc07c-d303-40fe-bf84-df0948c2012f" status: 200 len: 194 microversion: 2.1 time: 0.075413 Oct 31 12:39:00.359116 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 405/820] 10.222.0.15 () {58 vars in 1413 bytes} [Mon Oct 31 12:39:00 2022] GET /compute/v2.1/servers/96065a23-4a5f-4ffb-8b48-746d2dc2c301/os-volume_attachments/96cdc07c-d303-40fe-bf84-df0948c2012f => generated 194 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 12:39:00.552403 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-e440ad3e-8524-4d04-b08a-370b778b024e tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:39:00.553527 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-e440ad3e-8524-4d04-b08a-370b778b024e tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] [instance: 4400e455-f03f-48be-a78e-c4886ef878c6] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:39:00.561060 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-e440ad3e-8524-4d04-b08a-370b778b024e tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:00.561788 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-e440ad3e-8524-4d04-b08a-370b778b024e tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:00.562939 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-e440ad3e-8524-4d04-b08a-370b778b024e tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:00.564915 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-e440ad3e-8524-4d04-b08a-370b778b024e tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:00.565597 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-e440ad3e-8524-4d04-b08a-370b778b024e tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:00.566473 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-e440ad3e-8524-4d04-b08a-370b778b024e tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:00.665871 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-e440ad3e-8524-4d04-b08a-370b778b024e tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b76d81ee9446cf9014a2e695ef03e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae8c589d0b84ce096451a10717fc601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:39:00.675327 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-e440ad3e-8524-4d04-b08a-370b778b024e tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] 10.222.0.15 "GET /compute/v2.1/servers/4400e455-f03f-48be-a78e-c4886ef878c6" status: 200 len: 1210 microversion: 2.1 time: 0.126663 Oct 31 12:39:00.676432 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 416/821] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:39:00 2022] GET /compute/v2.1/servers/4400e455-f03f-48be-a78e-c4886ef878c6 => generated 1210 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:39:01.356645 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-fbed7464-ec4c-4f51-aab0-34a47457a671 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:39:01.357268 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-fbed7464-ec4c-4f51-aab0-34a47457a671 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] [instance: b3800adf-8cae-407e-9a5e-9eb107bff58d] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:39:01.364276 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-fbed7464-ec4c-4f51-aab0-34a47457a671 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:01.365131 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-fbed7464-ec4c-4f51-aab0-34a47457a671 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:01.365770 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-fbed7464-ec4c-4f51-aab0-34a47457a671 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:01.366777 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-fbed7464-ec4c-4f51-aab0-34a47457a671 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:01.367528 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-fbed7464-ec4c-4f51-aab0-34a47457a671 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:01.369657 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-fbed7464-ec4c-4f51-aab0-34a47457a671 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:01.517570 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-fbed7464-ec4c-4f51-aab0-34a47457a671 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:39:01.527217 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-fbed7464-ec4c-4f51-aab0-34a47457a671 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:39:01.528672 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-fbed7464-ec4c-4f51-aab0-34a47457a671 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:39:01.529881 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-fbed7464-ec4c-4f51-aab0-34a47457a671 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] 10.222.0.15 "GET /compute/v2.1/servers/b3800adf-8cae-407e-9a5e-9eb107bff58d" status: 200 len: 1722 microversion: 2.20 time: 0.177873 Oct 31 12:39:01.531108 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 406/822] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Oct 31 12:39:01 2022] GET /compute/v2.1/servers/b3800adf-8cae-407e-9a5e-9eb107bff58d => generated 1722 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 12:39:01.704505 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-7db6cf13-c141-4058-acf6-27c9541d70d4 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:39:01.705205 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-7db6cf13-c141-4058-acf6-27c9541d70d4 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] [instance: 4400e455-f03f-48be-a78e-c4886ef878c6] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:39:01.711679 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-7db6cf13-c141-4058-acf6-27c9541d70d4 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:01.712165 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-7db6cf13-c141-4058-acf6-27c9541d70d4 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:01.712617 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-7db6cf13-c141-4058-acf6-27c9541d70d4 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:01.714094 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-7db6cf13-c141-4058-acf6-27c9541d70d4 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:01.714595 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-7db6cf13-c141-4058-acf6-27c9541d70d4 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:01.715066 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-7db6cf13-c141-4058-acf6-27c9541d70d4 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:01.830077 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-3277aa56-942e-4e2a-9462-97a668e0b80a tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "202f05d1-1419-486f-8639-f71907d0ef11"}} {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 12:39:01.832442 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-3277aa56-942e-4e2a-9462-97a668e0b80a tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] [instance: 96065a23-4a5f-4ffb-8b48-746d2dc2c301] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:39:01.838896 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-3277aa56-942e-4e2a-9462-97a668e0b80a tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:01.839403 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-3277aa56-942e-4e2a-9462-97a668e0b80a tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:01.839837 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-3277aa56-942e-4e2a-9462-97a668e0b80a tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:01.840525 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-3277aa56-942e-4e2a-9462-97a668e0b80a tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:01.840975 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-3277aa56-942e-4e2a-9462-97a668e0b80a tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:01.841393 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-3277aa56-942e-4e2a-9462-97a668e0b80a tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:02.098106 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-7db6cf13-c141-4058-acf6-27c9541d70d4 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b76d81ee9446cf9014a2e695ef03e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae8c589d0b84ce096451a10717fc601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:39:02.108048 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-7db6cf13-c141-4058-acf6-27c9541d70d4 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] 10.222.0.15 "GET /compute/v2.1/servers/4400e455-f03f-48be-a78e-c4886ef878c6" status: 200 len: 1266 microversion: 2.1 time: 0.407265 Oct 31 12:39:02.109167 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 417/823] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:39:01 2022] GET /compute/v2.1/servers/4400e455-f03f-48be-a78e-c4886ef878c6 => generated 1266 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:39:02.128961 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-3277aa56-942e-4e2a-9462-97a668e0b80a tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] 10.222.0.15 "POST /compute/v2.1/servers/96065a23-4a5f-4ffb-8b48-746d2dc2c301/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.301981 Oct 31 12:39:02.135021 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 407/824] 10.222.0.15 () {60 vars in 1323 bytes} [Mon Oct 31 12:39:01 2022] POST /compute/v2.1/servers/96065a23-4a5f-4ffb-8b48-746d2dc2c301/os-volume_attachments => generated 194 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 12:39:02.391526 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [req-6b58a3d6-d8cc-40a4-9d09-9a3c8716b95e req-ca52ac50-abab-4b4f-a44d-9ee1e956acb5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4400e455-f03f-48be-a78e-c4886ef878c6", "tag": "a1f478e3-0037-482b-9f12-361410fca1f5"}]} {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 12:39:02.401790 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [req-6b58a3d6-d8cc-40a4-9d09-9a3c8716b95e req-ca52ac50-abab-4b4f-a44d-9ee1e956acb5 service nova] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:02.402273 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [req-6b58a3d6-d8cc-40a4-9d09-9a3c8716b95e req-ca52ac50-abab-4b4f-a44d-9ee1e956acb5 service nova] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:02.402680 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [req-6b58a3d6-d8cc-40a4-9d09-9a3c8716b95e req-ca52ac50-abab-4b4f-a44d-9ee1e956acb5 service nova] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:02.415994 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.compute.server_external_events [req-6b58a3d6-d8cc-40a4-9d09-9a3c8716b95e req-ca52ac50-abab-4b4f-a44d-9ee1e956acb5 service nova] Creating event network-changed:a1f478e3-0037-482b-9f12-361410fca1f5 for instance 4400e455-f03f-48be-a78e-c4886ef878c6 on hv-cinder-79617 Oct 31 12:39:02.420874 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [req-6b58a3d6-d8cc-40a4-9d09-9a3c8716b95e req-ca52ac50-abab-4b4f-a44d-9ee1e956acb5 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033242 Oct 31 12:39:02.421486 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 418/825] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Oct 31 12:39:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 12:39:02.558065 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-54e11557-3d95-4878-a83a-8569482ba411 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:39:02.558647 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-54e11557-3d95-4878-a83a-8569482ba411 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] [instance: b3800adf-8cae-407e-9a5e-9eb107bff58d] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:39:02.564896 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-54e11557-3d95-4878-a83a-8569482ba411 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:02.565410 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-54e11557-3d95-4878-a83a-8569482ba411 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:02.565840 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-54e11557-3d95-4878-a83a-8569482ba411 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:02.566529 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-54e11557-3d95-4878-a83a-8569482ba411 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:02.566976 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-54e11557-3d95-4878-a83a-8569482ba411 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:02.567431 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-54e11557-3d95-4878-a83a-8569482ba411 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:02.704043 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-54e11557-3d95-4878-a83a-8569482ba411 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:39:02.712003 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-54e11557-3d95-4878-a83a-8569482ba411 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:39:02.714069 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-54e11557-3d95-4878-a83a-8569482ba411 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:39:02.715239 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-54e11557-3d95-4878-a83a-8569482ba411 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] 10.222.0.15 "GET /compute/v2.1/servers/b3800adf-8cae-407e-9a5e-9eb107bff58d" status: 200 len: 1722 microversion: 2.20 time: 0.162972 Oct 31 12:39:02.715784 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 408/826] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Oct 31 12:39:02 2022] GET /compute/v2.1/servers/b3800adf-8cae-407e-9a5e-9eb107bff58d => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 12:39:03.133794 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-538cd7ab-66a3-4141-ba55-2e805ed43ee7 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:39:03.134482 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-538cd7ab-66a3-4141-ba55-2e805ed43ee7 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] [instance: 4400e455-f03f-48be-a78e-c4886ef878c6] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:39:03.141592 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-538cd7ab-66a3-4141-ba55-2e805ed43ee7 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:03.142073 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-538cd7ab-66a3-4141-ba55-2e805ed43ee7 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:03.142509 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-538cd7ab-66a3-4141-ba55-2e805ed43ee7 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:03.143203 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-538cd7ab-66a3-4141-ba55-2e805ed43ee7 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:03.143660 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-538cd7ab-66a3-4141-ba55-2e805ed43ee7 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:03.144331 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-538cd7ab-66a3-4141-ba55-2e805ed43ee7 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:03.282121 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-538cd7ab-66a3-4141-ba55-2e805ed43ee7 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b76d81ee9446cf9014a2e695ef03e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae8c589d0b84ce096451a10717fc601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:39:03.289890 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-538cd7ab-66a3-4141-ba55-2e805ed43ee7 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] 10.222.0.15 "GET /compute/v2.1/servers/4400e455-f03f-48be-a78e-c4886ef878c6" status: 200 len: 1266 microversion: 2.1 time: 0.160775 Oct 31 12:39:03.290443 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 419/827] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:39:03 2022] GET /compute/v2.1/servers/4400e455-f03f-48be-a78e-c4886ef878c6 => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:39:03.741682 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-1c154b1c-a3ad-48a2-95db-295b950b3ce5 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:39:03.742353 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-1c154b1c-a3ad-48a2-95db-295b950b3ce5 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] [instance: b3800adf-8cae-407e-9a5e-9eb107bff58d] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:39:03.750285 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-1c154b1c-a3ad-48a2-95db-295b950b3ce5 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:03.750784 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-1c154b1c-a3ad-48a2-95db-295b950b3ce5 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:03.751262 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-1c154b1c-a3ad-48a2-95db-295b950b3ce5 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:03.751977 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-1c154b1c-a3ad-48a2-95db-295b950b3ce5 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:03.752432 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-1c154b1c-a3ad-48a2-95db-295b950b3ce5 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:03.752853 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-1c154b1c-a3ad-48a2-95db-295b950b3ce5 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:03.888007 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-1c154b1c-a3ad-48a2-95db-295b950b3ce5 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:39:03.896314 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-1c154b1c-a3ad-48a2-95db-295b950b3ce5 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:39:03.897747 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-1c154b1c-a3ad-48a2-95db-295b950b3ce5 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:39:03.898886 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-1c154b1c-a3ad-48a2-95db-295b950b3ce5 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] 10.222.0.15 "GET /compute/v2.1/servers/b3800adf-8cae-407e-9a5e-9eb107bff58d" status: 200 len: 1722 microversion: 2.20 time: 0.161245 Oct 31 12:39:03.899471 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 409/828] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Oct 31 12:39:03 2022] GET /compute/v2.1/servers/b3800adf-8cae-407e-9a5e-9eb107bff58d => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 12:39:04.312534 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-08e70a7a-1031-4c95-8c70-ae8ce7880027 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:39:04.313148 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-08e70a7a-1031-4c95-8c70-ae8ce7880027 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] [instance: 4400e455-f03f-48be-a78e-c4886ef878c6] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:39:04.319904 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-08e70a7a-1031-4c95-8c70-ae8ce7880027 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:04.320627 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-08e70a7a-1031-4c95-8c70-ae8ce7880027 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:04.321242 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-08e70a7a-1031-4c95-8c70-ae8ce7880027 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:04.321941 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-08e70a7a-1031-4c95-8c70-ae8ce7880027 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:04.323130 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-08e70a7a-1031-4c95-8c70-ae8ce7880027 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:04.323744 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-08e70a7a-1031-4c95-8c70-ae8ce7880027 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:04.384085 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [req-0885bd79-86bd-41d4-ba12-b7b6863c6531 req-545c2dda-c87b-4090-a207-db5ecbf7fa09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3800adf-8cae-407e-9a5e-9eb107bff58d", "name": "network-vif-unplugged", "status": "completed", "tag": "360a1655-b233-4d4d-a557-dc89ddf2b18e"}]} {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 12:39:04.401324 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [req-0885bd79-86bd-41d4-ba12-b7b6863c6531 req-545c2dda-c87b-4090-a207-db5ecbf7fa09 service nova] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:04.402070 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [req-0885bd79-86bd-41d4-ba12-b7b6863c6531 req-545c2dda-c87b-4090-a207-db5ecbf7fa09 service nova] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:04.404056 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [req-0885bd79-86bd-41d4-ba12-b7b6863c6531 req-545c2dda-c87b-4090-a207-db5ecbf7fa09 service nova] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:04.420098 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.compute.server_external_events [req-0885bd79-86bd-41d4-ba12-b7b6863c6531 req-545c2dda-c87b-4090-a207-db5ecbf7fa09 service nova] Creating event network-vif-unplugged:360a1655-b233-4d4d-a557-dc89ddf2b18e for instance b3800adf-8cae-407e-9a5e-9eb107bff58d on hv-cinder-79617 Oct 31 12:39:04.425376 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [req-0885bd79-86bd-41d4-ba12-b7b6863c6531 req-545c2dda-c87b-4090-a207-db5ecbf7fa09 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046082 Oct 31 12:39:04.425982 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 410/829] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Oct 31 12:39:04 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 12:39:04.530787 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-08e70a7a-1031-4c95-8c70-ae8ce7880027 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b76d81ee9446cf9014a2e695ef03e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae8c589d0b84ce096451a10717fc601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:39:04.538422 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-08e70a7a-1031-4c95-8c70-ae8ce7880027 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] 10.222.0.15 "GET /compute/v2.1/servers/4400e455-f03f-48be-a78e-c4886ef878c6" status: 200 len: 1266 microversion: 2.1 time: 0.229678 Oct 31 12:39:04.538923 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 420/830] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:39:04 2022] GET /compute/v2.1/servers/4400e455-f03f-48be-a78e-c4886ef878c6 => generated 1266 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:39:04.925658 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-6ce98a09-ed1b-4a25-88d2-a33f8f21f7ea tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:39:04.926451 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-6ce98a09-ed1b-4a25-88d2-a33f8f21f7ea tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] [instance: b3800adf-8cae-407e-9a5e-9eb107bff58d] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:39:04.932724 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-6ce98a09-ed1b-4a25-88d2-a33f8f21f7ea tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:04.933807 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-6ce98a09-ed1b-4a25-88d2-a33f8f21f7ea tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:04.934436 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-6ce98a09-ed1b-4a25-88d2-a33f8f21f7ea tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:04.935140 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-6ce98a09-ed1b-4a25-88d2-a33f8f21f7ea tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:04.935622 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-6ce98a09-ed1b-4a25-88d2-a33f8f21f7ea tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:04.936073 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-6ce98a09-ed1b-4a25-88d2-a33f8f21f7ea tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:05.076088 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-6ce98a09-ed1b-4a25-88d2-a33f8f21f7ea tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:39:05.084656 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-6ce98a09-ed1b-4a25-88d2-a33f8f21f7ea tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:39:05.086118 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-6ce98a09-ed1b-4a25-88d2-a33f8f21f7ea tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:39:05.087718 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-6ce98a09-ed1b-4a25-88d2-a33f8f21f7ea tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] 10.222.0.15 "GET /compute/v2.1/servers/b3800adf-8cae-407e-9a5e-9eb107bff58d" status: 200 len: 1665 microversion: 2.20 time: 0.166409 Oct 31 12:39:05.090548 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 411/831] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Oct 31 12:39:04 2022] GET /compute/v2.1/servers/b3800adf-8cae-407e-9a5e-9eb107bff58d => generated 1665 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 12:39:05.113651 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-96f062b5-8b6a-476a-bdee-986aab4a38fd tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e42ea08b-4972-4acd-902d-b6489a6235e1"}} {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 12:39:05.116049 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-96f062b5-8b6a-476a-bdee-986aab4a38fd tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] [instance: b3800adf-8cae-407e-9a5e-9eb107bff58d] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:39:05.122261 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-96f062b5-8b6a-476a-bdee-986aab4a38fd tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:05.122745 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-96f062b5-8b6a-476a-bdee-986aab4a38fd tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:05.123196 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-96f062b5-8b6a-476a-bdee-986aab4a38fd tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:05.123888 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-96f062b5-8b6a-476a-bdee-986aab4a38fd tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:05.124341 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-96f062b5-8b6a-476a-bdee-986aab4a38fd tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:05.124763 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-96f062b5-8b6a-476a-bdee-986aab4a38fd tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:05.204154 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG dbcounter [-] [125440] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:39:05.408097 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-96f062b5-8b6a-476a-bdee-986aab4a38fd tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] 10.222.0.15 "POST /compute/v2.1/servers/b3800adf-8cae-407e-9a5e-9eb107bff58d/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.298556 Oct 31 12:39:05.408747 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 421/832] 10.222.0.15 () {62 vars in 1364 bytes} [Mon Oct 31 12:39:05 2022] POST /compute/v2.1/servers/b3800adf-8cae-407e-9a5e-9eb107bff58d/os-volume_attachments => generated 188 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 12:39:05.539926 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-9828242f-b83c-4335-bcc3-c18a6faff528 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:39:05.540424 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-9828242f-b83c-4335-bcc3-c18a6faff528 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] [instance: b3800adf-8cae-407e-9a5e-9eb107bff58d] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:39:05.547597 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-9828242f-b83c-4335-bcc3-c18a6faff528 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:05.548088 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-9828242f-b83c-4335-bcc3-c18a6faff528 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:05.548526 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-9828242f-b83c-4335-bcc3-c18a6faff528 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:05.549221 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-9828242f-b83c-4335-bcc3-c18a6faff528 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:05.549740 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-9828242f-b83c-4335-bcc3-c18a6faff528 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:05.550168 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-9828242f-b83c-4335-bcc3-c18a6faff528 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:05.564850 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-d42aa65d-1edb-48f5-b759-ba668269fc48 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:39:05.565496 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-d42aa65d-1edb-48f5-b759-ba668269fc48 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] [instance: 4400e455-f03f-48be-a78e-c4886ef878c6] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:39:05.572233 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-d42aa65d-1edb-48f5-b759-ba668269fc48 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:05.572782 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-d42aa65d-1edb-48f5-b759-ba668269fc48 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:05.573318 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-d42aa65d-1edb-48f5-b759-ba668269fc48 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:05.574672 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-d42aa65d-1edb-48f5-b759-ba668269fc48 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:05.575208 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-d42aa65d-1edb-48f5-b759-ba668269fc48 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:05.575726 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-d42aa65d-1edb-48f5-b759-ba668269fc48 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:05.632177 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG dbcounter [-] [125441] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:39:05.727470 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-d42aa65d-1edb-48f5-b759-ba668269fc48 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b76d81ee9446cf9014a2e695ef03e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae8c589d0b84ce096451a10717fc601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:39:05.735421 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-d42aa65d-1edb-48f5-b759-ba668269fc48 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] 10.222.0.15 "GET /compute/v2.1/servers/4400e455-f03f-48be-a78e-c4886ef878c6" status: 200 len: 1266 microversion: 2.1 time: 0.174395 Oct 31 12:39:05.735979 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 422/833] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:39:05 2022] GET /compute/v2.1/servers/4400e455-f03f-48be-a78e-c4886ef878c6 => generated 1266 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 12:39:05.821173 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-9828242f-b83c-4335-bcc3-c18a6faff528 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] 10.222.0.15 "DELETE /compute/v2.1/servers/b3800adf-8cae-407e-9a5e-9eb107bff58d/os-volume_attachments/e42ea08b-4972-4acd-902d-b6489a6235e1" status: 202 len: 0 microversion: 2.20 time: 0.285573 Oct 31 12:39:05.821948 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 412/834] 10.222.0.15 () {60 vars in 1457 bytes} [Mon Oct 31 12:39:05 2022] DELETE /compute/v2.1/servers/b3800adf-8cae-407e-9a5e-9eb107bff58d/os-volume_attachments/e42ea08b-4972-4acd-902d-b6489a6235e1 => generated 0 bytes in 288 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 31 12:39:05.883057 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-e30ea8e8-99f1-40e0-b203-09b7ab7566fe tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 12:39:05.883678 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-e30ea8e8-99f1-40e0-b203-09b7ab7566fe tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] [instance: b3800adf-8cae-407e-9a5e-9eb107bff58d] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:39:05.890674 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-e30ea8e8-99f1-40e0-b203-09b7ab7566fe tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:05.891156 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-e30ea8e8-99f1-40e0-b203-09b7ab7566fe tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:05.891653 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-e30ea8e8-99f1-40e0-b203-09b7ab7566fe tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:05.892338 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-e30ea8e8-99f1-40e0-b203-09b7ab7566fe tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:05.892786 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-e30ea8e8-99f1-40e0-b203-09b7ab7566fe tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:05.893202 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-e30ea8e8-99f1-40e0-b203-09b7ab7566fe tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:05.937971 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-e30ea8e8-99f1-40e0-b203-09b7ab7566fe tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] [instance: b3800adf-8cae-407e-9a5e-9eb107bff58d] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=125440) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 31 12:39:06.007526 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-e30ea8e8-99f1-40e0-b203-09b7ab7566fe tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] 10.222.0.15 "POST /compute/v2.1/servers/b3800adf-8cae-407e-9a5e-9eb107bff58d/action" status: 202 len: 0 microversion: 2.20 time: 0.128320 Oct 31 12:39:06.010140 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 423/835] 10.222.0.15 () {62 vars in 1319 bytes} [Mon Oct 31 12:39:05 2022] POST /compute/v2.1/servers/b3800adf-8cae-407e-9a5e-9eb107bff58d/action => generated 0 bytes in 130 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 31 12:39:06.017139 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-cd4c4e47-cda0-48db-b43b-fb97f4fa1824 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:39:06.017742 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-cd4c4e47-cda0-48db-b43b-fb97f4fa1824 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] [instance: b3800adf-8cae-407e-9a5e-9eb107bff58d] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:39:06.025773 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-cd4c4e47-cda0-48db-b43b-fb97f4fa1824 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:06.026091 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-cd4c4e47-cda0-48db-b43b-fb97f4fa1824 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:06.026517 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-cd4c4e47-cda0-48db-b43b-fb97f4fa1824 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:06.027791 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-cd4c4e47-cda0-48db-b43b-fb97f4fa1824 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:06.028239 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-cd4c4e47-cda0-48db-b43b-fb97f4fa1824 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:06.028651 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-cd4c4e47-cda0-48db-b43b-fb97f4fa1824 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:06.167975 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-cd4c4e47-cda0-48db-b43b-fb97f4fa1824 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:39:06.176337 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-cd4c4e47-cda0-48db-b43b-fb97f4fa1824 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:39:06.177778 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-cd4c4e47-cda0-48db-b43b-fb97f4fa1824 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:39:06.178935 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-cd4c4e47-cda0-48db-b43b-fb97f4fa1824 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] 10.222.0.15 "GET /compute/v2.1/servers/b3800adf-8cae-407e-9a5e-9eb107bff58d" status: 200 len: 1673 microversion: 2.20 time: 0.166045 Oct 31 12:39:06.181627 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 413/836] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Oct 31 12:39:06 2022] GET /compute/v2.1/servers/b3800adf-8cae-407e-9a5e-9eb107bff58d => generated 1673 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 12:39:06.758709 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-4fb46283-be87-4eb8-ab3d-c8ac8d9f7913 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:39:06.759307 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-4fb46283-be87-4eb8-ab3d-c8ac8d9f7913 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] [instance: 4400e455-f03f-48be-a78e-c4886ef878c6] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:39:06.765188 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-4fb46283-be87-4eb8-ab3d-c8ac8d9f7913 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:06.765678 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-4fb46283-be87-4eb8-ab3d-c8ac8d9f7913 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:06.766093 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-4fb46283-be87-4eb8-ab3d-c8ac8d9f7913 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:06.766775 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-4fb46283-be87-4eb8-ab3d-c8ac8d9f7913 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:06.767456 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-4fb46283-be87-4eb8-ab3d-c8ac8d9f7913 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:06.767923 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-4fb46283-be87-4eb8-ab3d-c8ac8d9f7913 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:06.905548 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-4fb46283-be87-4eb8-ab3d-c8ac8d9f7913 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b76d81ee9446cf9014a2e695ef03e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae8c589d0b84ce096451a10717fc601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:39:06.913125 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-4fb46283-be87-4eb8-ab3d-c8ac8d9f7913 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] 10.222.0.15 "GET /compute/v2.1/servers/4400e455-f03f-48be-a78e-c4886ef878c6" status: 200 len: 1266 microversion: 2.1 time: 0.158944 Oct 31 12:39:06.913670 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 424/837] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:39:06 2022] GET /compute/v2.1/servers/4400e455-f03f-48be-a78e-c4886ef878c6 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:39:07.204859 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-0335a3f8-22f1-465c-8bd4-98d2c5b5887f tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:39:07.205630 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-0335a3f8-22f1-465c-8bd4-98d2c5b5887f tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] [instance: b3800adf-8cae-407e-9a5e-9eb107bff58d] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:39:07.207916 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG dbcounter [-] [125441] Writing DB stats nova_cell0:SELECT=2 {{(pid=125441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:39:07.208783 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG dbcounter [-] [125441] Writing DB stats nova_cell0:SELECT=8 {{(pid=125441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:39:07.213514 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-0335a3f8-22f1-465c-8bd4-98d2c5b5887f tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:07.213991 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-0335a3f8-22f1-465c-8bd4-98d2c5b5887f tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:07.214951 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-0335a3f8-22f1-465c-8bd4-98d2c5b5887f tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:07.215871 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-0335a3f8-22f1-465c-8bd4-98d2c5b5887f tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:07.216325 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-0335a3f8-22f1-465c-8bd4-98d2c5b5887f tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:07.216741 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-0335a3f8-22f1-465c-8bd4-98d2c5b5887f tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:07.356801 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-0335a3f8-22f1-465c-8bd4-98d2c5b5887f tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:39:07.365038 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-0335a3f8-22f1-465c-8bd4-98d2c5b5887f tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:39:07.366582 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-0335a3f8-22f1-465c-8bd4-98d2c5b5887f tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:39:07.367773 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-0335a3f8-22f1-465c-8bd4-98d2c5b5887f tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] 10.222.0.15 "GET /compute/v2.1/servers/b3800adf-8cae-407e-9a5e-9eb107bff58d" status: 200 len: 1731 microversion: 2.20 time: 0.167078 Oct 31 12:39:07.368325 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 414/838] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Oct 31 12:39:07 2022] GET /compute/v2.1/servers/b3800adf-8cae-407e-9a5e-9eb107bff58d => generated 1731 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 12:39:07.937285 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-8b115dfe-b2c9-4815-9ed8-0c37ef539e85 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:39:07.938065 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-8b115dfe-b2c9-4815-9ed8-0c37ef539e85 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] [instance: 4400e455-f03f-48be-a78e-c4886ef878c6] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:39:07.944671 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-8b115dfe-b2c9-4815-9ed8-0c37ef539e85 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:07.945158 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-8b115dfe-b2c9-4815-9ed8-0c37ef539e85 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:07.945644 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-8b115dfe-b2c9-4815-9ed8-0c37ef539e85 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:07.946366 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-8b115dfe-b2c9-4815-9ed8-0c37ef539e85 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:07.946819 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-8b115dfe-b2c9-4815-9ed8-0c37ef539e85 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:07.947258 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-8b115dfe-b2c9-4815-9ed8-0c37ef539e85 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:08.100199 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-8b115dfe-b2c9-4815-9ed8-0c37ef539e85 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b76d81ee9446cf9014a2e695ef03e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae8c589d0b84ce096451a10717fc601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:39:08.110812 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-8b115dfe-b2c9-4815-9ed8-0c37ef539e85 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] 10.222.0.15 "GET /compute/v2.1/servers/4400e455-f03f-48be-a78e-c4886ef878c6" status: 200 len: 1266 microversion: 2.1 time: 0.178088 Oct 31 12:39:08.111844 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 425/839] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:39:07 2022] GET /compute/v2.1/servers/4400e455-f03f-48be-a78e-c4886ef878c6 => generated 1266 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:39:08.396525 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-5daa4fe7-18b0-48b2-86ae-90747ad61d59 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:39:08.397904 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-5daa4fe7-18b0-48b2-86ae-90747ad61d59 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] [instance: b3800adf-8cae-407e-9a5e-9eb107bff58d] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:39:08.417039 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-5daa4fe7-18b0-48b2-86ae-90747ad61d59 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:08.418391 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-5daa4fe7-18b0-48b2-86ae-90747ad61d59 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:08.419039 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-5daa4fe7-18b0-48b2-86ae-90747ad61d59 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:08.419967 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-5daa4fe7-18b0-48b2-86ae-90747ad61d59 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:08.420653 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-5daa4fe7-18b0-48b2-86ae-90747ad61d59 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:08.421078 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-5daa4fe7-18b0-48b2-86ae-90747ad61d59 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:08.609155 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-5daa4fe7-18b0-48b2-86ae-90747ad61d59 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:39:08.625334 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-5daa4fe7-18b0-48b2-86ae-90747ad61d59 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:39:08.628011 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-5daa4fe7-18b0-48b2-86ae-90747ad61d59 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:39:08.629722 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-5daa4fe7-18b0-48b2-86ae-90747ad61d59 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] 10.222.0.15 "GET /compute/v2.1/servers/b3800adf-8cae-407e-9a5e-9eb107bff58d" status: 200 len: 1731 microversion: 2.20 time: 0.239448 Oct 31 12:39:08.630906 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 415/840] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Oct 31 12:39:08 2022] GET /compute/v2.1/servers/b3800adf-8cae-407e-9a5e-9eb107bff58d => generated 1731 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 12:39:09.133911 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-aea939a4-62b9-4b02-82c1-c03353d04155 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:39:09.134507 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-aea939a4-62b9-4b02-82c1-c03353d04155 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] [instance: 4400e455-f03f-48be-a78e-c4886ef878c6] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:39:09.141546 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-aea939a4-62b9-4b02-82c1-c03353d04155 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:09.142187 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-aea939a4-62b9-4b02-82c1-c03353d04155 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:09.142614 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-aea939a4-62b9-4b02-82c1-c03353d04155 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:09.143430 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-aea939a4-62b9-4b02-82c1-c03353d04155 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:09.144237 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-aea939a4-62b9-4b02-82c1-c03353d04155 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:09.144757 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-aea939a4-62b9-4b02-82c1-c03353d04155 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:09.302117 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-aea939a4-62b9-4b02-82c1-c03353d04155 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b76d81ee9446cf9014a2e695ef03e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae8c589d0b84ce096451a10717fc601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:39:09.310182 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-aea939a4-62b9-4b02-82c1-c03353d04155 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] 10.222.0.15 "GET /compute/v2.1/servers/4400e455-f03f-48be-a78e-c4886ef878c6" status: 200 len: 1266 microversion: 2.1 time: 0.180089 Oct 31 12:39:09.310849 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 426/841] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:39:09 2022] GET /compute/v2.1/servers/4400e455-f03f-48be-a78e-c4886ef878c6 => generated 1266 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:39:09.661760 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-540401e5-1860-4868-9041-30325b11fab8 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:39:09.662668 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-540401e5-1860-4868-9041-30325b11fab8 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] [instance: b3800adf-8cae-407e-9a5e-9eb107bff58d] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:39:09.669900 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-540401e5-1860-4868-9041-30325b11fab8 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:09.670470 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-540401e5-1860-4868-9041-30325b11fab8 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:09.670959 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-540401e5-1860-4868-9041-30325b11fab8 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:09.671765 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-540401e5-1860-4868-9041-30325b11fab8 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:09.672280 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-540401e5-1860-4868-9041-30325b11fab8 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:09.672764 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-540401e5-1860-4868-9041-30325b11fab8 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:09.847075 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-540401e5-1860-4868-9041-30325b11fab8 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:39:09.857214 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-540401e5-1860-4868-9041-30325b11fab8 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:39:09.858676 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-540401e5-1860-4868-9041-30325b11fab8 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:39:09.859993 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-540401e5-1860-4868-9041-30325b11fab8 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] 10.222.0.15 "GET /compute/v2.1/servers/b3800adf-8cae-407e-9a5e-9eb107bff58d" status: 200 len: 1731 microversion: 2.20 time: 0.202903 Oct 31 12:39:09.860587 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 416/842] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Oct 31 12:39:09 2022] GET /compute/v2.1/servers/b3800adf-8cae-407e-9a5e-9eb107bff58d => generated 1731 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 12:39:10.334370 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-afe48c45-5a2f-4b50-b9b7-f1225a3870df tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:39:10.334996 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-afe48c45-5a2f-4b50-b9b7-f1225a3870df tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] [instance: 4400e455-f03f-48be-a78e-c4886ef878c6] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:39:10.342094 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-afe48c45-5a2f-4b50-b9b7-f1225a3870df tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:10.342581 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-afe48c45-5a2f-4b50-b9b7-f1225a3870df tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:10.343015 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-afe48c45-5a2f-4b50-b9b7-f1225a3870df tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:10.343745 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-afe48c45-5a2f-4b50-b9b7-f1225a3870df tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:10.344202 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-afe48c45-5a2f-4b50-b9b7-f1225a3870df tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:10.344620 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-afe48c45-5a2f-4b50-b9b7-f1225a3870df tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:10.485702 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-afe48c45-5a2f-4b50-b9b7-f1225a3870df tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b76d81ee9446cf9014a2e695ef03e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae8c589d0b84ce096451a10717fc601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:39:10.493564 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-afe48c45-5a2f-4b50-b9b7-f1225a3870df tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] 10.222.0.15 "GET /compute/v2.1/servers/4400e455-f03f-48be-a78e-c4886ef878c6" status: 200 len: 1266 microversion: 2.1 time: 0.163268 Oct 31 12:39:10.494470 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 427/843] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:39:10 2022] GET /compute/v2.1/servers/4400e455-f03f-48be-a78e-c4886ef878c6 => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:39:10.885592 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-0ee9134a-0c59-4ab3-b610-9fa7f4f4b7b0 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:39:10.886292 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-0ee9134a-0c59-4ab3-b610-9fa7f4f4b7b0 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] [instance: b3800adf-8cae-407e-9a5e-9eb107bff58d] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:39:10.892745 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-0ee9134a-0c59-4ab3-b610-9fa7f4f4b7b0 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:10.893225 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-0ee9134a-0c59-4ab3-b610-9fa7f4f4b7b0 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:10.893917 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-0ee9134a-0c59-4ab3-b610-9fa7f4f4b7b0 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:10.894632 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-0ee9134a-0c59-4ab3-b610-9fa7f4f4b7b0 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:10.895118 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-0ee9134a-0c59-4ab3-b610-9fa7f4f4b7b0 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:10.895566 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-0ee9134a-0c59-4ab3-b610-9fa7f4f4b7b0 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:11.033650 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-0ee9134a-0c59-4ab3-b610-9fa7f4f4b7b0 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:39:11.041953 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-0ee9134a-0c59-4ab3-b610-9fa7f4f4b7b0 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:39:11.044469 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-0ee9134a-0c59-4ab3-b610-9fa7f4f4b7b0 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:39:11.045677 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-0ee9134a-0c59-4ab3-b610-9fa7f4f4b7b0 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] 10.222.0.15 "GET /compute/v2.1/servers/b3800adf-8cae-407e-9a5e-9eb107bff58d" status: 200 len: 1731 microversion: 2.20 time: 0.164006 Oct 31 12:39:11.046239 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 417/844] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Oct 31 12:39:10 2022] GET /compute/v2.1/servers/b3800adf-8cae-407e-9a5e-9eb107bff58d => generated 1731 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 12:39:11.518015 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-58ec08f9-667d-48e0-9669-2ee1731b5b6b tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:39:11.518862 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-58ec08f9-667d-48e0-9669-2ee1731b5b6b tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] [instance: 4400e455-f03f-48be-a78e-c4886ef878c6] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:39:11.525307 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-58ec08f9-667d-48e0-9669-2ee1731b5b6b tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:11.525788 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-58ec08f9-667d-48e0-9669-2ee1731b5b6b tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:11.526287 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-58ec08f9-667d-48e0-9669-2ee1731b5b6b tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:11.527549 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-58ec08f9-667d-48e0-9669-2ee1731b5b6b tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:11.528070 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-58ec08f9-667d-48e0-9669-2ee1731b5b6b tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:11.528657 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-58ec08f9-667d-48e0-9669-2ee1731b5b6b tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:11.922439 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-58ec08f9-667d-48e0-9669-2ee1731b5b6b tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b76d81ee9446cf9014a2e695ef03e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae8c589d0b84ce096451a10717fc601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:39:11.931043 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-58ec08f9-667d-48e0-9669-2ee1731b5b6b tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] 10.222.0.15 "GET /compute/v2.1/servers/4400e455-f03f-48be-a78e-c4886ef878c6" status: 200 len: 1266 microversion: 2.1 time: 0.416790 Oct 31 12:39:11.932108 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 428/845] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:39:11 2022] GET /compute/v2.1/servers/4400e455-f03f-48be-a78e-c4886ef878c6 => generated 1266 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 12:39:12.072505 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-eef02155-4891-48ca-a10f-708a63cc04cd tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:39:12.074256 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-eef02155-4891-48ca-a10f-708a63cc04cd tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] [instance: b3800adf-8cae-407e-9a5e-9eb107bff58d] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:39:12.081402 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-eef02155-4891-48ca-a10f-708a63cc04cd tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:12.082141 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-eef02155-4891-48ca-a10f-708a63cc04cd tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:12.082571 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-eef02155-4891-48ca-a10f-708a63cc04cd tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:12.083641 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-eef02155-4891-48ca-a10f-708a63cc04cd tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:12.084097 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-eef02155-4891-48ca-a10f-708a63cc04cd tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:12.084515 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-eef02155-4891-48ca-a10f-708a63cc04cd tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:12.236057 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-eef02155-4891-48ca-a10f-708a63cc04cd tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:39:12.244066 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-eef02155-4891-48ca-a10f-708a63cc04cd tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:39:12.246199 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-eef02155-4891-48ca-a10f-708a63cc04cd tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:39:12.247484 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-eef02155-4891-48ca-a10f-708a63cc04cd tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] 10.222.0.15 "GET /compute/v2.1/servers/b3800adf-8cae-407e-9a5e-9eb107bff58d" status: 200 len: 1731 microversion: 2.20 time: 0.180140 Oct 31 12:39:12.248230 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 418/846] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Oct 31 12:39:12 2022] GET /compute/v2.1/servers/b3800adf-8cae-407e-9a5e-9eb107bff58d => generated 1731 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 12:39:12.954462 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-c666ba97-7886-49ad-963b-efad098144fd tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:39:12.955062 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-c666ba97-7886-49ad-963b-efad098144fd tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] [instance: 4400e455-f03f-48be-a78e-c4886ef878c6] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:39:12.962372 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-c666ba97-7886-49ad-963b-efad098144fd tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:12.962853 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-c666ba97-7886-49ad-963b-efad098144fd tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:12.963575 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-c666ba97-7886-49ad-963b-efad098144fd tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:12.964897 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-c666ba97-7886-49ad-963b-efad098144fd tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:12.965454 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-c666ba97-7886-49ad-963b-efad098144fd tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:12.966070 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-c666ba97-7886-49ad-963b-efad098144fd tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:13.124881 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-c666ba97-7886-49ad-963b-efad098144fd tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b76d81ee9446cf9014a2e695ef03e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae8c589d0b84ce096451a10717fc601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:39:13.133064 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-c666ba97-7886-49ad-963b-efad098144fd tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] 10.222.0.15 "GET /compute/v2.1/servers/4400e455-f03f-48be-a78e-c4886ef878c6" status: 200 len: 1266 microversion: 2.1 time: 0.182304 Oct 31 12:39:13.133906 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 429/847] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:39:12 2022] GET /compute/v2.1/servers/4400e455-f03f-48be-a78e-c4886ef878c6 => generated 1266 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 12:39:13.273983 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-474f511e-d09a-4c4e-ab0a-91002584ad3f tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:39:13.274581 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-474f511e-d09a-4c4e-ab0a-91002584ad3f tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] [instance: b3800adf-8cae-407e-9a5e-9eb107bff58d] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:39:13.277424 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG dbcounter [-] [125441] Writing DB stats nova_api:SELECT=86,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=125441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:39:13.282667 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-474f511e-d09a-4c4e-ab0a-91002584ad3f tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:13.283145 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-474f511e-d09a-4c4e-ab0a-91002584ad3f tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:13.283605 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-474f511e-d09a-4c4e-ab0a-91002584ad3f tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:13.284321 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-474f511e-d09a-4c4e-ab0a-91002584ad3f tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:13.284770 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-474f511e-d09a-4c4e-ab0a-91002584ad3f tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:13.285182 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-474f511e-d09a-4c4e-ab0a-91002584ad3f tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:13.440081 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-474f511e-d09a-4c4e-ab0a-91002584ad3f tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:39:13.449686 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-474f511e-d09a-4c4e-ab0a-91002584ad3f tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:39:13.451371 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-474f511e-d09a-4c4e-ab0a-91002584ad3f tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:39:13.452575 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-474f511e-d09a-4c4e-ab0a-91002584ad3f tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] 10.222.0.15 "GET /compute/v2.1/servers/b3800adf-8cae-407e-9a5e-9eb107bff58d" status: 200 len: 1731 microversion: 2.20 time: 0.184076 Oct 31 12:39:13.453501 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 419/848] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Oct 31 12:39:13 2022] GET /compute/v2.1/servers/b3800adf-8cae-407e-9a5e-9eb107bff58d => generated 1731 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 12:39:14.158140 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-a266eec6-10cb-4a52-83ee-39845c23e638 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:39:14.158748 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-a266eec6-10cb-4a52-83ee-39845c23e638 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] [instance: 4400e455-f03f-48be-a78e-c4886ef878c6] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:39:14.165089 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-a266eec6-10cb-4a52-83ee-39845c23e638 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:14.165577 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-a266eec6-10cb-4a52-83ee-39845c23e638 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:14.165998 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-a266eec6-10cb-4a52-83ee-39845c23e638 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:14.166682 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-a266eec6-10cb-4a52-83ee-39845c23e638 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:14.167782 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-a266eec6-10cb-4a52-83ee-39845c23e638 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:14.168306 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-a266eec6-10cb-4a52-83ee-39845c23e638 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:14.322029 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-a266eec6-10cb-4a52-83ee-39845c23e638 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b76d81ee9446cf9014a2e695ef03e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae8c589d0b84ce096451a10717fc601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:39:14.332162 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-a266eec6-10cb-4a52-83ee-39845c23e638 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] 10.222.0.15 "GET /compute/v2.1/servers/4400e455-f03f-48be-a78e-c4886ef878c6" status: 200 len: 1266 microversion: 2.1 time: 0.177646 Oct 31 12:39:14.332833 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 430/849] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:39:14 2022] GET /compute/v2.1/servers/4400e455-f03f-48be-a78e-c4886ef878c6 => generated 1266 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:39:14.478793 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-303a0111-163e-47a6-b0bf-ccee9aa0f318 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:39:14.479459 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-303a0111-163e-47a6-b0bf-ccee9aa0f318 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] [instance: b3800adf-8cae-407e-9a5e-9eb107bff58d] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:39:14.486179 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-303a0111-163e-47a6-b0bf-ccee9aa0f318 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:14.486661 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-303a0111-163e-47a6-b0bf-ccee9aa0f318 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:14.487310 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-303a0111-163e-47a6-b0bf-ccee9aa0f318 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:14.488005 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-303a0111-163e-47a6-b0bf-ccee9aa0f318 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:14.488455 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-303a0111-163e-47a6-b0bf-ccee9aa0f318 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:14.489070 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-303a0111-163e-47a6-b0bf-ccee9aa0f318 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:14.629375 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-303a0111-163e-47a6-b0bf-ccee9aa0f318 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:39:14.639095 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-303a0111-163e-47a6-b0bf-ccee9aa0f318 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:39:14.640605 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-303a0111-163e-47a6-b0bf-ccee9aa0f318 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:39:14.641766 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-303a0111-163e-47a6-b0bf-ccee9aa0f318 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] 10.222.0.15 "GET /compute/v2.1/servers/b3800adf-8cae-407e-9a5e-9eb107bff58d" status: 200 len: 1731 microversion: 2.20 time: 0.166884 Oct 31 12:39:14.642324 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 420/850] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Oct 31 12:39:14 2022] GET /compute/v2.1/servers/b3800adf-8cae-407e-9a5e-9eb107bff58d => generated 1731 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 12:39:15.358556 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-b80c9cfc-889e-40d4-b427-ab34e57db9b5 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:39:15.359065 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-b80c9cfc-889e-40d4-b427-ab34e57db9b5 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] [instance: 4400e455-f03f-48be-a78e-c4886ef878c6] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:39:15.365787 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-b80c9cfc-889e-40d4-b427-ab34e57db9b5 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:15.366271 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-b80c9cfc-889e-40d4-b427-ab34e57db9b5 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:15.366700 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-b80c9cfc-889e-40d4-b427-ab34e57db9b5 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:15.367521 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-b80c9cfc-889e-40d4-b427-ab34e57db9b5 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:15.368153 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-b80c9cfc-889e-40d4-b427-ab34e57db9b5 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:15.368647 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-b80c9cfc-889e-40d4-b427-ab34e57db9b5 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:15.541940 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-b80c9cfc-889e-40d4-b427-ab34e57db9b5 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b76d81ee9446cf9014a2e695ef03e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae8c589d0b84ce096451a10717fc601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:39:15.550046 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-b80c9cfc-889e-40d4-b427-ab34e57db9b5 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] 10.222.0.15 "GET /compute/v2.1/servers/4400e455-f03f-48be-a78e-c4886ef878c6" status: 200 len: 1266 microversion: 2.1 time: 0.195979 Oct 31 12:39:15.551221 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 431/851] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:39:15 2022] GET /compute/v2.1/servers/4400e455-f03f-48be-a78e-c4886ef878c6 => generated 1266 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:39:15.669275 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-a693a00f-50de-409a-9a95-bc41354cccc5 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:39:15.670785 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-a693a00f-50de-409a-9a95-bc41354cccc5 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] [instance: b3800adf-8cae-407e-9a5e-9eb107bff58d] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:39:15.677597 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-a693a00f-50de-409a-9a95-bc41354cccc5 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:15.678212 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-a693a00f-50de-409a-9a95-bc41354cccc5 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:15.678822 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-a693a00f-50de-409a-9a95-bc41354cccc5 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:15.679675 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-a693a00f-50de-409a-9a95-bc41354cccc5 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:15.680340 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-a693a00f-50de-409a-9a95-bc41354cccc5 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:15.680879 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-a693a00f-50de-409a-9a95-bc41354cccc5 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:15.834957 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-a693a00f-50de-409a-9a95-bc41354cccc5 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:39:15.845309 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-a693a00f-50de-409a-9a95-bc41354cccc5 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:39:15.846785 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-a693a00f-50de-409a-9a95-bc41354cccc5 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:39:15.847990 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-a693a00f-50de-409a-9a95-bc41354cccc5 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] 10.222.0.15 "GET /compute/v2.1/servers/b3800adf-8cae-407e-9a5e-9eb107bff58d" status: 200 len: 1731 microversion: 2.20 time: 0.183176 Oct 31 12:39:15.848547 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 421/852] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Oct 31 12:39:15 2022] GET /compute/v2.1/servers/b3800adf-8cae-407e-9a5e-9eb107bff58d => generated 1731 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 12:39:16.574627 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-367c1980-04a4-4aac-957d-c83a595849b8 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:39:16.575339 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-367c1980-04a4-4aac-957d-c83a595849b8 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] [instance: 4400e455-f03f-48be-a78e-c4886ef878c6] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:39:16.582276 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-367c1980-04a4-4aac-957d-c83a595849b8 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:16.582718 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-367c1980-04a4-4aac-957d-c83a595849b8 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:16.583258 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-367c1980-04a4-4aac-957d-c83a595849b8 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:16.583987 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-367c1980-04a4-4aac-957d-c83a595849b8 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:16.584443 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-367c1980-04a4-4aac-957d-c83a595849b8 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:16.584868 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-367c1980-04a4-4aac-957d-c83a595849b8 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:16.751087 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-367c1980-04a4-4aac-957d-c83a595849b8 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b76d81ee9446cf9014a2e695ef03e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae8c589d0b84ce096451a10717fc601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:39:16.760063 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-367c1980-04a4-4aac-957d-c83a595849b8 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] 10.222.0.15 "GET /compute/v2.1/servers/4400e455-f03f-48be-a78e-c4886ef878c6" status: 200 len: 1266 microversion: 2.1 time: 0.189493 Oct 31 12:39:16.763598 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 432/853] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:39:16 2022] GET /compute/v2.1/servers/4400e455-f03f-48be-a78e-c4886ef878c6 => generated 1266 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:39:16.876421 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-6c46db92-6db5-44e5-a6cc-df650c501947 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:39:16.877669 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-6c46db92-6db5-44e5-a6cc-df650c501947 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] [instance: b3800adf-8cae-407e-9a5e-9eb107bff58d] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:39:16.884267 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-6c46db92-6db5-44e5-a6cc-df650c501947 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:16.884761 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-6c46db92-6db5-44e5-a6cc-df650c501947 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:16.885206 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-6c46db92-6db5-44e5-a6cc-df650c501947 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:16.887029 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-6c46db92-6db5-44e5-a6cc-df650c501947 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:16.887530 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-6c46db92-6db5-44e5-a6cc-df650c501947 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:16.887957 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-6c46db92-6db5-44e5-a6cc-df650c501947 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:17.027914 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-6c46db92-6db5-44e5-a6cc-df650c501947 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:39:17.038024 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-6c46db92-6db5-44e5-a6cc-df650c501947 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:39:17.039596 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-6c46db92-6db5-44e5-a6cc-df650c501947 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:39:17.040865 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-6c46db92-6db5-44e5-a6cc-df650c501947 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] 10.222.0.15 "GET /compute/v2.1/servers/b3800adf-8cae-407e-9a5e-9eb107bff58d" status: 200 len: 1731 microversion: 2.20 time: 0.169034 Oct 31 12:39:17.041411 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 422/854] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Oct 31 12:39:16 2022] GET /compute/v2.1/servers/b3800adf-8cae-407e-9a5e-9eb107bff58d => generated 1731 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 12:39:17.213711 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-061c7d33-dd59-421b-b3b4-e552e6513257 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:39:17.214461 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-061c7d33-dd59-421b-b3b4-e552e6513257 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] [instance: 0a62e143-71fb-4080-9691-fea9a84eaaca] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:39:17.221086 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-061c7d33-dd59-421b-b3b4-e552e6513257 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:17.222327 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-061c7d33-dd59-421b-b3b4-e552e6513257 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:17.222850 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-061c7d33-dd59-421b-b3b4-e552e6513257 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:17.223649 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-061c7d33-dd59-421b-b3b4-e552e6513257 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:17.224104 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-061c7d33-dd59-421b-b3b4-e552e6513257 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:17.224573 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-061c7d33-dd59-421b-b3b4-e552e6513257 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:17.251009 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-061c7d33-dd59-421b-b3b4-e552e6513257 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] 10.222.0.15 "GET /compute/v2.1/servers/0a62e143-71fb-4080-9691-fea9a84eaaca/ips" status: 200 len: 149 microversion: 2.1 time: 0.041073 Oct 31 12:39:17.251618 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 433/855] 10.222.0.15 () {58 vars in 1248 bytes} [Mon Oct 31 12:39:17 2022] GET /compute/v2.1/servers/0a62e143-71fb-4080-9691-fea9a84eaaca/ips => generated 149 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 12:39:17.782771 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-163d1f56-df05-4096-9404-70db256c4db6 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:39:17.783401 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-163d1f56-df05-4096-9404-70db256c4db6 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] [instance: 4400e455-f03f-48be-a78e-c4886ef878c6] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:39:17.790102 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-163d1f56-df05-4096-9404-70db256c4db6 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:17.790514 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-163d1f56-df05-4096-9404-70db256c4db6 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:17.791029 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-163d1f56-df05-4096-9404-70db256c4db6 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:17.791821 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-163d1f56-df05-4096-9404-70db256c4db6 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:17.792287 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-163d1f56-df05-4096-9404-70db256c4db6 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:17.792712 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-163d1f56-df05-4096-9404-70db256c4db6 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:17.938568 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-163d1f56-df05-4096-9404-70db256c4db6 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b76d81ee9446cf9014a2e695ef03e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae8c589d0b84ce096451a10717fc601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:39:17.950948 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-163d1f56-df05-4096-9404-70db256c4db6 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] 10.222.0.15 "GET /compute/v2.1/servers/4400e455-f03f-48be-a78e-c4886ef878c6" status: 200 len: 1266 microversion: 2.1 time: 0.171983 Oct 31 12:39:17.951850 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 423/856] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:39:17 2022] GET /compute/v2.1/servers/4400e455-f03f-48be-a78e-c4886ef878c6 => generated 1266 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:39:18.065915 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-5376d273-f5b5-4b74-9f42-792dda158390 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:39:18.066521 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-5376d273-f5b5-4b74-9f42-792dda158390 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] [instance: b3800adf-8cae-407e-9a5e-9eb107bff58d] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:39:18.072943 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-5376d273-f5b5-4b74-9f42-792dda158390 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:18.073990 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-5376d273-f5b5-4b74-9f42-792dda158390 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:18.074417 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-5376d273-f5b5-4b74-9f42-792dda158390 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:18.075102 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-5376d273-f5b5-4b74-9f42-792dda158390 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:18.075620 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-5376d273-f5b5-4b74-9f42-792dda158390 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:18.076039 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-5376d273-f5b5-4b74-9f42-792dda158390 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:18.210736 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-5376d273-f5b5-4b74-9f42-792dda158390 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:39:18.220097 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-5376d273-f5b5-4b74-9f42-792dda158390 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:39:18.221645 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-5376d273-f5b5-4b74-9f42-792dda158390 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:39:18.225237 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-5376d273-f5b5-4b74-9f42-792dda158390 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] 10.222.0.15 "GET /compute/v2.1/servers/b3800adf-8cae-407e-9a5e-9eb107bff58d" status: 200 len: 1731 microversion: 2.20 time: 0.160876 Oct 31 12:39:18.225825 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 434/857] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Oct 31 12:39:18 2022] GET /compute/v2.1/servers/b3800adf-8cae-407e-9a5e-9eb107bff58d => generated 1731 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 12:39:18.608695 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-77704b37-eace-4538-b818-3fea5b5df144 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "de5c3eb1-93f9-4c18-a651-8ac52fde01f9"}} {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 12:39:18.611112 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-77704b37-eace-4538-b818-3fea5b5df144 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] [instance: 0a62e143-71fb-4080-9691-fea9a84eaaca] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:39:18.617287 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-77704b37-eace-4538-b818-3fea5b5df144 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:18.617766 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-77704b37-eace-4538-b818-3fea5b5df144 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:18.618195 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-77704b37-eace-4538-b818-3fea5b5df144 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:18.618879 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-77704b37-eace-4538-b818-3fea5b5df144 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:18.619359 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-77704b37-eace-4538-b818-3fea5b5df144 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:18.619806 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-77704b37-eace-4538-b818-3fea5b5df144 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:18.975099 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-75de2447-5b50-4363-a545-fc9475724898 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:39:18.975636 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-75de2447-5b50-4363-a545-fc9475724898 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] [instance: 4400e455-f03f-48be-a78e-c4886ef878c6] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:39:18.981639 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-75de2447-5b50-4363-a545-fc9475724898 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:18.982116 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-75de2447-5b50-4363-a545-fc9475724898 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:18.982544 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-75de2447-5b50-4363-a545-fc9475724898 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:18.983249 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-75de2447-5b50-4363-a545-fc9475724898 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:18.983706 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-75de2447-5b50-4363-a545-fc9475724898 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:18.984119 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-75de2447-5b50-4363-a545-fc9475724898 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:18.998312 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG dbcounter [-] [125440] Writing DB stats nova_cell1:INSERT=4,nova_cell1:SELECT=91,nova_cell1:UPDATE=5 {{(pid=125440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:39:19.119020 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-75de2447-5b50-4363-a545-fc9475724898 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b76d81ee9446cf9014a2e695ef03e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae8c589d0b84ce096451a10717fc601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:39:19.127503 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-75de2447-5b50-4363-a545-fc9475724898 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] 10.222.0.15 "GET /compute/v2.1/servers/4400e455-f03f-48be-a78e-c4886ef878c6" status: 200 len: 1266 microversion: 2.1 time: 0.156100 Oct 31 12:39:19.128073 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 435/858] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:39:18 2022] GET /compute/v2.1/servers/4400e455-f03f-48be-a78e-c4886ef878c6 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 12:39:19.251659 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-72dafcab-9665-448e-a48d-cb900a7d3efe tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:39:19.252170 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-72dafcab-9665-448e-a48d-cb900a7d3efe tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] [instance: b3800adf-8cae-407e-9a5e-9eb107bff58d] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:39:19.258328 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-72dafcab-9665-448e-a48d-cb900a7d3efe tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:19.258766 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-72dafcab-9665-448e-a48d-cb900a7d3efe tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:19.259105 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-72dafcab-9665-448e-a48d-cb900a7d3efe tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:19.259817 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-72dafcab-9665-448e-a48d-cb900a7d3efe tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:19.260271 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-72dafcab-9665-448e-a48d-cb900a7d3efe tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:19.260697 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-72dafcab-9665-448e-a48d-cb900a7d3efe tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:19.412202 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-72dafcab-9665-448e-a48d-cb900a7d3efe tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:39:19.421605 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-72dafcab-9665-448e-a48d-cb900a7d3efe tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:39:19.423307 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-72dafcab-9665-448e-a48d-cb900a7d3efe tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:39:19.424708 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-72dafcab-9665-448e-a48d-cb900a7d3efe tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] 10.222.0.15 "GET /compute/v2.1/servers/b3800adf-8cae-407e-9a5e-9eb107bff58d" status: 200 len: 1731 microversion: 2.20 time: 0.177002 Oct 31 12:39:19.425336 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 436/859] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Oct 31 12:39:19 2022] GET /compute/v2.1/servers/b3800adf-8cae-407e-9a5e-9eb107bff58d => generated 1731 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 12:39:19.470609 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-918c19c4-7f23-4b73-ae76-8772cb08c843 tempest-VolumesNegativeTest-1210908864 tempest-VolumesNegativeTest-1210908864-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1776421424", "imageRef": "fbbea321-8f0d-4092-b070-b67a6931d610", "flavorRef": "452"}} {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 12:39:19.500525 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-77704b37-eace-4538-b818-3fea5b5df144 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] 10.222.0.15 "POST /compute/v2.1/servers/0a62e143-71fb-4080-9691-fea9a84eaaca/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.896245 Oct 31 12:39:19.501219 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 424/860] 10.222.0.15 () {60 vars in 1323 bytes} [Mon Oct 31 12:39:18 2022] POST /compute/v2.1/servers/0a62e143-71fb-4080-9691-fea9a84eaaca/os-volume_attachments => generated 194 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 12:39:19.528870 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.network.neutron [None req-918c19c4-7f23-4b73-ae76-8772cb08c843 tempest-VolumesNegativeTest-1210908864 tempest-VolumesNegativeTest-1210908864-project] validate_networks() for None {{(pid=125440) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 12:39:19.800405 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.virt.hardware [None req-918c19c4-7f23-4b73-ae76-8772cb08c843 tempest-VolumesNegativeTest-1210908864 tempest-VolumesNegativeTest-1210908864-project] Flavor limits 0:0:0 {{(pid=125440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 12:39:19.800820 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.virt.hardware [None req-918c19c4-7f23-4b73-ae76-8772cb08c843 tempest-VolumesNegativeTest-1210908864 tempest-VolumesNegativeTest-1210908864-project] Image limits 0:0:0 {{(pid=125440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 12:39:19.801286 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.virt.hardware [None req-918c19c4-7f23-4b73-ae76-8772cb08c843 tempest-VolumesNegativeTest-1210908864 tempest-VolumesNegativeTest-1210908864-project] Flavor pref 0:0:0 {{(pid=125440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 12:39:19.801689 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.virt.hardware [None req-918c19c4-7f23-4b73-ae76-8772cb08c843 tempest-VolumesNegativeTest-1210908864 tempest-VolumesNegativeTest-1210908864-project] Image pref 0:0:0 {{(pid=125440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 12:39:19.802094 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.virt.hardware [None req-918c19c4-7f23-4b73-ae76-8772cb08c843 tempest-VolumesNegativeTest-1210908864 tempest-VolumesNegativeTest-1210908864-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 12:39:19.811810 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-918c19c4-7f23-4b73-ae76-8772cb08c843 tempest-VolumesNegativeTest-1210908864 tempest-VolumesNegativeTest-1210908864-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:19.812283 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-918c19c4-7f23-4b73-ae76-8772cb08c843 tempest-VolumesNegativeTest-1210908864 tempest-VolumesNegativeTest-1210908864-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:19.812706 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-918c19c4-7f23-4b73-ae76-8772cb08c843 tempest-VolumesNegativeTest-1210908864 tempest-VolumesNegativeTest-1210908864-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:19.813418 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-918c19c4-7f23-4b73-ae76-8772cb08c843 tempest-VolumesNegativeTest-1210908864 tempest-VolumesNegativeTest-1210908864-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:19.813863 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-918c19c4-7f23-4b73-ae76-8772cb08c843 tempest-VolumesNegativeTest-1210908864 tempest-VolumesNegativeTest-1210908864-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:19.814274 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-918c19c4-7f23-4b73-ae76-8772cb08c843 tempest-VolumesNegativeTest-1210908864 tempest-VolumesNegativeTest-1210908864-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:19.831058 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.quota [None req-918c19c4-7f23-4b73-ae76-8772cb08c843 tempest-VolumesNegativeTest-1210908864 tempest-VolumesNegativeTest-1210908864-project] Getting quotas for project 741f915aad03472e8373166c4d7fd380. Resources: {'instances', 'cores', 'ram'} {{(pid=125440) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 12:39:19.835216 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.quota [None req-918c19c4-7f23-4b73-ae76-8772cb08c843 tempest-VolumesNegativeTest-1210908864 tempest-VolumesNegativeTest-1210908864-project] Getting quotas for user 66eb8a35b8b64ad0adaa54971706420e and project 741f915aad03472e8373166c4d7fd380. Resources: {'instances', 'cores', 'ram'} {{(pid=125440) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 12:39:19.846190 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-918c19c4-7f23-4b73-ae76-8772cb08c843 tempest-VolumesNegativeTest-1210908864 tempest-VolumesNegativeTest-1210908864-project] Going to run 1 instances... {{(pid=125440) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 12:39:19.848497 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-918c19c4-7f23-4b73-ae76-8772cb08c843 tempest-VolumesNegativeTest-1210908864 tempest-VolumesNegativeTest-1210908864-project] [instance: 0284c601-38fb-4270-8808-44aaf4b96c73] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fbbea321-8f0d-4092-b070-b67a6931d610',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125440) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 12:39:19.892817 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-918c19c4-7f23-4b73-ae76-8772cb08c843 tempest-VolumesNegativeTest-1210908864 tempest-VolumesNegativeTest-1210908864-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.425935 Oct 31 12:39:19.893465 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 437/861] 10.222.0.15 () {60 vars in 1147 bytes} [Mon Oct 31 12:39:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 427 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 12:39:19.905728 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-72fab262-385a-45e9-888e-ab05129ac8d0 tempest-VolumesNegativeTest-1210908864 tempest-VolumesNegativeTest-1210908864-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:39:19.906418 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-72fab262-385a-45e9-888e-ab05129ac8d0 tempest-VolumesNegativeTest-1210908864 tempest-VolumesNegativeTest-1210908864-project] [instance: 0284c601-38fb-4270-8808-44aaf4b96c73] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:39:19.975567 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-72fab262-385a-45e9-888e-ab05129ac8d0 tempest-VolumesNegativeTest-1210908864 tempest-VolumesNegativeTest-1210908864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66eb8a35b8b64ad0adaa54971706420e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741f915aad03472e8373166c4d7fd380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:39:19.984401 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-72fab262-385a-45e9-888e-ab05129ac8d0 tempest-VolumesNegativeTest-1210908864 tempest-VolumesNegativeTest-1210908864-project] 10.222.0.15 "GET /compute/v2.1/servers/0284c601-38fb-4270-8808-44aaf4b96c73" status: 200 len: 1215 microversion: 2.1 time: 0.083305 Oct 31 12:39:19.986647 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 425/862] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:39:19 2022] GET /compute/v2.1/servers/0284c601-38fb-4270-8808-44aaf4b96c73 => generated 1215 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:39:20.152057 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-00ca6afa-5f9d-4bde-8a5b-65de9875274a tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:39:20.152860 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-00ca6afa-5f9d-4bde-8a5b-65de9875274a tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] [instance: 4400e455-f03f-48be-a78e-c4886ef878c6] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:39:20.160459 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-00ca6afa-5f9d-4bde-8a5b-65de9875274a tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:20.160947 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-00ca6afa-5f9d-4bde-8a5b-65de9875274a tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:20.161368 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-00ca6afa-5f9d-4bde-8a5b-65de9875274a tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:20.162066 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-00ca6afa-5f9d-4bde-8a5b-65de9875274a tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:20.162588 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-00ca6afa-5f9d-4bde-8a5b-65de9875274a tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:20.163048 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-00ca6afa-5f9d-4bde-8a5b-65de9875274a tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:20.302716 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-00ca6afa-5f9d-4bde-8a5b-65de9875274a tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b76d81ee9446cf9014a2e695ef03e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae8c589d0b84ce096451a10717fc601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:39:20.315987 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-00ca6afa-5f9d-4bde-8a5b-65de9875274a tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] 10.222.0.15 "GET /compute/v2.1/servers/4400e455-f03f-48be-a78e-c4886ef878c6" status: 200 len: 1266 microversion: 2.1 time: 0.168242 Oct 31 12:39:20.317528 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 438/863] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:39:20 2022] GET /compute/v2.1/servers/4400e455-f03f-48be-a78e-c4886ef878c6 => generated 1266 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:39:20.452016 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-89318748-ae37-4046-a131-70c7c0e6001a tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:39:20.452498 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-9534daf5-6501-4102-952f-c1ee97158579 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:39:20.453172 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-9534daf5-6501-4102-952f-c1ee97158579 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] [instance: b3800adf-8cae-407e-9a5e-9eb107bff58d] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:39:20.454875 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-89318748-ae37-4046-a131-70c7c0e6001a tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] [instance: 96065a23-4a5f-4ffb-8b48-746d2dc2c301] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:39:20.459745 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-9534daf5-6501-4102-952f-c1ee97158579 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:20.460439 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-9534daf5-6501-4102-952f-c1ee97158579 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:20.461185 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-9534daf5-6501-4102-952f-c1ee97158579 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:20.462026 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-9534daf5-6501-4102-952f-c1ee97158579 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:20.462903 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-9534daf5-6501-4102-952f-c1ee97158579 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:20.463501 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-9534daf5-6501-4102-952f-c1ee97158579 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:20.466734 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-89318748-ae37-4046-a131-70c7c0e6001a tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:20.467430 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-89318748-ae37-4046-a131-70c7c0e6001a tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:20.468034 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-89318748-ae37-4046-a131-70c7c0e6001a tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:20.468886 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-89318748-ae37-4046-a131-70c7c0e6001a tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:20.469522 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-89318748-ae37-4046-a131-70c7c0e6001a tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:20.469942 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-89318748-ae37-4046-a131-70c7c0e6001a tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:20.492448 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG dbcounter [-] [125441] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=3,nova_cell1:UPDATE=6 {{(pid=125441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:39:20.509262 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-89318748-ae37-4046-a131-70c7c0e6001a tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] 10.222.0.15 "GET /compute/v2.1/servers/96065a23-4a5f-4ffb-8b48-746d2dc2c301/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.062327 Oct 31 12:39:20.511915 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 426/864] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Oct 31 12:39:20 2022] GET /compute/v2.1/servers/96065a23-4a5f-4ffb-8b48-746d2dc2c301/os-volume_attachments => generated 371 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 12:39:20.636707 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-9534daf5-6501-4102-952f-c1ee97158579 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:39:20.650125 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-9534daf5-6501-4102-952f-c1ee97158579 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:39:20.653248 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-9534daf5-6501-4102-952f-c1ee97158579 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:39:20.654745 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-9534daf5-6501-4102-952f-c1ee97158579 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] 10.222.0.15 "GET /compute/v2.1/servers/b3800adf-8cae-407e-9a5e-9eb107bff58d" status: 200 len: 1731 microversion: 2.20 time: 0.207740 Oct 31 12:39:20.655351 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 439/865] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Oct 31 12:39:20 2022] GET /compute/v2.1/servers/b3800adf-8cae-407e-9a5e-9eb107bff58d => generated 1731 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 12:39:20.662221 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-1b7a35aa-780a-4083-9731-d77ab12caf70 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:39:20.662810 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-1b7a35aa-780a-4083-9731-d77ab12caf70 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] [instance: 96065a23-4a5f-4ffb-8b48-746d2dc2c301] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:39:20.673074 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-1b7a35aa-780a-4083-9731-d77ab12caf70 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:20.673694 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-1b7a35aa-780a-4083-9731-d77ab12caf70 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:20.674133 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-1b7a35aa-780a-4083-9731-d77ab12caf70 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:20.674826 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-1b7a35aa-780a-4083-9731-d77ab12caf70 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:20.675314 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-1b7a35aa-780a-4083-9731-d77ab12caf70 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:20.675740 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-1b7a35aa-780a-4083-9731-d77ab12caf70 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:20.705734 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-1b7a35aa-780a-4083-9731-d77ab12caf70 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] 10.222.0.15 "GET /compute/v2.1/servers/96065a23-4a5f-4ffb-8b48-746d2dc2c301/os-volume_attachments/96cdc07c-d303-40fe-bf84-df0948c2012f" status: 200 len: 194 microversion: 2.1 time: 0.047555 Oct 31 12:39:20.707410 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 427/866] 10.222.0.15 () {58 vars in 1413 bytes} [Mon Oct 31 12:39:20 2022] GET /compute/v2.1/servers/96065a23-4a5f-4ffb-8b48-746d2dc2c301/os-volume_attachments/96cdc07c-d303-40fe-bf84-df0948c2012f => generated 194 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 12:39:20.717298 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-7674e6be-0126-47e5-b0a1-7442ab8fd1bf tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:39:20.717780 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-7674e6be-0126-47e5-b0a1-7442ab8fd1bf tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] [instance: 96065a23-4a5f-4ffb-8b48-746d2dc2c301] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:39:20.723525 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-7674e6be-0126-47e5-b0a1-7442ab8fd1bf tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:20.723996 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-7674e6be-0126-47e5-b0a1-7442ab8fd1bf tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:20.724420 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-7674e6be-0126-47e5-b0a1-7442ab8fd1bf tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:20.725094 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-7674e6be-0126-47e5-b0a1-7442ab8fd1bf tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:20.726894 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-7674e6be-0126-47e5-b0a1-7442ab8fd1bf tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:20.727420 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-7674e6be-0126-47e5-b0a1-7442ab8fd1bf tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:20.815114 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.objects.instance [None req-7674e6be-0126-47e5-b0a1-7442ab8fd1bf tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lazy-loading 'services' on Instance uuid 96065a23-4a5f-4ffb-8b48-746d2dc2c301 {{(pid=125440) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 12:39:20.890599 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-7674e6be-0126-47e5-b0a1-7442ab8fd1bf tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] 10.222.0.15 "DELETE /compute/v2.1/servers/96065a23-4a5f-4ffb-8b48-746d2dc2c301/os-volume_attachments/96cdc07c-d303-40fe-bf84-df0948c2012f" status: 202 len: 0 microversion: 2.1 time: 0.177641 Oct 31 12:39:20.891305 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 440/867] 10.222.0.15 () {58 vars in 1416 bytes} [Mon Oct 31 12:39:20 2022] DELETE /compute/v2.1/servers/96065a23-4a5f-4ffb-8b48-746d2dc2c301/os-volume_attachments/96cdc07c-d303-40fe-bf84-df0948c2012f => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 12:39:21.009066 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-76a3ed1a-cae8-4779-a998-41e3b42c2831 tempest-VolumesNegativeTest-1210908864 tempest-VolumesNegativeTest-1210908864-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:39:21.009809 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-76a3ed1a-cae8-4779-a998-41e3b42c2831 tempest-VolumesNegativeTest-1210908864 tempest-VolumesNegativeTest-1210908864-project] [instance: 0284c601-38fb-4270-8808-44aaf4b96c73] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:39:21.017308 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-76a3ed1a-cae8-4779-a998-41e3b42c2831 tempest-VolumesNegativeTest-1210908864 tempest-VolumesNegativeTest-1210908864-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:21.017825 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-76a3ed1a-cae8-4779-a998-41e3b42c2831 tempest-VolumesNegativeTest-1210908864 tempest-VolumesNegativeTest-1210908864-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:21.018264 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-76a3ed1a-cae8-4779-a998-41e3b42c2831 tempest-VolumesNegativeTest-1210908864 tempest-VolumesNegativeTest-1210908864-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:21.019285 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-76a3ed1a-cae8-4779-a998-41e3b42c2831 tempest-VolumesNegativeTest-1210908864 tempest-VolumesNegativeTest-1210908864-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:21.019744 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-76a3ed1a-cae8-4779-a998-41e3b42c2831 tempest-VolumesNegativeTest-1210908864 tempest-VolumesNegativeTest-1210908864-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:21.020165 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-76a3ed1a-cae8-4779-a998-41e3b42c2831 tempest-VolumesNegativeTest-1210908864 tempest-VolumesNegativeTest-1210908864-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:21.081944 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-76a3ed1a-cae8-4779-a998-41e3b42c2831 tempest-VolumesNegativeTest-1210908864 tempest-VolumesNegativeTest-1210908864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66eb8a35b8b64ad0adaa54971706420e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741f915aad03472e8373166c4d7fd380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:39:21.090294 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-76a3ed1a-cae8-4779-a998-41e3b42c2831 tempest-VolumesNegativeTest-1210908864 tempest-VolumesNegativeTest-1210908864-project] 10.222.0.15 "GET /compute/v2.1/servers/0284c601-38fb-4270-8808-44aaf4b96c73" status: 200 len: 1267 microversion: 2.1 time: 0.084967 Oct 31 12:39:21.090849 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 428/868] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:39:21 2022] GET /compute/v2.1/servers/0284c601-38fb-4270-8808-44aaf4b96c73 => generated 1267 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:39:21.341710 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-03736a4c-542e-44e6-be6e-f4c7d0551158 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:39:21.342518 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-03736a4c-542e-44e6-be6e-f4c7d0551158 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] [instance: 4400e455-f03f-48be-a78e-c4886ef878c6] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:39:21.359277 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-03736a4c-542e-44e6-be6e-f4c7d0551158 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:21.359871 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-03736a4c-542e-44e6-be6e-f4c7d0551158 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:21.360401 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-03736a4c-542e-44e6-be6e-f4c7d0551158 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:21.361170 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-03736a4c-542e-44e6-be6e-f4c7d0551158 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:21.361734 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-03736a4c-542e-44e6-be6e-f4c7d0551158 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:21.362212 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-03736a4c-542e-44e6-be6e-f4c7d0551158 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:21.555728 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-03736a4c-542e-44e6-be6e-f4c7d0551158 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b76d81ee9446cf9014a2e695ef03e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae8c589d0b84ce096451a10717fc601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:39:21.564578 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-03736a4c-542e-44e6-be6e-f4c7d0551158 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] 10.222.0.15 "GET /compute/v2.1/servers/4400e455-f03f-48be-a78e-c4886ef878c6" status: 200 len: 1266 microversion: 2.1 time: 0.227308 Oct 31 12:39:21.565161 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 441/869] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:39:21 2022] GET /compute/v2.1/servers/4400e455-f03f-48be-a78e-c4886ef878c6 => generated 1266 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:39:21.682010 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-8effca93-8178-46c1-ae13-d0a68a1f385a tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:39:21.684261 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-8effca93-8178-46c1-ae13-d0a68a1f385a tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] [instance: b3800adf-8cae-407e-9a5e-9eb107bff58d] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:39:21.692442 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-8effca93-8178-46c1-ae13-d0a68a1f385a tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:21.693352 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-8effca93-8178-46c1-ae13-d0a68a1f385a tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:21.693838 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-8effca93-8178-46c1-ae13-d0a68a1f385a tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:21.694465 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-8effca93-8178-46c1-ae13-d0a68a1f385a tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:21.694908 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-8effca93-8178-46c1-ae13-d0a68a1f385a tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:21.695757 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-8effca93-8178-46c1-ae13-d0a68a1f385a tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:21.833814 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-8effca93-8178-46c1-ae13-d0a68a1f385a tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:39:21.842107 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-8effca93-8178-46c1-ae13-d0a68a1f385a tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:39:21.843705 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-8effca93-8178-46c1-ae13-d0a68a1f385a tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:39:21.844858 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-8effca93-8178-46c1-ae13-d0a68a1f385a tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] 10.222.0.15 "GET /compute/v2.1/servers/b3800adf-8cae-407e-9a5e-9eb107bff58d" status: 200 len: 1731 microversion: 2.20 time: 0.168635 Oct 31 12:39:21.845422 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 429/870] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Oct 31 12:39:21 2022] GET /compute/v2.1/servers/b3800adf-8cae-407e-9a5e-9eb107bff58d => generated 1731 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 12:39:22.113201 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-9ee4b085-5ce9-4420-a6aa-a3662d211821 tempest-VolumesNegativeTest-1210908864 tempest-VolumesNegativeTest-1210908864-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:39:22.113804 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-9ee4b085-5ce9-4420-a6aa-a3662d211821 tempest-VolumesNegativeTest-1210908864 tempest-VolumesNegativeTest-1210908864-project] [instance: 0284c601-38fb-4270-8808-44aaf4b96c73] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:39:22.119699 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-9ee4b085-5ce9-4420-a6aa-a3662d211821 tempest-VolumesNegativeTest-1210908864 tempest-VolumesNegativeTest-1210908864-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:22.120498 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-9ee4b085-5ce9-4420-a6aa-a3662d211821 tempest-VolumesNegativeTest-1210908864 tempest-VolumesNegativeTest-1210908864-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:22.120965 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-9ee4b085-5ce9-4420-a6aa-a3662d211821 tempest-VolumesNegativeTest-1210908864 tempest-VolumesNegativeTest-1210908864-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:22.121661 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-9ee4b085-5ce9-4420-a6aa-a3662d211821 tempest-VolumesNegativeTest-1210908864 tempest-VolumesNegativeTest-1210908864-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:22.122108 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-9ee4b085-5ce9-4420-a6aa-a3662d211821 tempest-VolumesNegativeTest-1210908864 tempest-VolumesNegativeTest-1210908864-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:22.122522 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-9ee4b085-5ce9-4420-a6aa-a3662d211821 tempest-VolumesNegativeTest-1210908864 tempest-VolumesNegativeTest-1210908864-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:22.359978 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-9ee4b085-5ce9-4420-a6aa-a3662d211821 tempest-VolumesNegativeTest-1210908864 tempest-VolumesNegativeTest-1210908864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66eb8a35b8b64ad0adaa54971706420e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741f915aad03472e8373166c4d7fd380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:39:22.368195 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-9ee4b085-5ce9-4420-a6aa-a3662d211821 tempest-VolumesNegativeTest-1210908864 tempest-VolumesNegativeTest-1210908864-project] 10.222.0.15 "GET /compute/v2.1/servers/0284c601-38fb-4270-8808-44aaf4b96c73" status: 200 len: 1315 microversion: 2.1 time: 0.258758 Oct 31 12:39:22.369157 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 442/871] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:39:22 2022] GET /compute/v2.1/servers/0284c601-38fb-4270-8808-44aaf4b96c73 => generated 1315 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:39:22.591700 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-59ff000f-c352-464b-ba10-f09d28bb362e tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:39:22.592452 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-59ff000f-c352-464b-ba10-f09d28bb362e tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] [instance: 4400e455-f03f-48be-a78e-c4886ef878c6] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:39:22.598921 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-59ff000f-c352-464b-ba10-f09d28bb362e tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:22.599730 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-59ff000f-c352-464b-ba10-f09d28bb362e tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:22.600157 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-59ff000f-c352-464b-ba10-f09d28bb362e tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:22.600857 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-59ff000f-c352-464b-ba10-f09d28bb362e tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:22.601310 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-59ff000f-c352-464b-ba10-f09d28bb362e tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:22.601726 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-59ff000f-c352-464b-ba10-f09d28bb362e tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:22.759135 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-59ff000f-c352-464b-ba10-f09d28bb362e tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b76d81ee9446cf9014a2e695ef03e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae8c589d0b84ce096451a10717fc601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:39:22.773046 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-59ff000f-c352-464b-ba10-f09d28bb362e tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] 10.222.0.15 "GET /compute/v2.1/servers/4400e455-f03f-48be-a78e-c4886ef878c6" status: 200 len: 1266 microversion: 2.1 time: 0.183124 Oct 31 12:39:22.773196 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [req-0b05e9e6-d501-42f9-86f7-525891412d97 req-a3e38bca-fd91-4e89-be6c-281172f07f29 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4400e455-f03f-48be-a78e-c4886ef878c6", "name": "network-vif-plugged", "status": "completed", "tag": "a1f478e3-0037-482b-9f12-361410fca1f5"}]} {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 12:39:22.784642 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [req-0b05e9e6-d501-42f9-86f7-525891412d97 req-a3e38bca-fd91-4e89-be6c-281172f07f29 service nova] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:22.785230 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [req-0b05e9e6-d501-42f9-86f7-525891412d97 req-a3e38bca-fd91-4e89-be6c-281172f07f29 service nova] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:22.785660 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [req-0b05e9e6-d501-42f9-86f7-525891412d97 req-a3e38bca-fd91-4e89-be6c-281172f07f29 service nova] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:22.789260 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 430/872] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:39:22 2022] GET /compute/v2.1/servers/4400e455-f03f-48be-a78e-c4886ef878c6 => generated 1266 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:39:22.803250 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.compute.server_external_events [req-0b05e9e6-d501-42f9-86f7-525891412d97 req-a3e38bca-fd91-4e89-be6c-281172f07f29 service nova] Creating event network-vif-plugged:a1f478e3-0037-482b-9f12-361410fca1f5 for instance 4400e455-f03f-48be-a78e-c4886ef878c6 on hv-cinder-79617 Oct 31 12:39:22.809195 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [req-0b05e9e6-d501-42f9-86f7-525891412d97 req-a3e38bca-fd91-4e89-be6c-281172f07f29 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043981 Oct 31 12:39:22.810384 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 443/873] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Oct 31 12:39:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 12:39:22.872600 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-f9b7f982-c747-478b-8694-aac222379ecf tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:39:22.873164 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-f9b7f982-c747-478b-8694-aac222379ecf tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] [instance: b3800adf-8cae-407e-9a5e-9eb107bff58d] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:39:22.882308 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-f9b7f982-c747-478b-8694-aac222379ecf tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:22.884372 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-f9b7f982-c747-478b-8694-aac222379ecf tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:22.885017 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-f9b7f982-c747-478b-8694-aac222379ecf tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:22.889349 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [req-4d5e6c52-3110-4599-b40c-ce51ccbc8762 req-9c951b0f-6610-4f35-a716-f247057e7c60 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0284c601-38fb-4270-8808-44aaf4b96c73", "tag": "165b6d01-75c7-4d1f-9584-92ce0f4b1ea8"}]} {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 12:39:22.891858 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-f9b7f982-c747-478b-8694-aac222379ecf tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:22.892436 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-f9b7f982-c747-478b-8694-aac222379ecf tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:22.892906 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-f9b7f982-c747-478b-8694-aac222379ecf tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:22.916343 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [req-4d5e6c52-3110-4599-b40c-ce51ccbc8762 req-9c951b0f-6610-4f35-a716-f247057e7c60 service nova] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:22.917022 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [req-4d5e6c52-3110-4599-b40c-ce51ccbc8762 req-9c951b0f-6610-4f35-a716-f247057e7c60 service nova] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:22.918187 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [req-4d5e6c52-3110-4599-b40c-ce51ccbc8762 req-9c951b0f-6610-4f35-a716-f247057e7c60 service nova] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:22.931150 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.compute.server_external_events [req-4d5e6c52-3110-4599-b40c-ce51ccbc8762 req-9c951b0f-6610-4f35-a716-f247057e7c60 service nova] Creating event network-changed:165b6d01-75c7-4d1f-9584-92ce0f4b1ea8 for instance 0284c601-38fb-4270-8808-44aaf4b96c73 on hv-cinder-79617 Oct 31 12:39:22.937662 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [req-4d5e6c52-3110-4599-b40c-ce51ccbc8762 req-9c951b0f-6610-4f35-a716-f247057e7c60 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056650 Oct 31 12:39:22.938280 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 444/874] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Oct 31 12:39:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 12:39:23.051733 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-f9b7f982-c747-478b-8694-aac222379ecf tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:39:23.062537 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-f9b7f982-c747-478b-8694-aac222379ecf tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:39:23.064467 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-f9b7f982-c747-478b-8694-aac222379ecf tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:39:23.066453 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-f9b7f982-c747-478b-8694-aac222379ecf tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] 10.222.0.15 "GET /compute/v2.1/servers/b3800adf-8cae-407e-9a5e-9eb107bff58d" status: 200 len: 1731 microversion: 2.20 time: 0.199321 Oct 31 12:39:23.076787 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 431/875] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Oct 31 12:39:22 2022] GET /compute/v2.1/servers/b3800adf-8cae-407e-9a5e-9eb107bff58d => generated 1731 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 12:39:23.392816 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-d251f18b-8ee5-4f3d-aaaf-2e1422a97e54 tempest-VolumesNegativeTest-1210908864 tempest-VolumesNegativeTest-1210908864-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:39:23.393750 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-d251f18b-8ee5-4f3d-aaaf-2e1422a97e54 tempest-VolumesNegativeTest-1210908864 tempest-VolumesNegativeTest-1210908864-project] [instance: 0284c601-38fb-4270-8808-44aaf4b96c73] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:39:23.399784 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-d251f18b-8ee5-4f3d-aaaf-2e1422a97e54 tempest-VolumesNegativeTest-1210908864 tempest-VolumesNegativeTest-1210908864-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:23.400261 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-d251f18b-8ee5-4f3d-aaaf-2e1422a97e54 tempest-VolumesNegativeTest-1210908864 tempest-VolumesNegativeTest-1210908864-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:23.400686 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-d251f18b-8ee5-4f3d-aaaf-2e1422a97e54 tempest-VolumesNegativeTest-1210908864 tempest-VolumesNegativeTest-1210908864-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:23.401400 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-d251f18b-8ee5-4f3d-aaaf-2e1422a97e54 tempest-VolumesNegativeTest-1210908864 tempest-VolumesNegativeTest-1210908864-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:23.401847 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-d251f18b-8ee5-4f3d-aaaf-2e1422a97e54 tempest-VolumesNegativeTest-1210908864 tempest-VolumesNegativeTest-1210908864-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:23.402263 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-d251f18b-8ee5-4f3d-aaaf-2e1422a97e54 tempest-VolumesNegativeTest-1210908864 tempest-VolumesNegativeTest-1210908864-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:23.602164 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-d251f18b-8ee5-4f3d-aaaf-2e1422a97e54 tempest-VolumesNegativeTest-1210908864 tempest-VolumesNegativeTest-1210908864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66eb8a35b8b64ad0adaa54971706420e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741f915aad03472e8373166c4d7fd380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:39:23.610660 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-d251f18b-8ee5-4f3d-aaaf-2e1422a97e54 tempest-VolumesNegativeTest-1210908864 tempest-VolumesNegativeTest-1210908864-project] 10.222.0.15 "GET /compute/v2.1/servers/0284c601-38fb-4270-8808-44aaf4b96c73" status: 200 len: 1315 microversion: 2.1 time: 0.222528 Oct 31 12:39:23.611357 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 445/876] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:39:23 2022] GET /compute/v2.1/servers/0284c601-38fb-4270-8808-44aaf4b96c73 => generated 1315 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:39:23.797184 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-2350496b-5968-43f6-8e20-6eb8f50ad39d tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:39:23.797798 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-2350496b-5968-43f6-8e20-6eb8f50ad39d tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] [instance: 4400e455-f03f-48be-a78e-c4886ef878c6] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:39:23.804152 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-2350496b-5968-43f6-8e20-6eb8f50ad39d tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:23.804635 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-2350496b-5968-43f6-8e20-6eb8f50ad39d tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:23.805067 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-2350496b-5968-43f6-8e20-6eb8f50ad39d tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:23.805754 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-2350496b-5968-43f6-8e20-6eb8f50ad39d tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:23.806211 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-2350496b-5968-43f6-8e20-6eb8f50ad39d tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:23.806636 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-2350496b-5968-43f6-8e20-6eb8f50ad39d tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:23.940178 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-2350496b-5968-43f6-8e20-6eb8f50ad39d tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b76d81ee9446cf9014a2e695ef03e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae8c589d0b84ce096451a10717fc601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:39:23.947680 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-2350496b-5968-43f6-8e20-6eb8f50ad39d tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] 10.222.0.15 "GET /compute/v2.1/servers/4400e455-f03f-48be-a78e-c4886ef878c6" status: 200 len: 1266 microversion: 2.1 time: 0.154392 Oct 31 12:39:23.948765 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 432/877] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:39:23 2022] GET /compute/v2.1/servers/4400e455-f03f-48be-a78e-c4886ef878c6 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:39:24.094183 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-7859ef2d-3e4b-4b08-afc7-8653a433d3a9 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:39:24.094783 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-7859ef2d-3e4b-4b08-afc7-8653a433d3a9 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] [instance: b3800adf-8cae-407e-9a5e-9eb107bff58d] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:39:24.096735 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG dbcounter [-] [125440] Writing DB stats nova_api:SELECT=87,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=125440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:39:24.101974 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-7859ef2d-3e4b-4b08-afc7-8653a433d3a9 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:24.102387 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-7859ef2d-3e4b-4b08-afc7-8653a433d3a9 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:24.102842 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-7859ef2d-3e4b-4b08-afc7-8653a433d3a9 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:24.103577 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-7859ef2d-3e4b-4b08-afc7-8653a433d3a9 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:24.104015 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-7859ef2d-3e4b-4b08-afc7-8653a433d3a9 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:24.104510 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-7859ef2d-3e4b-4b08-afc7-8653a433d3a9 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:24.242380 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-7859ef2d-3e4b-4b08-afc7-8653a433d3a9 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:39:24.251135 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-7859ef2d-3e4b-4b08-afc7-8653a433d3a9 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:39:24.252590 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-7859ef2d-3e4b-4b08-afc7-8653a433d3a9 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:39:24.253755 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-7859ef2d-3e4b-4b08-afc7-8653a433d3a9 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] 10.222.0.15 "GET /compute/v2.1/servers/b3800adf-8cae-407e-9a5e-9eb107bff58d" status: 200 len: 1731 microversion: 2.20 time: 0.163489 Oct 31 12:39:24.254308 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 446/878] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Oct 31 12:39:24 2022] GET /compute/v2.1/servers/b3800adf-8cae-407e-9a5e-9eb107bff58d => generated 1731 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 12:39:24.633299 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-d2f1248a-cf11-4c9a-843b-e05f26f0380c tempest-VolumesNegativeTest-1210908864 tempest-VolumesNegativeTest-1210908864-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:39:24.634021 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-d2f1248a-cf11-4c9a-843b-e05f26f0380c tempest-VolumesNegativeTest-1210908864 tempest-VolumesNegativeTest-1210908864-project] [instance: 0284c601-38fb-4270-8808-44aaf4b96c73] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:39:24.640383 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-d2f1248a-cf11-4c9a-843b-e05f26f0380c tempest-VolumesNegativeTest-1210908864 tempest-VolumesNegativeTest-1210908864-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:24.640866 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-d2f1248a-cf11-4c9a-843b-e05f26f0380c tempest-VolumesNegativeTest-1210908864 tempest-VolumesNegativeTest-1210908864-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:24.641296 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-d2f1248a-cf11-4c9a-843b-e05f26f0380c tempest-VolumesNegativeTest-1210908864 tempest-VolumesNegativeTest-1210908864-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:24.641993 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-d2f1248a-cf11-4c9a-843b-e05f26f0380c tempest-VolumesNegativeTest-1210908864 tempest-VolumesNegativeTest-1210908864-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:24.642440 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-d2f1248a-cf11-4c9a-843b-e05f26f0380c tempest-VolumesNegativeTest-1210908864 tempest-VolumesNegativeTest-1210908864-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:24.642869 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-d2f1248a-cf11-4c9a-843b-e05f26f0380c tempest-VolumesNegativeTest-1210908864 tempest-VolumesNegativeTest-1210908864-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:24.778847 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-d2f1248a-cf11-4c9a-843b-e05f26f0380c tempest-VolumesNegativeTest-1210908864 tempest-VolumesNegativeTest-1210908864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66eb8a35b8b64ad0adaa54971706420e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741f915aad03472e8373166c4d7fd380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:39:24.788102 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-d2f1248a-cf11-4c9a-843b-e05f26f0380c tempest-VolumesNegativeTest-1210908864 tempest-VolumesNegativeTest-1210908864-project] 10.222.0.15 "GET /compute/v2.1/servers/0284c601-38fb-4270-8808-44aaf4b96c73" status: 200 len: 1315 microversion: 2.1 time: 0.158774 Oct 31 12:39:24.788692 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 433/879] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:39:24 2022] GET /compute/v2.1/servers/0284c601-38fb-4270-8808-44aaf4b96c73 => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:39:24.832901 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [req-423e4eb3-132e-4b49-a0af-c98b249c0de5 req-75858555-04eb-4c1e-b2e8-9ecfc9e0e952 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3800adf-8cae-407e-9a5e-9eb107bff58d", "name": "network-vif-plugged", "status": "completed", "tag": "360a1655-b233-4d4d-a557-dc89ddf2b18e"}]} {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 12:39:24.843603 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [req-423e4eb3-132e-4b49-a0af-c98b249c0de5 req-75858555-04eb-4c1e-b2e8-9ecfc9e0e952 service nova] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:24.844078 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [req-423e4eb3-132e-4b49-a0af-c98b249c0de5 req-75858555-04eb-4c1e-b2e8-9ecfc9e0e952 service nova] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:24.844503 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [req-423e4eb3-132e-4b49-a0af-c98b249c0de5 req-75858555-04eb-4c1e-b2e8-9ecfc9e0e952 service nova] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:24.856856 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.compute.server_external_events [req-423e4eb3-132e-4b49-a0af-c98b249c0de5 req-75858555-04eb-4c1e-b2e8-9ecfc9e0e952 service nova] Creating event network-vif-plugged:360a1655-b233-4d4d-a557-dc89ddf2b18e for instance b3800adf-8cae-407e-9a5e-9eb107bff58d on hv-cinder-79617 Oct 31 12:39:24.861781 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [req-423e4eb3-132e-4b49-a0af-c98b249c0de5 req-75858555-04eb-4c1e-b2e8-9ecfc9e0e952 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033048 Oct 31 12:39:24.862396 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 447/880] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Oct 31 12:39:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 12:39:24.971091 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-75b5277d-3343-4ea6-b16a-c709ace955c6 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:39:24.971656 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-75b5277d-3343-4ea6-b16a-c709ace955c6 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] [instance: 4400e455-f03f-48be-a78e-c4886ef878c6] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:39:24.978380 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-75b5277d-3343-4ea6-b16a-c709ace955c6 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:24.979397 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-75b5277d-3343-4ea6-b16a-c709ace955c6 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:24.980569 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-75b5277d-3343-4ea6-b16a-c709ace955c6 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:24.981323 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-75b5277d-3343-4ea6-b16a-c709ace955c6 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:24.981798 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-75b5277d-3343-4ea6-b16a-c709ace955c6 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:24.982422 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-75b5277d-3343-4ea6-b16a-c709ace955c6 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:25.132602 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-75b5277d-3343-4ea6-b16a-c709ace955c6 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b76d81ee9446cf9014a2e695ef03e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae8c589d0b84ce096451a10717fc601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:39:25.141670 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-75b5277d-3343-4ea6-b16a-c709ace955c6 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] 10.222.0.15 "GET /compute/v2.1/servers/4400e455-f03f-48be-a78e-c4886ef878c6" status: 200 len: 1266 microversion: 2.1 time: 0.174528 Oct 31 12:39:25.142259 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 434/881] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:39:24 2022] GET /compute/v2.1/servers/4400e455-f03f-48be-a78e-c4886ef878c6 => generated 1266 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:39:25.280521 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-d6a4f4ad-faa4-4d9e-a14d-28f247a8ead3 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:39:25.281337 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-d6a4f4ad-faa4-4d9e-a14d-28f247a8ead3 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] [instance: b3800adf-8cae-407e-9a5e-9eb107bff58d] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:39:25.287373 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-d6a4f4ad-faa4-4d9e-a14d-28f247a8ead3 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:25.287840 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-d6a4f4ad-faa4-4d9e-a14d-28f247a8ead3 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:25.288259 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-d6a4f4ad-faa4-4d9e-a14d-28f247a8ead3 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:25.288925 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-d6a4f4ad-faa4-4d9e-a14d-28f247a8ead3 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:25.289367 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-d6a4f4ad-faa4-4d9e-a14d-28f247a8ead3 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:25.289774 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-d6a4f4ad-faa4-4d9e-a14d-28f247a8ead3 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:25.456413 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-ae835d9d-a147-42e6-957d-39df5350dee4 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:39:25.457802 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-ae835d9d-a147-42e6-957d-39df5350dee4 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] [instance: b8c93a18-ee0e-438e-823c-cf51f9d4985f] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:39:25.467933 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-ae835d9d-a147-42e6-957d-39df5350dee4 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:25.468417 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-ae835d9d-a147-42e6-957d-39df5350dee4 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:25.469058 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-ae835d9d-a147-42e6-957d-39df5350dee4 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:25.470540 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-ae835d9d-a147-42e6-957d-39df5350dee4 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:25.471082 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-ae835d9d-a147-42e6-957d-39df5350dee4 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:25.471497 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-ae835d9d-a147-42e6-957d-39df5350dee4 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:25.501938 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-ae835d9d-a147-42e6-957d-39df5350dee4 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] [instance: b8c93a18-ee0e-438e-823c-cf51f9d4985f] Going to try to terminate instance {{(pid=125441) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 12:39:25.604934 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-ae835d9d-a147-42e6-957d-39df5350dee4 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] 10.222.0.15 "DELETE /compute/v2.1/servers/b8c93a18-ee0e-438e-823c-cf51f9d4985f" status: 204 len: 0 microversion: 2.1 time: 0.153258 Oct 31 12:39:25.605827 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 435/882] 10.222.0.15 () {58 vars in 1239 bytes} [Mon Oct 31 12:39:25 2022] DELETE /compute/v2.1/servers/b8c93a18-ee0e-438e-823c-cf51f9d4985f => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 31 12:39:25.612072 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [req-cd5613d3-4644-4419-9198-79abec84885b req-54bfdd85-53a8-4517-9e4e-ab56eab392c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b8c93a18-ee0e-438e-823c-cf51f9d4985f", "tag": "c444a742-6430-4bab-91f7-bff045443454"}]} {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 12:39:25.621575 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [req-cd5613d3-4644-4419-9198-79abec84885b req-54bfdd85-53a8-4517-9e4e-ab56eab392c4 service nova] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:25.622044 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [req-cd5613d3-4644-4419-9198-79abec84885b req-54bfdd85-53a8-4517-9e4e-ab56eab392c4 service nova] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:25.622460 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [req-cd5613d3-4644-4419-9198-79abec84885b req-54bfdd85-53a8-4517-9e4e-ab56eab392c4 service nova] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:25.634775 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.compute.server_external_events [req-cd5613d3-4644-4419-9198-79abec84885b req-54bfdd85-53a8-4517-9e4e-ab56eab392c4 service nova] Creating event network-changed:c444a742-6430-4bab-91f7-bff045443454 for instance b8c93a18-ee0e-438e-823c-cf51f9d4985f on hv-cinder-79617 Oct 31 12:39:25.640675 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [req-cd5613d3-4644-4419-9198-79abec84885b req-54bfdd85-53a8-4517-9e4e-ab56eab392c4 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033336 Oct 31 12:39:25.641270 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 436/883] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Oct 31 12:39:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 12:39:25.647754 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-a9d8dd10-c1ba-423c-a0b5-a59bb229f1e2 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:39:25.647877 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-d6a4f4ad-faa4-4d9e-a14d-28f247a8ead3 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:39:25.648714 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-a9d8dd10-c1ba-423c-a0b5-a59bb229f1e2 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] [instance: b8c93a18-ee0e-438e-823c-cf51f9d4985f] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:39:25.655623 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-a9d8dd10-c1ba-423c-a0b5-a59bb229f1e2 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:25.656511 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-a9d8dd10-c1ba-423c-a0b5-a59bb229f1e2 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:25.657125 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-a9d8dd10-c1ba-423c-a0b5-a59bb229f1e2 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:25.658176 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-a9d8dd10-c1ba-423c-a0b5-a59bb229f1e2 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:25.658620 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-a9d8dd10-c1ba-423c-a0b5-a59bb229f1e2 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:25.659220 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-a9d8dd10-c1ba-423c-a0b5-a59bb229f1e2 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:25.662564 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-d6a4f4ad-faa4-4d9e-a14d-28f247a8ead3 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:39:25.664041 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-d6a4f4ad-faa4-4d9e-a14d-28f247a8ead3 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:39:25.665365 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-d6a4f4ad-faa4-4d9e-a14d-28f247a8ead3 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] 10.222.0.15 "GET /compute/v2.1/servers/b3800adf-8cae-407e-9a5e-9eb107bff58d" status: 200 len: 1731 microversion: 2.20 time: 0.389604 Oct 31 12:39:25.680762 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 448/884] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Oct 31 12:39:25 2022] GET /compute/v2.1/servers/b3800adf-8cae-407e-9a5e-9eb107bff58d => generated 1731 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 12:39:25.796186 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-a9d8dd10-c1ba-423c-a0b5-a59bb229f1e2 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825059319a204b6da5bc7004b3a09361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14b98f006574deabc030c2e93c680c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:39:25.804148 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-a9d8dd10-c1ba-423c-a0b5-a59bb229f1e2 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] 10.222.0.15 "GET /compute/v2.1/servers/b8c93a18-ee0e-438e-823c-cf51f9d4985f" status: 200 len: 1567 microversion: 2.1 time: 0.161627 Oct 31 12:39:25.804947 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 437/885] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:39:25 2022] GET /compute/v2.1/servers/b8c93a18-ee0e-438e-823c-cf51f9d4985f => generated 1567 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:39:25.821188 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-9f5062f0-83e8-4c83-8e14-bae041e75f9e tempest-VolumesNegativeTest-1210908864 tempest-VolumesNegativeTest-1210908864-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:39:25.821797 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-9f5062f0-83e8-4c83-8e14-bae041e75f9e tempest-VolumesNegativeTest-1210908864 tempest-VolumesNegativeTest-1210908864-project] [instance: 0284c601-38fb-4270-8808-44aaf4b96c73] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:39:25.829021 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-9f5062f0-83e8-4c83-8e14-bae041e75f9e tempest-VolumesNegativeTest-1210908864 tempest-VolumesNegativeTest-1210908864-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:25.829524 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-9f5062f0-83e8-4c83-8e14-bae041e75f9e tempest-VolumesNegativeTest-1210908864 tempest-VolumesNegativeTest-1210908864-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:25.829952 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-9f5062f0-83e8-4c83-8e14-bae041e75f9e tempest-VolumesNegativeTest-1210908864 tempest-VolumesNegativeTest-1210908864-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:25.830651 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-9f5062f0-83e8-4c83-8e14-bae041e75f9e tempest-VolumesNegativeTest-1210908864 tempest-VolumesNegativeTest-1210908864-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:25.831099 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-9f5062f0-83e8-4c83-8e14-bae041e75f9e tempest-VolumesNegativeTest-1210908864 tempest-VolumesNegativeTest-1210908864-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:25.831580 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-9f5062f0-83e8-4c83-8e14-bae041e75f9e tempest-VolumesNegativeTest-1210908864 tempest-VolumesNegativeTest-1210908864-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:25.967672 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-9f5062f0-83e8-4c83-8e14-bae041e75f9e tempest-VolumesNegativeTest-1210908864 tempest-VolumesNegativeTest-1210908864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66eb8a35b8b64ad0adaa54971706420e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741f915aad03472e8373166c4d7fd380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:39:25.975925 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-9f5062f0-83e8-4c83-8e14-bae041e75f9e tempest-VolumesNegativeTest-1210908864 tempest-VolumesNegativeTest-1210908864-project] 10.222.0.15 "GET /compute/v2.1/servers/0284c601-38fb-4270-8808-44aaf4b96c73" status: 200 len: 1315 microversion: 2.1 time: 0.158522 Oct 31 12:39:25.983215 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 449/886] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:39:25 2022] GET /compute/v2.1/servers/0284c601-38fb-4270-8808-44aaf4b96c73 => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 12:39:26.165314 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-1e1030af-faf5-448b-a3ef-4d36f56f0367 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:39:26.165946 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-1e1030af-faf5-448b-a3ef-4d36f56f0367 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] [instance: 4400e455-f03f-48be-a78e-c4886ef878c6] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:39:26.172462 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-1e1030af-faf5-448b-a3ef-4d36f56f0367 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:26.172941 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-1e1030af-faf5-448b-a3ef-4d36f56f0367 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:26.173374 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-1e1030af-faf5-448b-a3ef-4d36f56f0367 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:26.174059 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-1e1030af-faf5-448b-a3ef-4d36f56f0367 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:26.174508 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-1e1030af-faf5-448b-a3ef-4d36f56f0367 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:26.174927 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-1e1030af-faf5-448b-a3ef-4d36f56f0367 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:26.312852 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-1e1030af-faf5-448b-a3ef-4d36f56f0367 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b76d81ee9446cf9014a2e695ef03e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae8c589d0b84ce096451a10717fc601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:39:26.320911 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-1e1030af-faf5-448b-a3ef-4d36f56f0367 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] 10.222.0.15 "GET /compute/v2.1/servers/4400e455-f03f-48be-a78e-c4886ef878c6" status: 200 len: 1453 microversion: 2.1 time: 0.159498 Oct 31 12:39:26.321474 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 438/887] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:39:26 2022] GET /compute/v2.1/servers/4400e455-f03f-48be-a78e-c4886ef878c6 => generated 1453 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:39:26.343512 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-b7889ff6-d509-4dcb-9e14-4b75f960128b tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:39:26.344117 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-b7889ff6-d509-4dcb-9e14-4b75f960128b tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] [instance: 4400e455-f03f-48be-a78e-c4886ef878c6] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:39:26.350441 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-b7889ff6-d509-4dcb-9e14-4b75f960128b tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:26.350921 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-b7889ff6-d509-4dcb-9e14-4b75f960128b tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:26.351393 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-b7889ff6-d509-4dcb-9e14-4b75f960128b tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:26.352075 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-b7889ff6-d509-4dcb-9e14-4b75f960128b tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:26.352522 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-b7889ff6-d509-4dcb-9e14-4b75f960128b tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:26.352935 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-b7889ff6-d509-4dcb-9e14-4b75f960128b tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:26.484835 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-b7889ff6-d509-4dcb-9e14-4b75f960128b tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b76d81ee9446cf9014a2e695ef03e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae8c589d0b84ce096451a10717fc601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:39:26.492554 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-b7889ff6-d509-4dcb-9e14-4b75f960128b tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] 10.222.0.15 "GET /compute/v2.1/servers/4400e455-f03f-48be-a78e-c4886ef878c6" status: 200 len: 1453 microversion: 2.1 time: 0.152872 Oct 31 12:39:26.493122 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 450/888] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:39:26 2022] GET /compute/v2.1/servers/4400e455-f03f-48be-a78e-c4886ef878c6 => generated 1453 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:39:26.693347 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-99776704-b58c-4dd9-8b8c-a58415a7d09d tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:39:26.693953 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-99776704-b58c-4dd9-8b8c-a58415a7d09d tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] [instance: b3800adf-8cae-407e-9a5e-9eb107bff58d] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:39:26.701029 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-99776704-b58c-4dd9-8b8c-a58415a7d09d tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:26.701511 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-99776704-b58c-4dd9-8b8c-a58415a7d09d tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:26.701935 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-99776704-b58c-4dd9-8b8c-a58415a7d09d tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:26.702615 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-99776704-b58c-4dd9-8b8c-a58415a7d09d tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:26.703074 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-99776704-b58c-4dd9-8b8c-a58415a7d09d tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:26.703517 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-99776704-b58c-4dd9-8b8c-a58415a7d09d tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:26.828677 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-1291f429-4579-4794-8d0c-ad463ee31e9e tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:39:26.829403 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-1291f429-4579-4794-8d0c-ad463ee31e9e tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] [instance: b8c93a18-ee0e-438e-823c-cf51f9d4985f] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:39:26.835543 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-1291f429-4579-4794-8d0c-ad463ee31e9e tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:26.836024 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-1291f429-4579-4794-8d0c-ad463ee31e9e tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:26.836453 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-1291f429-4579-4794-8d0c-ad463ee31e9e tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:26.837134 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-1291f429-4579-4794-8d0c-ad463ee31e9e tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:26.837586 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-1291f429-4579-4794-8d0c-ad463ee31e9e tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:26.838088 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-1291f429-4579-4794-8d0c-ad463ee31e9e tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:26.920161 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-99776704-b58c-4dd9-8b8c-a58415a7d09d tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:39:26.929606 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-99776704-b58c-4dd9-8b8c-a58415a7d09d tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:39:26.931473 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-99776704-b58c-4dd9-8b8c-a58415a7d09d tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:39:26.933073 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-99776704-b58c-4dd9-8b8c-a58415a7d09d tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] 10.222.0.15 "GET /compute/v2.1/servers/b3800adf-8cae-407e-9a5e-9eb107bff58d" status: 200 len: 1731 microversion: 2.20 time: 0.243529 Oct 31 12:39:26.933634 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 439/889] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Oct 31 12:39:26 2022] GET /compute/v2.1/servers/b3800adf-8cae-407e-9a5e-9eb107bff58d => generated 1731 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 12:39:27.001056 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-01cc6f0b-14fa-4f52-80ad-e4fab3b29e4d tempest-VolumesNegativeTest-1210908864 tempest-VolumesNegativeTest-1210908864-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:39:27.002018 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-01cc6f0b-14fa-4f52-80ad-e4fab3b29e4d tempest-VolumesNegativeTest-1210908864 tempest-VolumesNegativeTest-1210908864-project] [instance: 0284c601-38fb-4270-8808-44aaf4b96c73] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:39:27.018281 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-01cc6f0b-14fa-4f52-80ad-e4fab3b29e4d tempest-VolumesNegativeTest-1210908864 tempest-VolumesNegativeTest-1210908864-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:27.019426 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-01cc6f0b-14fa-4f52-80ad-e4fab3b29e4d tempest-VolumesNegativeTest-1210908864 tempest-VolumesNegativeTest-1210908864-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:27.021103 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-01cc6f0b-14fa-4f52-80ad-e4fab3b29e4d tempest-VolumesNegativeTest-1210908864 tempest-VolumesNegativeTest-1210908864-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:27.022763 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-01cc6f0b-14fa-4f52-80ad-e4fab3b29e4d tempest-VolumesNegativeTest-1210908864 tempest-VolumesNegativeTest-1210908864-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:27.023546 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-01cc6f0b-14fa-4f52-80ad-e4fab3b29e4d tempest-VolumesNegativeTest-1210908864 tempest-VolumesNegativeTest-1210908864-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:27.029633 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-01cc6f0b-14fa-4f52-80ad-e4fab3b29e4d tempest-VolumesNegativeTest-1210908864 tempest-VolumesNegativeTest-1210908864-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:27.061789 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-1291f429-4579-4794-8d0c-ad463ee31e9e tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825059319a204b6da5bc7004b3a09361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14b98f006574deabc030c2e93c680c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:39:27.071975 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-1291f429-4579-4794-8d0c-ad463ee31e9e tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] 10.222.0.15 "GET /compute/v2.1/servers/b8c93a18-ee0e-438e-823c-cf51f9d4985f" status: 200 len: 1567 microversion: 2.1 time: 0.247117 Oct 31 12:39:27.072715 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 451/890] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:39:26 2022] GET /compute/v2.1/servers/b8c93a18-ee0e-438e-823c-cf51f9d4985f => generated 1567 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:39:27.256803 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-01cc6f0b-14fa-4f52-80ad-e4fab3b29e4d tempest-VolumesNegativeTest-1210908864 tempest-VolumesNegativeTest-1210908864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66eb8a35b8b64ad0adaa54971706420e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741f915aad03472e8373166c4d7fd380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:39:27.264867 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-01cc6f0b-14fa-4f52-80ad-e4fab3b29e4d tempest-VolumesNegativeTest-1210908864 tempest-VolumesNegativeTest-1210908864-project] 10.222.0.15 "GET /compute/v2.1/servers/0284c601-38fb-4270-8808-44aaf4b96c73" status: 200 len: 1315 microversion: 2.1 time: 0.267798 Oct 31 12:39:27.265436 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 440/891] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:39:26 2022] GET /compute/v2.1/servers/0284c601-38fb-4270-8808-44aaf4b96c73 => generated 1315 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 12:39:27.959401 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-c35e841c-f0cc-4476-aaec-a49fcbb7decf tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:39:27.960009 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-c35e841c-f0cc-4476-aaec-a49fcbb7decf tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] [instance: b3800adf-8cae-407e-9a5e-9eb107bff58d] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:39:27.966417 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-c35e841c-f0cc-4476-aaec-a49fcbb7decf tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:27.966893 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-c35e841c-f0cc-4476-aaec-a49fcbb7decf tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:27.967348 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-c35e841c-f0cc-4476-aaec-a49fcbb7decf tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:27.968033 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-c35e841c-f0cc-4476-aaec-a49fcbb7decf tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:27.968476 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-c35e841c-f0cc-4476-aaec-a49fcbb7decf tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:27.968887 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-c35e841c-f0cc-4476-aaec-a49fcbb7decf tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:28.096385 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-ad81c159-540a-4e77-bbfe-a00b21e88ea6 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:39:28.097567 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-ad81c159-540a-4e77-bbfe-a00b21e88ea6 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] [instance: b8c93a18-ee0e-438e-823c-cf51f9d4985f] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:39:28.104855 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-ad81c159-540a-4e77-bbfe-a00b21e88ea6 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:28.105352 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-ad81c159-540a-4e77-bbfe-a00b21e88ea6 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:28.105793 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-ad81c159-540a-4e77-bbfe-a00b21e88ea6 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:28.106486 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-ad81c159-540a-4e77-bbfe-a00b21e88ea6 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:28.107103 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-ad81c159-540a-4e77-bbfe-a00b21e88ea6 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:28.107704 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-ad81c159-540a-4e77-bbfe-a00b21e88ea6 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:28.116203 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-c35e841c-f0cc-4476-aaec-a49fcbb7decf tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:39:28.132119 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-c35e841c-f0cc-4476-aaec-a49fcbb7decf tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:39:28.133568 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-c35e841c-f0cc-4476-aaec-a49fcbb7decf tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:39:28.134727 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-c35e841c-f0cc-4476-aaec-a49fcbb7decf tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] 10.222.0.15 "GET /compute/v2.1/servers/b3800adf-8cae-407e-9a5e-9eb107bff58d" status: 200 len: 1731 microversion: 2.20 time: 0.179285 Oct 31 12:39:28.135332 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 452/892] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Oct 31 12:39:27 2022] GET /compute/v2.1/servers/b3800adf-8cae-407e-9a5e-9eb107bff58d => generated 1731 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 12:39:28.290051 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-f1cbdf9d-2871-42b5-84c0-ebbab39f250f tempest-VolumesNegativeTest-1210908864 tempest-VolumesNegativeTest-1210908864-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:39:28.290677 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-f1cbdf9d-2871-42b5-84c0-ebbab39f250f tempest-VolumesNegativeTest-1210908864 tempest-VolumesNegativeTest-1210908864-project] [instance: 0284c601-38fb-4270-8808-44aaf4b96c73] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:39:28.298226 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-f1cbdf9d-2871-42b5-84c0-ebbab39f250f tempest-VolumesNegativeTest-1210908864 tempest-VolumesNegativeTest-1210908864-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:28.298724 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-f1cbdf9d-2871-42b5-84c0-ebbab39f250f tempest-VolumesNegativeTest-1210908864 tempest-VolumesNegativeTest-1210908864-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:28.299200 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-f1cbdf9d-2871-42b5-84c0-ebbab39f250f tempest-VolumesNegativeTest-1210908864 tempest-VolumesNegativeTest-1210908864-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:28.299932 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-f1cbdf9d-2871-42b5-84c0-ebbab39f250f tempest-VolumesNegativeTest-1210908864 tempest-VolumesNegativeTest-1210908864-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:28.300382 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-f1cbdf9d-2871-42b5-84c0-ebbab39f250f tempest-VolumesNegativeTest-1210908864 tempest-VolumesNegativeTest-1210908864-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:28.300802 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-f1cbdf9d-2871-42b5-84c0-ebbab39f250f tempest-VolumesNegativeTest-1210908864 tempest-VolumesNegativeTest-1210908864-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:28.653252 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-ad81c159-540a-4e77-bbfe-a00b21e88ea6 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825059319a204b6da5bc7004b3a09361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14b98f006574deabc030c2e93c680c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:39:28.666107 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-f1cbdf9d-2871-42b5-84c0-ebbab39f250f tempest-VolumesNegativeTest-1210908864 tempest-VolumesNegativeTest-1210908864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66eb8a35b8b64ad0adaa54971706420e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741f915aad03472e8373166c4d7fd380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:39:28.671899 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-ad81c159-540a-4e77-bbfe-a00b21e88ea6 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] 10.222.0.15 "GET /compute/v2.1/servers/b8c93a18-ee0e-438e-823c-cf51f9d4985f" status: 200 len: 1567 microversion: 2.1 time: 0.579491 Oct 31 12:39:28.672691 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 441/893] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:39:28 2022] GET /compute/v2.1/servers/b8c93a18-ee0e-438e-823c-cf51f9d4985f => generated 1567 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:39:28.679015 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-f1cbdf9d-2871-42b5-84c0-ebbab39f250f tempest-VolumesNegativeTest-1210908864 tempest-VolumesNegativeTest-1210908864-project] 10.222.0.15 "GET /compute/v2.1/servers/0284c601-38fb-4270-8808-44aaf4b96c73" status: 200 len: 1315 microversion: 2.1 time: 0.389749 Oct 31 12:39:28.687605 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 453/894] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:39:28 2022] GET /compute/v2.1/servers/0284c601-38fb-4270-8808-44aaf4b96c73 => generated 1315 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 12:39:28.689162 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [req-a9549e34-dce4-4665-b101-6b8829359d6f req-d3e6fa42-6ef3-414f-9c08-be1de4ddf7ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4400e455-f03f-48be-a78e-c4886ef878c6", "tag": "a1f478e3-0037-482b-9f12-361410fca1f5"}]} {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 12:39:28.699471 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [req-a9549e34-dce4-4665-b101-6b8829359d6f req-d3e6fa42-6ef3-414f-9c08-be1de4ddf7ce service nova] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:28.699952 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [req-a9549e34-dce4-4665-b101-6b8829359d6f req-d3e6fa42-6ef3-414f-9c08-be1de4ddf7ce service nova] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:28.700388 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [req-a9549e34-dce4-4665-b101-6b8829359d6f req-d3e6fa42-6ef3-414f-9c08-be1de4ddf7ce service nova] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:28.704276 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG dbcounter [-] [125441] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:39:28.715738 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.compute.server_external_events [req-a9549e34-dce4-4665-b101-6b8829359d6f req-d3e6fa42-6ef3-414f-9c08-be1de4ddf7ce service nova] Creating event network-changed:a1f478e3-0037-482b-9f12-361410fca1f5 for instance 4400e455-f03f-48be-a78e-c4886ef878c6 on hv-cinder-79617 Oct 31 12:39:28.720874 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [req-a9549e34-dce4-4665-b101-6b8829359d6f req-d3e6fa42-6ef3-414f-9c08-be1de4ddf7ce service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040188 Oct 31 12:39:28.721652 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 442/895] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Oct 31 12:39:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 12:39:29.162527 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-058e361f-f04b-4d17-946f-ae3650df9db2 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:39:29.163239 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-058e361f-f04b-4d17-946f-ae3650df9db2 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] [instance: b3800adf-8cae-407e-9a5e-9eb107bff58d] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:39:29.171763 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-058e361f-f04b-4d17-946f-ae3650df9db2 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:29.172463 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-058e361f-f04b-4d17-946f-ae3650df9db2 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:29.173000 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-058e361f-f04b-4d17-946f-ae3650df9db2 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:29.173815 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-058e361f-f04b-4d17-946f-ae3650df9db2 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:29.174529 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-058e361f-f04b-4d17-946f-ae3650df9db2 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:29.175056 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-058e361f-f04b-4d17-946f-ae3650df9db2 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:29.179996 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG dbcounter [-] [125440] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=125440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:39:29.601212 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-058e361f-f04b-4d17-946f-ae3650df9db2 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:39:29.630570 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-058e361f-f04b-4d17-946f-ae3650df9db2 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:39:29.633219 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-058e361f-f04b-4d17-946f-ae3650df9db2 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:39:29.636506 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-058e361f-f04b-4d17-946f-ae3650df9db2 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] 10.222.0.15 "GET /compute/v2.1/servers/b3800adf-8cae-407e-9a5e-9eb107bff58d" status: 200 len: 1731 microversion: 2.20 time: 0.479078 Oct 31 12:39:29.637619 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 454/896] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Oct 31 12:39:29 2022] GET /compute/v2.1/servers/b3800adf-8cae-407e-9a5e-9eb107bff58d => generated 1731 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 12:39:29.640889 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-4282db84-52d5-4f58-a1f3-e332c974699e tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:39:29.641683 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-4282db84-52d5-4f58-a1f3-e332c974699e tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] [instance: 0a62e143-71fb-4080-9691-fea9a84eaaca] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:39:29.649033 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-4282db84-52d5-4f58-a1f3-e332c974699e tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:29.649704 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-4282db84-52d5-4f58-a1f3-e332c974699e tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:29.650132 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-4282db84-52d5-4f58-a1f3-e332c974699e tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:29.651555 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-4282db84-52d5-4f58-a1f3-e332c974699e tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:29.652185 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-4282db84-52d5-4f58-a1f3-e332c974699e tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:29.652765 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-4282db84-52d5-4f58-a1f3-e332c974699e tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:29.697043 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-18231ec6-a18b-44dd-bbb9-0b05aa33c2f8 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:39:29.697877 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-18231ec6-a18b-44dd-bbb9-0b05aa33c2f8 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] [instance: b8c93a18-ee0e-438e-823c-cf51f9d4985f] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:39:29.706816 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-18231ec6-a18b-44dd-bbb9-0b05aa33c2f8 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:29.707910 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-18231ec6-a18b-44dd-bbb9-0b05aa33c2f8 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:29.708432 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-18231ec6-a18b-44dd-bbb9-0b05aa33c2f8 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:29.709364 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-18231ec6-a18b-44dd-bbb9-0b05aa33c2f8 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:29.710023 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-18231ec6-a18b-44dd-bbb9-0b05aa33c2f8 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:29.710650 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-18231ec6-a18b-44dd-bbb9-0b05aa33c2f8 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:29.792814 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.objects.instance [None req-4282db84-52d5-4f58-a1f3-e332c974699e tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lazy-loading 'services' on Instance uuid 0a62e143-71fb-4080-9691-fea9a84eaaca {{(pid=125441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 12:39:29.821710 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG dbcounter [-] [125440] Writing DB stats nova_cell0:SELECT=2 {{(pid=125440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:39:29.842136 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG dbcounter [-] [125440] Writing DB stats nova_cell0:SELECT=6 {{(pid=125440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:39:29.903050 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-4282db84-52d5-4f58-a1f3-e332c974699e tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] 10.222.0.15 "DELETE /compute/v2.1/servers/0a62e143-71fb-4080-9691-fea9a84eaaca/os-volume_attachments/de5c3eb1-93f9-4c18-a651-8ac52fde01f9" status: 202 len: 0 microversion: 2.1 time: 0.268105 Oct 31 12:39:29.905265 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 443/897] 10.222.0.15 () {58 vars in 1416 bytes} [Mon Oct 31 12:39:29 2022] DELETE /compute/v2.1/servers/0a62e143-71fb-4080-9691-fea9a84eaaca/os-volume_attachments/de5c3eb1-93f9-4c18-a651-8ac52fde01f9 => generated 0 bytes in 272 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 31 12:39:29.912577 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-d422f599-6eef-4bd7-8139-2db726a4e216 tempest-VolumesNegativeTest-1210908864 tempest-VolumesNegativeTest-1210908864-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:39:29.914317 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-d422f599-6eef-4bd7-8139-2db726a4e216 tempest-VolumesNegativeTest-1210908864 tempest-VolumesNegativeTest-1210908864-project] [instance: 0284c601-38fb-4270-8808-44aaf4b96c73] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:39:29.922800 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-d422f599-6eef-4bd7-8139-2db726a4e216 tempest-VolumesNegativeTest-1210908864 tempest-VolumesNegativeTest-1210908864-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:29.923561 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-d422f599-6eef-4bd7-8139-2db726a4e216 tempest-VolumesNegativeTest-1210908864 tempest-VolumesNegativeTest-1210908864-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:29.924176 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-d422f599-6eef-4bd7-8139-2db726a4e216 tempest-VolumesNegativeTest-1210908864 tempest-VolumesNegativeTest-1210908864-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:29.925085 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-d422f599-6eef-4bd7-8139-2db726a4e216 tempest-VolumesNegativeTest-1210908864 tempest-VolumesNegativeTest-1210908864-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:29.925575 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-d422f599-6eef-4bd7-8139-2db726a4e216 tempest-VolumesNegativeTest-1210908864 tempest-VolumesNegativeTest-1210908864-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:29.925970 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-d422f599-6eef-4bd7-8139-2db726a4e216 tempest-VolumesNegativeTest-1210908864 tempest-VolumesNegativeTest-1210908864-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:29.949757 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-18231ec6-a18b-44dd-bbb9-0b05aa33c2f8 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825059319a204b6da5bc7004b3a09361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14b98f006574deabc030c2e93c680c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:39:29.969129 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-18231ec6-a18b-44dd-bbb9-0b05aa33c2f8 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] 10.222.0.15 "GET /compute/v2.1/servers/b8c93a18-ee0e-438e-823c-cf51f9d4985f" status: 200 len: 1500 microversion: 2.1 time: 0.276825 Oct 31 12:39:29.982931 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG dbcounter [-] [125441] Writing DB stats nova_cell0:SELECT=2 {{(pid=125441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:39:29.992476 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 455/898] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:39:29 2022] GET /compute/v2.1/servers/b8c93a18-ee0e-438e-823c-cf51f9d4985f => generated 1500 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 12:39:30.001795 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-f9bc2f58-60b1-4908-ada1-0e54cc29c2bf tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:39:30.004101 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-f9bc2f58-60b1-4908-ada1-0e54cc29c2bf tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] [instance: 0a62e143-71fb-4080-9691-fea9a84eaaca] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:39:30.054255 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-f9bc2f58-60b1-4908-ada1-0e54cc29c2bf tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:30.054746 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-f9bc2f58-60b1-4908-ada1-0e54cc29c2bf tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:30.055203 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-f9bc2f58-60b1-4908-ada1-0e54cc29c2bf tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:30.055890 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-f9bc2f58-60b1-4908-ada1-0e54cc29c2bf tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:30.056406 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-f9bc2f58-60b1-4908-ada1-0e54cc29c2bf tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:30.056732 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-f9bc2f58-60b1-4908-ada1-0e54cc29c2bf tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:30.120034 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-f9bc2f58-60b1-4908-ada1-0e54cc29c2bf tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] 10.222.0.15 "GET /compute/v2.1/servers/0a62e143-71fb-4080-9691-fea9a84eaaca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.126273 Oct 31 12:39:30.121408 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 456/899] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Oct 31 12:39:29 2022] GET /compute/v2.1/servers/0a62e143-71fb-4080-9691-fea9a84eaaca/os-volume_attachments => generated 197 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 12:39:30.127788 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [req-f3f680f1-ae23-4193-9e81-3a6ed2d3e6ef req-42faef6f-d13b-4287-89be-5e4f1494e6a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8c93a18-ee0e-438e-823c-cf51f9d4985f", "name": "network-vif-deleted", "tag": "c444a742-6430-4bab-91f7-bff045443454"}]} {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 12:39:30.138158 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [req-f3f680f1-ae23-4193-9e81-3a6ed2d3e6ef req-42faef6f-d13b-4287-89be-5e4f1494e6a4 service nova] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:30.138883 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [req-f3f680f1-ae23-4193-9e81-3a6ed2d3e6ef req-42faef6f-d13b-4287-89be-5e4f1494e6a4 service nova] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:30.139654 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [req-f3f680f1-ae23-4193-9e81-3a6ed2d3e6ef req-42faef6f-d13b-4287-89be-5e4f1494e6a4 service nova] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:30.141474 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-d422f599-6eef-4bd7-8139-2db726a4e216 tempest-VolumesNegativeTest-1210908864 tempest-VolumesNegativeTest-1210908864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66eb8a35b8b64ad0adaa54971706420e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741f915aad03472e8373166c4d7fd380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:39:30.153270 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-d422f599-6eef-4bd7-8139-2db726a4e216 tempest-VolumesNegativeTest-1210908864 tempest-VolumesNegativeTest-1210908864-project] 10.222.0.15 "GET /compute/v2.1/servers/0284c601-38fb-4270-8808-44aaf4b96c73" status: 200 len: 1315 microversion: 2.1 time: 0.246541 Oct 31 12:39:30.154132 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 444/900] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:39:29 2022] GET /compute/v2.1/servers/0284c601-38fb-4270-8808-44aaf4b96c73 => generated 1315 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:39:30.154262 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.compute.server_external_events [req-f3f680f1-ae23-4193-9e81-3a6ed2d3e6ef req-42faef6f-d13b-4287-89be-5e4f1494e6a4 service nova] Creating event network-vif-deleted:c444a742-6430-4bab-91f7-bff045443454 for instance b8c93a18-ee0e-438e-823c-cf51f9d4985f on hv-cinder-79617 Oct 31 12:39:30.173574 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [req-f3f680f1-ae23-4193-9e81-3a6ed2d3e6ef req-42faef6f-d13b-4287-89be-5e4f1494e6a4 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050701 Oct 31 12:39:30.175720 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 457/901] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Oct 31 12:39:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 12:39:30.496322 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [req-48912863-3e06-40e6-bbe4-5f153946d8e5 req-29761493-73af-47d8-aa51-69b5982523d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0284c601-38fb-4270-8808-44aaf4b96c73", "name": "network-vif-plugged", "status": "completed", "tag": "165b6d01-75c7-4d1f-9584-92ce0f4b1ea8"}]} {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 12:39:30.509446 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [req-48912863-3e06-40e6-bbe4-5f153946d8e5 req-29761493-73af-47d8-aa51-69b5982523d8 service nova] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:30.510049 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [req-48912863-3e06-40e6-bbe4-5f153946d8e5 req-29761493-73af-47d8-aa51-69b5982523d8 service nova] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:30.511378 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [req-48912863-3e06-40e6-bbe4-5f153946d8e5 req-29761493-73af-47d8-aa51-69b5982523d8 service nova] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:30.524857 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.compute.server_external_events [req-48912863-3e06-40e6-bbe4-5f153946d8e5 req-29761493-73af-47d8-aa51-69b5982523d8 service nova] Creating event network-vif-plugged:165b6d01-75c7-4d1f-9584-92ce0f4b1ea8 for instance 0284c601-38fb-4270-8808-44aaf4b96c73 on hv-cinder-79617 Oct 31 12:39:30.530994 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [req-48912863-3e06-40e6-bbe4-5f153946d8e5 req-29761493-73af-47d8-aa51-69b5982523d8 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039558 Oct 31 12:39:30.532482 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 445/902] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Oct 31 12:39:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 12:39:30.666044 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-3821947a-2755-4532-b8e7-c0b3f29c7445 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:39:30.668066 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-3821947a-2755-4532-b8e7-c0b3f29c7445 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] [instance: b3800adf-8cae-407e-9a5e-9eb107bff58d] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:39:30.674238 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-3821947a-2755-4532-b8e7-c0b3f29c7445 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:30.674954 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-3821947a-2755-4532-b8e7-c0b3f29c7445 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:30.675566 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-3821947a-2755-4532-b8e7-c0b3f29c7445 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:30.676730 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-3821947a-2755-4532-b8e7-c0b3f29c7445 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:30.677499 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-3821947a-2755-4532-b8e7-c0b3f29c7445 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:30.678077 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-3821947a-2755-4532-b8e7-c0b3f29c7445 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:30.712802 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-ebbd4dca-cff4-4475-81a7-865f9dd30d5a tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:39:30.713450 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-ebbd4dca-cff4-4475-81a7-865f9dd30d5a tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] [instance: 96065a23-4a5f-4ffb-8b48-746d2dc2c301] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:39:30.723884 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-ebbd4dca-cff4-4475-81a7-865f9dd30d5a tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:30.724367 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-ebbd4dca-cff4-4475-81a7-865f9dd30d5a tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:30.724800 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-ebbd4dca-cff4-4475-81a7-865f9dd30d5a tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:30.725494 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-ebbd4dca-cff4-4475-81a7-865f9dd30d5a tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:30.725961 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-ebbd4dca-cff4-4475-81a7-865f9dd30d5a tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:30.726381 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-ebbd4dca-cff4-4475-81a7-865f9dd30d5a tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:30.764805 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-ebbd4dca-cff4-4475-81a7-865f9dd30d5a tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] 10.222.0.15 "GET /compute/v2.1/servers/96065a23-4a5f-4ffb-8b48-746d2dc2c301/os-volume_attachments/202f05d1-1419-486f-8639-f71907d0ef11" status: 200 len: 194 microversion: 2.1 time: 0.055987 Oct 31 12:39:30.770356 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 446/903] 10.222.0.15 () {58 vars in 1413 bytes} [Mon Oct 31 12:39:30 2022] GET /compute/v2.1/servers/96065a23-4a5f-4ffb-8b48-746d2dc2c301/os-volume_attachments/202f05d1-1419-486f-8639-f71907d0ef11 => generated 194 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 12:39:30.783003 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-91b22f70-927f-415c-9544-9b343f25b0bd tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:39:30.783935 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-91b22f70-927f-415c-9544-9b343f25b0bd tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] [instance: 96065a23-4a5f-4ffb-8b48-746d2dc2c301] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:39:30.794762 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-91b22f70-927f-415c-9544-9b343f25b0bd tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:30.796619 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-91b22f70-927f-415c-9544-9b343f25b0bd tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:30.797461 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-91b22f70-927f-415c-9544-9b343f25b0bd tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:30.799052 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-91b22f70-927f-415c-9544-9b343f25b0bd tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:30.800544 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-91b22f70-927f-415c-9544-9b343f25b0bd tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:30.801480 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-91b22f70-927f-415c-9544-9b343f25b0bd tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:30.913656 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.objects.instance [None req-91b22f70-927f-415c-9544-9b343f25b0bd tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lazy-loading 'services' on Instance uuid 96065a23-4a5f-4ffb-8b48-746d2dc2c301 {{(pid=125441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 12:39:30.998722 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-91b22f70-927f-415c-9544-9b343f25b0bd tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] 10.222.0.15 "DELETE /compute/v2.1/servers/96065a23-4a5f-4ffb-8b48-746d2dc2c301/os-volume_attachments/202f05d1-1419-486f-8639-f71907d0ef11" status: 202 len: 0 microversion: 2.1 time: 0.220988 Oct 31 12:39:31.002438 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 447/904] 10.222.0.15 () {58 vars in 1416 bytes} [Mon Oct 31 12:39:30 2022] DELETE /compute/v2.1/servers/96065a23-4a5f-4ffb-8b48-746d2dc2c301/os-volume_attachments/202f05d1-1419-486f-8639-f71907d0ef11 => generated 0 bytes in 223 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 31 12:39:31.007058 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-a0009837-fa69-4740-886c-214d10a71dce tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:39:31.008006 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-a0009837-fa69-4740-886c-214d10a71dce tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] [instance: b8c93a18-ee0e-438e-823c-cf51f9d4985f] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:39:31.019024 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-3821947a-2755-4532-b8e7-c0b3f29c7445 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:39:31.025436 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-a0009837-fa69-4740-886c-214d10a71dce tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:31.026606 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-a0009837-fa69-4740-886c-214d10a71dce tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:31.027125 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-a0009837-fa69-4740-886c-214d10a71dce tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:31.033372 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-3821947a-2755-4532-b8e7-c0b3f29c7445 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:39:31.034911 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-3821947a-2755-4532-b8e7-c0b3f29c7445 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:39:31.036164 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-3821947a-2755-4532-b8e7-c0b3f29c7445 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] 10.222.0.15 "GET /compute/v2.1/servers/b3800adf-8cae-407e-9a5e-9eb107bff58d" status: 200 len: 1718 microversion: 2.20 time: 0.374526 Oct 31 12:39:31.037610 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-a0009837-fa69-4740-886c-214d10a71dce tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:31.038276 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-a0009837-fa69-4740-886c-214d10a71dce tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:31.041170 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-a0009837-fa69-4740-886c-214d10a71dce tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:31.052656 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 458/905] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Oct 31 12:39:30 2022] GET /compute/v2.1/servers/b3800adf-8cae-407e-9a5e-9eb107bff58d => generated 1718 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 12:39:31.118535 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-a0009837-fa69-4740-886c-214d10a71dce tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:31.119019 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-a0009837-fa69-4740-886c-214d10a71dce tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:31.119496 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-a0009837-fa69-4740-886c-214d10a71dce tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:31.120595 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.objects.instance [None req-a0009837-fa69-4740-886c-214d10a71dce tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lazy-loading 'fault' on Instance uuid b8c93a18-ee0e-438e-823c-cf51f9d4985f {{(pid=125441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 12:39:31.132481 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-4538542b-0ae5-4338-b7b1-5ebb43545f8f tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:39:31.134935 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-4538542b-0ae5-4338-b7b1-5ebb43545f8f tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] [instance: 0a62e143-71fb-4080-9691-fea9a84eaaca] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:39:31.141776 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-4538542b-0ae5-4338-b7b1-5ebb43545f8f tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:31.142335 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-4538542b-0ae5-4338-b7b1-5ebb43545f8f tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:31.142832 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-4538542b-0ae5-4338-b7b1-5ebb43545f8f tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:31.143885 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-4538542b-0ae5-4338-b7b1-5ebb43545f8f tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:31.144332 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-4538542b-0ae5-4338-b7b1-5ebb43545f8f tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:31.144743 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-4538542b-0ae5-4338-b7b1-5ebb43545f8f tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:31.162092 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-a0009837-fa69-4740-886c-214d10a71dce tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825059319a204b6da5bc7004b3a09361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14b98f006574deabc030c2e93c680c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:39:31.170016 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-a0009837-fa69-4740-886c-214d10a71dce tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] 10.222.0.15 "GET /compute/v2.1/servers/b8c93a18-ee0e-438e-823c-cf51f9d4985f" status: 200 len: 1386 microversion: 2.1 time: 0.169181 Oct 31 12:39:31.170808 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 448/906] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:39:30 2022] GET /compute/v2.1/servers/b8c93a18-ee0e-438e-823c-cf51f9d4985f => generated 1386 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:39:31.176140 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-88915a92-afa3-4a21-9fdb-6bfb5c782b37 tempest-VolumesNegativeTest-1210908864 tempest-VolumesNegativeTest-1210908864-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:39:31.176740 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-88915a92-afa3-4a21-9fdb-6bfb5c782b37 tempest-VolumesNegativeTest-1210908864 tempest-VolumesNegativeTest-1210908864-project] [instance: 0284c601-38fb-4270-8808-44aaf4b96c73] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:39:31.183072 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-88915a92-afa3-4a21-9fdb-6bfb5c782b37 tempest-VolumesNegativeTest-1210908864 tempest-VolumesNegativeTest-1210908864-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:31.183634 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-88915a92-afa3-4a21-9fdb-6bfb5c782b37 tempest-VolumesNegativeTest-1210908864 tempest-VolumesNegativeTest-1210908864-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:31.183980 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-4538542b-0ae5-4338-b7b1-5ebb43545f8f tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] 10.222.0.15 "GET /compute/v2.1/servers/0a62e143-71fb-4080-9691-fea9a84eaaca/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.055438 Oct 31 12:39:31.184431 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-88915a92-afa3-4a21-9fdb-6bfb5c782b37 tempest-VolumesNegativeTest-1210908864 tempest-VolumesNegativeTest-1210908864-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:31.187215 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-88915a92-afa3-4a21-9fdb-6bfb5c782b37 tempest-VolumesNegativeTest-1210908864 tempest-VolumesNegativeTest-1210908864-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:31.187344 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 459/907] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Oct 31 12:39:31 2022] GET /compute/v2.1/servers/0a62e143-71fb-4080-9691-fea9a84eaaca/os-volume_attachments => generated 25 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 31 12:39:31.187432 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-88915a92-afa3-4a21-9fdb-6bfb5c782b37 tempest-VolumesNegativeTest-1210908864 tempest-VolumesNegativeTest-1210908864-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:31.187432 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-88915a92-afa3-4a21-9fdb-6bfb5c782b37 tempest-VolumesNegativeTest-1210908864 tempest-VolumesNegativeTest-1210908864-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:31.248228 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-479f2193-8139-4420-87ae-c232de4744fd tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:39:31.248722 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-479f2193-8139-4420-87ae-c232de4744fd tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] [instance: 0a62e143-71fb-4080-9691-fea9a84eaaca] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:39:31.254733 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-479f2193-8139-4420-87ae-c232de4744fd tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:31.255250 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-479f2193-8139-4420-87ae-c232de4744fd tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:31.255678 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-479f2193-8139-4420-87ae-c232de4744fd tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:31.256374 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-479f2193-8139-4420-87ae-c232de4744fd tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:31.256821 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-479f2193-8139-4420-87ae-c232de4744fd tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:31.257237 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-479f2193-8139-4420-87ae-c232de4744fd tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:31.287592 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-479f2193-8139-4420-87ae-c232de4744fd tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] [instance: 0a62e143-71fb-4080-9691-fea9a84eaaca] Going to try to terminate instance {{(pid=125440) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 12:39:31.323399 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-88915a92-afa3-4a21-9fdb-6bfb5c782b37 tempest-VolumesNegativeTest-1210908864 tempest-VolumesNegativeTest-1210908864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66eb8a35b8b64ad0adaa54971706420e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741f915aad03472e8373166c4d7fd380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:39:31.331214 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-88915a92-afa3-4a21-9fdb-6bfb5c782b37 tempest-VolumesNegativeTest-1210908864 tempest-VolumesNegativeTest-1210908864-project] 10.222.0.15 "GET /compute/v2.1/servers/0284c601-38fb-4270-8808-44aaf4b96c73" status: 200 len: 1315 microversion: 2.1 time: 0.158540 Oct 31 12:39:31.331983 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 449/908] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:39:31 2022] GET /compute/v2.1/servers/0284c601-38fb-4270-8808-44aaf4b96c73 => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 12:39:31.388797 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-479f2193-8139-4420-87ae-c232de4744fd tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] 10.222.0.15 "DELETE /compute/v2.1/servers/0a62e143-71fb-4080-9691-fea9a84eaaca" status: 204 len: 0 microversion: 2.1 time: 0.144969 Oct 31 12:39:31.389372 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 460/909] 10.222.0.15 () {58 vars in 1239 bytes} [Mon Oct 31 12:39:31 2022] DELETE /compute/v2.1/servers/0a62e143-71fb-4080-9691-fea9a84eaaca => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 31 12:39:31.397666 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-67ccf771-1242-49d9-a0af-04920776cda3 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:39:31.398267 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-67ccf771-1242-49d9-a0af-04920776cda3 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] [instance: 0a62e143-71fb-4080-9691-fea9a84eaaca] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:39:31.404931 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-67ccf771-1242-49d9-a0af-04920776cda3 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:31.405400 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-67ccf771-1242-49d9-a0af-04920776cda3 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:31.405821 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-67ccf771-1242-49d9-a0af-04920776cda3 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:31.406502 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-67ccf771-1242-49d9-a0af-04920776cda3 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:31.406946 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-67ccf771-1242-49d9-a0af-04920776cda3 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:31.407401 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-67ccf771-1242-49d9-a0af-04920776cda3 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:31.537491 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-67ccf771-1242-49d9-a0af-04920776cda3 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c03f0365ee4a26b8c076ae365325b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfbc3a46f12942299b99cdd20c989e1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:39:31.546197 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-67ccf771-1242-49d9-a0af-04920776cda3 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] 10.222.0.15 "GET /compute/v2.1/servers/0a62e143-71fb-4080-9691-fea9a84eaaca" status: 200 len: 1680 microversion: 2.1 time: 0.152547 Oct 31 12:39:31.547000 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 450/910] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:39:31 2022] GET /compute/v2.1/servers/0a62e143-71fb-4080-9691-fea9a84eaaca => generated 1680 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 12:39:32.196516 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-21ecaebb-9e9a-498c-a981-f4a66423182b tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:39:32.197205 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-21ecaebb-9e9a-498c-a981-f4a66423182b tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] [instance: b8c93a18-ee0e-438e-823c-cf51f9d4985f] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:39:32.203978 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-21ecaebb-9e9a-498c-a981-f4a66423182b tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:32.204640 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-21ecaebb-9e9a-498c-a981-f4a66423182b tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:32.205231 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-21ecaebb-9e9a-498c-a981-f4a66423182b tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:32.205924 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-21ecaebb-9e9a-498c-a981-f4a66423182b tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:32.206392 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-21ecaebb-9e9a-498c-a981-f4a66423182b tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:32.206794 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-21ecaebb-9e9a-498c-a981-f4a66423182b tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:32.239181 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-21ecaebb-9e9a-498c-a981-f4a66423182b tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:32.239678 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-21ecaebb-9e9a-498c-a981-f4a66423182b tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:32.240102 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-21ecaebb-9e9a-498c-a981-f4a66423182b tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:32.240536 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.objects.instance [None req-21ecaebb-9e9a-498c-a981-f4a66423182b tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lazy-loading 'fault' on Instance uuid b8c93a18-ee0e-438e-823c-cf51f9d4985f {{(pid=125440) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 12:39:32.282427 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-21ecaebb-9e9a-498c-a981-f4a66423182b tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825059319a204b6da5bc7004b3a09361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14b98f006574deabc030c2e93c680c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:39:32.290188 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-21ecaebb-9e9a-498c-a981-f4a66423182b tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] 10.222.0.15 "GET /compute/v2.1/servers/b8c93a18-ee0e-438e-823c-cf51f9d4985f" status: 200 len: 1386 microversion: 2.1 time: 0.097832 Oct 31 12:39:32.290757 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 461/911] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:39:32 2022] GET /compute/v2.1/servers/b8c93a18-ee0e-438e-823c-cf51f9d4985f => generated 1386 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:39:32.353730 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-8a3ff21a-7859-4611-8e48-4a0c217ac050 tempest-VolumesNegativeTest-1210908864 tempest-VolumesNegativeTest-1210908864-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:39:32.354381 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-8a3ff21a-7859-4611-8e48-4a0c217ac050 tempest-VolumesNegativeTest-1210908864 tempest-VolumesNegativeTest-1210908864-project] [instance: 0284c601-38fb-4270-8808-44aaf4b96c73] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:39:32.360933 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-8a3ff21a-7859-4611-8e48-4a0c217ac050 tempest-VolumesNegativeTest-1210908864 tempest-VolumesNegativeTest-1210908864-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:32.361410 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-8a3ff21a-7859-4611-8e48-4a0c217ac050 tempest-VolumesNegativeTest-1210908864 tempest-VolumesNegativeTest-1210908864-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:32.361836 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-8a3ff21a-7859-4611-8e48-4a0c217ac050 tempest-VolumesNegativeTest-1210908864 tempest-VolumesNegativeTest-1210908864-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:32.362512 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-8a3ff21a-7859-4611-8e48-4a0c217ac050 tempest-VolumesNegativeTest-1210908864 tempest-VolumesNegativeTest-1210908864-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:32.362962 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-8a3ff21a-7859-4611-8e48-4a0c217ac050 tempest-VolumesNegativeTest-1210908864 tempest-VolumesNegativeTest-1210908864-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:32.363409 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-8a3ff21a-7859-4611-8e48-4a0c217ac050 tempest-VolumesNegativeTest-1210908864 tempest-VolumesNegativeTest-1210908864-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:32.491043 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-8a3ff21a-7859-4611-8e48-4a0c217ac050 tempest-VolumesNegativeTest-1210908864 tempest-VolumesNegativeTest-1210908864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66eb8a35b8b64ad0adaa54971706420e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741f915aad03472e8373166c4d7fd380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:39:32.498817 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-8a3ff21a-7859-4611-8e48-4a0c217ac050 tempest-VolumesNegativeTest-1210908864 tempest-VolumesNegativeTest-1210908864-project] 10.222.0.15 "GET /compute/v2.1/servers/0284c601-38fb-4270-8808-44aaf4b96c73" status: 200 len: 1315 microversion: 2.1 time: 0.148927 Oct 31 12:39:32.499484 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 451/912] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:39:32 2022] GET /compute/v2.1/servers/0284c601-38fb-4270-8808-44aaf4b96c73 => generated 1315 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:39:32.569912 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-eb9df5bb-9676-41d0-878e-58737a0e62b7 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:39:32.570457 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-eb9df5bb-9676-41d0-878e-58737a0e62b7 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] [instance: 0a62e143-71fb-4080-9691-fea9a84eaaca] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:39:32.576991 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-eb9df5bb-9676-41d0-878e-58737a0e62b7 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:32.577464 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-eb9df5bb-9676-41d0-878e-58737a0e62b7 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:32.577889 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-eb9df5bb-9676-41d0-878e-58737a0e62b7 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:32.578567 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-eb9df5bb-9676-41d0-878e-58737a0e62b7 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:32.579008 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-eb9df5bb-9676-41d0-878e-58737a0e62b7 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:32.579446 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-eb9df5bb-9676-41d0-878e-58737a0e62b7 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:32.712957 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-eb9df5bb-9676-41d0-878e-58737a0e62b7 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c03f0365ee4a26b8c076ae365325b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfbc3a46f12942299b99cdd20c989e1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:39:32.721086 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-eb9df5bb-9676-41d0-878e-58737a0e62b7 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] 10.222.0.15 "GET /compute/v2.1/servers/0a62e143-71fb-4080-9691-fea9a84eaaca" status: 200 len: 1680 microversion: 2.1 time: 0.155240 Oct 31 12:39:32.721658 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 462/913] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:39:32 2022] GET /compute/v2.1/servers/0a62e143-71fb-4080-9691-fea9a84eaaca => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:39:33.313428 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-7c5ac9c8-2f26-4bff-848f-920389ee1d63 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:39:33.313997 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-7c5ac9c8-2f26-4bff-848f-920389ee1d63 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] [instance: b8c93a18-ee0e-438e-823c-cf51f9d4985f] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:39:33.319892 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-7c5ac9c8-2f26-4bff-848f-920389ee1d63 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:33.320368 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-7c5ac9c8-2f26-4bff-848f-920389ee1d63 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:33.320791 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-7c5ac9c8-2f26-4bff-848f-920389ee1d63 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:33.321461 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-7c5ac9c8-2f26-4bff-848f-920389ee1d63 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:33.321913 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-7c5ac9c8-2f26-4bff-848f-920389ee1d63 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:33.322325 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-7c5ac9c8-2f26-4bff-848f-920389ee1d63 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:33.352397 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-7c5ac9c8-2f26-4bff-848f-920389ee1d63 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:33.352871 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-7c5ac9c8-2f26-4bff-848f-920389ee1d63 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:33.353296 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-7c5ac9c8-2f26-4bff-848f-920389ee1d63 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:33.353732 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.objects.instance [None req-7c5ac9c8-2f26-4bff-848f-920389ee1d63 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lazy-loading 'fault' on Instance uuid b8c93a18-ee0e-438e-823c-cf51f9d4985f {{(pid=125441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 12:39:33.399623 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-7c5ac9c8-2f26-4bff-848f-920389ee1d63 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825059319a204b6da5bc7004b3a09361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14b98f006574deabc030c2e93c680c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:39:33.408003 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-7c5ac9c8-2f26-4bff-848f-920389ee1d63 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] 10.222.0.15 "GET /compute/v2.1/servers/b8c93a18-ee0e-438e-823c-cf51f9d4985f" status: 200 len: 1386 microversion: 2.1 time: 0.098525 Oct 31 12:39:33.408569 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 452/914] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:39:33 2022] GET /compute/v2.1/servers/b8c93a18-ee0e-438e-823c-cf51f9d4985f => generated 1386 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:39:33.522130 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-af301b09-3334-4d72-9218-5a61da0e57b0 tempest-VolumesNegativeTest-1210908864 tempest-VolumesNegativeTest-1210908864-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:39:33.522837 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-af301b09-3334-4d72-9218-5a61da0e57b0 tempest-VolumesNegativeTest-1210908864 tempest-VolumesNegativeTest-1210908864-project] [instance: 0284c601-38fb-4270-8808-44aaf4b96c73] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:39:33.529826 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-af301b09-3334-4d72-9218-5a61da0e57b0 tempest-VolumesNegativeTest-1210908864 tempest-VolumesNegativeTest-1210908864-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:33.530331 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-af301b09-3334-4d72-9218-5a61da0e57b0 tempest-VolumesNegativeTest-1210908864 tempest-VolumesNegativeTest-1210908864-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:33.530755 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-af301b09-3334-4d72-9218-5a61da0e57b0 tempest-VolumesNegativeTest-1210908864 tempest-VolumesNegativeTest-1210908864-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:33.531472 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-af301b09-3334-4d72-9218-5a61da0e57b0 tempest-VolumesNegativeTest-1210908864 tempest-VolumesNegativeTest-1210908864-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:33.531917 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-af301b09-3334-4d72-9218-5a61da0e57b0 tempest-VolumesNegativeTest-1210908864 tempest-VolumesNegativeTest-1210908864-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:33.532329 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-af301b09-3334-4d72-9218-5a61da0e57b0 tempest-VolumesNegativeTest-1210908864 tempest-VolumesNegativeTest-1210908864-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:33.664328 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-af301b09-3334-4d72-9218-5a61da0e57b0 tempest-VolumesNegativeTest-1210908864 tempest-VolumesNegativeTest-1210908864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66eb8a35b8b64ad0adaa54971706420e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741f915aad03472e8373166c4d7fd380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:39:33.671885 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-af301b09-3334-4d72-9218-5a61da0e57b0 tempest-VolumesNegativeTest-1210908864 tempest-VolumesNegativeTest-1210908864-project] 10.222.0.15 "GET /compute/v2.1/servers/0284c601-38fb-4270-8808-44aaf4b96c73" status: 200 len: 1315 microversion: 2.1 time: 0.153959 Oct 31 12:39:33.672440 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 463/915] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:39:33 2022] GET /compute/v2.1/servers/0284c601-38fb-4270-8808-44aaf4b96c73 => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:39:33.745453 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-68c95051-5c6f-401d-962b-4bff5c54cc3f tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:39:33.746058 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-68c95051-5c6f-401d-962b-4bff5c54cc3f tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] [instance: 0a62e143-71fb-4080-9691-fea9a84eaaca] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:39:33.751889 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-68c95051-5c6f-401d-962b-4bff5c54cc3f tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:33.752362 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-68c95051-5c6f-401d-962b-4bff5c54cc3f tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:33.752788 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-68c95051-5c6f-401d-962b-4bff5c54cc3f tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:33.753461 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-68c95051-5c6f-401d-962b-4bff5c54cc3f tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:33.753907 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-68c95051-5c6f-401d-962b-4bff5c54cc3f tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:33.754319 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-68c95051-5c6f-401d-962b-4bff5c54cc3f tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:33.880844 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-68c95051-5c6f-401d-962b-4bff5c54cc3f tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c03f0365ee4a26b8c076ae365325b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfbc3a46f12942299b99cdd20c989e1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:39:33.889226 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-68c95051-5c6f-401d-962b-4bff5c54cc3f tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] 10.222.0.15 "GET /compute/v2.1/servers/0a62e143-71fb-4080-9691-fea9a84eaaca" status: 200 len: 1680 microversion: 2.1 time: 0.147920 Oct 31 12:39:33.889783 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 453/916] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:39:33 2022] GET /compute/v2.1/servers/0a62e143-71fb-4080-9691-fea9a84eaaca => generated 1680 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:39:34.432976 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-4230a09b-49ab-4ffd-a3d7-fffc0252313e tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:39:34.433777 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-4230a09b-49ab-4ffd-a3d7-fffc0252313e tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] [instance: b8c93a18-ee0e-438e-823c-cf51f9d4985f] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:39:34.439710 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-4230a09b-49ab-4ffd-a3d7-fffc0252313e tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:34.440183 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-4230a09b-49ab-4ffd-a3d7-fffc0252313e tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:34.440638 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-4230a09b-49ab-4ffd-a3d7-fffc0252313e tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:34.441323 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-4230a09b-49ab-4ffd-a3d7-fffc0252313e tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:34.441765 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-4230a09b-49ab-4ffd-a3d7-fffc0252313e tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:34.442199 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-4230a09b-49ab-4ffd-a3d7-fffc0252313e tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:34.455332 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.wsgi [None req-4230a09b-49ab-4ffd-a3d7-fffc0252313e tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] HTTP exception thrown: Instance b8c93a18-ee0e-438e-823c-cf51f9d4985f could not be found. Oct 31 12:39:34.456962 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-4230a09b-49ab-4ffd-a3d7-fffc0252313e tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Request method failure captured: Oct 31 12:39:34.456962 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: request: GET /compute/v2.1/servers/b8c93a18-ee0e-438e-823c-cf51f9d4985f HTTP/1.1 Oct 31 12:39:34.456962 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: Accept: application/json Oct 31 12:39:34.456962 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: Accept-Encoding: identity Oct 31 12:39:34.456962 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: Connection: close Oct 31 12:39:34.456962 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: Content-Length: 0 Oct 31 12:39:34.456962 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: Content-Type: application/json Oct 31 12:39:34.456962 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: Host: 10.222.0.15 Oct 31 12:39:34.456962 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: Openstack-System-Scope: None Oct 31 12:39:34.456962 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: User-Agent: python-urllib3/1.26.12 Oct 31 12:39:34.456962 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Auth-Token: gAAAAABjX8DBfAP7hSk2HFcWPhT5R_K1RFibHp3bEymgNFeMP8o8z97t4xETdunFgrZdv8AfMvovH-o1dO9kxE84HUu1fYsJPdPJi-hua5Tw0oyk8CX8vrwWJiui_rnJQoeJApVBCO8cVDrj_m1kuU7n9IpBNTt3wf1SCeiwDzOTjaLd5zfINXQ Oct 31 12:39:34.456962 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Domain-Id: None Oct 31 12:39:34.456962 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Domain-Name: None Oct 31 12:39:34.456962 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Identity-Status: Confirmed Oct 31 12:39:34.456962 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Is-Admin-Project: True Oct 31 12:39:34.456962 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Project-Domain-Id: default Oct 31 12:39:34.456962 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Project-Domain-Name: Default Oct 31 12:39:34.456962 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Project-Id: b14b98f006574deabc030c2e93c680c4 Oct 31 12:39:34.456962 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Project-Name: tempest-TestShelveInstance-474618788 Oct 31 12:39:34.456962 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Role: reader,member Oct 31 12:39:34.456962 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Roles: reader,member Oct 31 12:39:34.458517 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/b14b98f006574deabc030c2e93c680c4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_b14b98f006574deabc030c2e93c680c4", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/b14b98f006574deabc030c2e93c680c4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/b14b98f006574deabc030c2e93c680c4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Oct 31 12:39:34.458517 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Tenant: tempest-TestShelveInstance-474618788 Oct 31 12:39:34.458517 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Tenant-Id: b14b98f006574deabc030c2e93c680c4 Oct 31 12:39:34.458517 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Tenant-Name: tempest-TestShelveInstance-474618788 Oct 31 12:39:34.458517 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-User: tempest-TestShelveInstance-474618788-project Oct 31 12:39:34.458517 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-User-Domain-Id: default Oct 31 12:39:34.458517 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-User-Domain-Name: Default Oct 31 12:39:34.458517 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-User-Id: 825059319a204b6da5bc7004b3a09361 Oct 31 12:39:34.458517 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-User-Name: tempest-TestShelveInstance-474618788-project Oct 31 12:39:34.458517 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: method: > Oct 31 12:39:34.458517 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: exception: Instance b8c93a18-ee0e-438e-823c-cf51f9d4985f could not be found. Oct 31 12:39:34.458517 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: action_args: {'id': 'b8c93a18-ee0e-438e-823c-cf51f9d4985f'} Oct 31 12:39:34.463427 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 12:39:34.463427 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 12:39:34.463427 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 12:39:34.463427 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 12:39:34.463427 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 12:39:34.463427 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 12:39:34.463427 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 12:39:34.463427 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 12:39:34.463427 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 12:39:34.463427 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 12:39:34.463427 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b8c93a18-ee0e-438e-823c-cf51f9d4985f could not be found. Oct 31 12:39:34.463427 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Oct 31 12:39:34.463427 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 12:39:34.463427 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Oct 31 12:39:34.463427 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 12:39:34.463427 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 12:39:34.463427 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 12:39:34.463427 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 12:39:34.463427 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 12:39:34.463427 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 12:39:34.465299 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 12:39:34.465299 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 12:39:34.465299 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 12:39:34.465299 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 12:39:34.465299 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 12:39:34.465299 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 12:39:34.465299 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 12:39:34.465299 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b8c93a18-ee0e-438e-823c-cf51f9d4985f could not be found. Oct 31 12:39:34.465299 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Oct 31 12:39:34.465299 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 12:39:34.465299 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Oct 31 12:39:34.465299 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 12:39:34.465299 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 12:39:34.465299 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 12:39:34.465299 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 12:39:34.465299 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 12:39:34.465299 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b8c93a18-ee0e-438e-823c-cf51f9d4985f could not be found. Oct 31 12:39:34.465299 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Oct 31 12:39:34.466896 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-4230a09b-49ab-4ffd-a3d7-fffc0252313e tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Returning 404 to user: Instance b8c93a18-ee0e-438e-823c-cf51f9d4985f could not be found. {{(pid=125440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 12:39:34.466896 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-4230a09b-49ab-4ffd-a3d7-fffc0252313e tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] 10.222.0.15 "GET /compute/v2.1/servers/b8c93a18-ee0e-438e-823c-cf51f9d4985f" status: 404 len: 111 microversion: 2.1 time: 0.030064 Oct 31 12:39:34.466896 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 464/917] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:39:34 2022] GET /compute/v2.1/servers/b8c93a18-ee0e-438e-823c-cf51f9d4985f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 12:39:34.631875 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-4c006fa3-bc84-47d8-87ca-79b9b7f13954 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] Calling method '.version_select at 0x7f2aa508da60>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:39:34.655654 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-4c006fa3-bc84-47d8-87ca-79b9b7f13954 tempest-TestShelveInstance-474618788 tempest-TestShelveInstance-474618788-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1538609029" status: 202 len: 0 microversion: 2.1 time: 0.027436 Oct 31 12:39:34.657015 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 454/918] 10.222.0.15 () {58 vars in 1254 bytes} [Mon Oct 31 12:39:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1538609029 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 31 12:39:34.693635 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-87321ac7-d6c5-45f2-9053-d7db2af5d9dc tempest-VolumesNegativeTest-1210908864 tempest-VolumesNegativeTest-1210908864-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:39:34.694248 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-87321ac7-d6c5-45f2-9053-d7db2af5d9dc tempest-VolumesNegativeTest-1210908864 tempest-VolumesNegativeTest-1210908864-project] [instance: 0284c601-38fb-4270-8808-44aaf4b96c73] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:39:34.701856 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-87321ac7-d6c5-45f2-9053-d7db2af5d9dc tempest-VolumesNegativeTest-1210908864 tempest-VolumesNegativeTest-1210908864-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:34.702380 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-87321ac7-d6c5-45f2-9053-d7db2af5d9dc tempest-VolumesNegativeTest-1210908864 tempest-VolumesNegativeTest-1210908864-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:34.702819 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-87321ac7-d6c5-45f2-9053-d7db2af5d9dc tempest-VolumesNegativeTest-1210908864 tempest-VolumesNegativeTest-1210908864-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:34.703583 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-87321ac7-d6c5-45f2-9053-d7db2af5d9dc tempest-VolumesNegativeTest-1210908864 tempest-VolumesNegativeTest-1210908864-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:34.704034 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-87321ac7-d6c5-45f2-9053-d7db2af5d9dc tempest-VolumesNegativeTest-1210908864 tempest-VolumesNegativeTest-1210908864-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:34.704454 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-87321ac7-d6c5-45f2-9053-d7db2af5d9dc tempest-VolumesNegativeTest-1210908864 tempest-VolumesNegativeTest-1210908864-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:34.913494 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-4943d90b-ee59-4931-8704-39f935675304 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:39:34.914318 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-4943d90b-ee59-4931-8704-39f935675304 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] [instance: 0a62e143-71fb-4080-9691-fea9a84eaaca] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:39:34.921196 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-4943d90b-ee59-4931-8704-39f935675304 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:34.921921 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-4943d90b-ee59-4931-8704-39f935675304 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:34.922355 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-4943d90b-ee59-4931-8704-39f935675304 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:34.923050 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-4943d90b-ee59-4931-8704-39f935675304 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:34.923530 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-4943d90b-ee59-4931-8704-39f935675304 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:34.923972 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-4943d90b-ee59-4931-8704-39f935675304 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:34.957874 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-87321ac7-d6c5-45f2-9053-d7db2af5d9dc tempest-VolumesNegativeTest-1210908864 tempest-VolumesNegativeTest-1210908864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66eb8a35b8b64ad0adaa54971706420e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741f915aad03472e8373166c4d7fd380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:39:34.967525 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-87321ac7-d6c5-45f2-9053-d7db2af5d9dc tempest-VolumesNegativeTest-1210908864 tempest-VolumesNegativeTest-1210908864-project] 10.222.0.15 "GET /compute/v2.1/servers/0284c601-38fb-4270-8808-44aaf4b96c73" status: 200 len: 1465 microversion: 2.1 time: 0.277228 Oct 31 12:39:34.968392 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 465/919] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:39:34 2022] GET /compute/v2.1/servers/0284c601-38fb-4270-8808-44aaf4b96c73 => generated 1465 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 12:39:35.002758 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-4943d90b-ee59-4931-8704-39f935675304 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c03f0365ee4a26b8c076ae365325b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfbc3a46f12942299b99cdd20c989e1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:39:35.012165 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-4943d90b-ee59-4931-8704-39f935675304 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] 10.222.0.15 "GET /compute/v2.1/servers/0a62e143-71fb-4080-9691-fea9a84eaaca" status: 200 len: 1612 microversion: 2.1 time: 0.102549 Oct 31 12:39:35.014051 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 455/920] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:39:34 2022] GET /compute/v2.1/servers/0a62e143-71fb-4080-9691-fea9a84eaaca => generated 1612 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 12:39:35.036755 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-d35086c5-7aac-467f-b037-4f3a7d8ea4af tempest-VolumesNegativeTest-1210908864 tempest-VolumesNegativeTest-1210908864-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:39:35.037661 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-d35086c5-7aac-467f-b037-4f3a7d8ea4af tempest-VolumesNegativeTest-1210908864 tempest-VolumesNegativeTest-1210908864-project] [instance: 0284c601-38fb-4270-8808-44aaf4b96c73] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:39:35.044913 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-d35086c5-7aac-467f-b037-4f3a7d8ea4af tempest-VolumesNegativeTest-1210908864 tempest-VolumesNegativeTest-1210908864-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:35.045406 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-d35086c5-7aac-467f-b037-4f3a7d8ea4af tempest-VolumesNegativeTest-1210908864 tempest-VolumesNegativeTest-1210908864-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:35.045834 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-d35086c5-7aac-467f-b037-4f3a7d8ea4af tempest-VolumesNegativeTest-1210908864 tempest-VolumesNegativeTest-1210908864-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:35.046538 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-d35086c5-7aac-467f-b037-4f3a7d8ea4af tempest-VolumesNegativeTest-1210908864 tempest-VolumesNegativeTest-1210908864-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:35.046987 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-d35086c5-7aac-467f-b037-4f3a7d8ea4af tempest-VolumesNegativeTest-1210908864 tempest-VolumesNegativeTest-1210908864-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:35.047431 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-d35086c5-7aac-467f-b037-4f3a7d8ea4af tempest-VolumesNegativeTest-1210908864 tempest-VolumesNegativeTest-1210908864-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:35.076820 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-d35086c5-7aac-467f-b037-4f3a7d8ea4af tempest-VolumesNegativeTest-1210908864 tempest-VolumesNegativeTest-1210908864-project] [instance: 0284c601-38fb-4270-8808-44aaf4b96c73] Going to try to terminate instance {{(pid=125440) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 12:39:35.164224 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-d35086c5-7aac-467f-b037-4f3a7d8ea4af tempest-VolumesNegativeTest-1210908864 tempest-VolumesNegativeTest-1210908864-project] 10.222.0.15 "DELETE /compute/v2.1/servers/0284c601-38fb-4270-8808-44aaf4b96c73" status: 204 len: 0 microversion: 2.1 time: 0.142454 Oct 31 12:39:35.164743 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 466/921] 10.222.0.15 () {58 vars in 1239 bytes} [Mon Oct 31 12:39:35 2022] DELETE /compute/v2.1/servers/0284c601-38fb-4270-8808-44aaf4b96c73 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 12:39:35.175283 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-24db7b59-696c-4315-af29-68518cf85448 tempest-VolumesNegativeTest-1210908864 tempest-VolumesNegativeTest-1210908864-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:39:35.175900 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-24db7b59-696c-4315-af29-68518cf85448 tempest-VolumesNegativeTest-1210908864 tempest-VolumesNegativeTest-1210908864-project] [instance: 0284c601-38fb-4270-8808-44aaf4b96c73] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:39:35.182029 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-24db7b59-696c-4315-af29-68518cf85448 tempest-VolumesNegativeTest-1210908864 tempest-VolumesNegativeTest-1210908864-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:35.182549 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-24db7b59-696c-4315-af29-68518cf85448 tempest-VolumesNegativeTest-1210908864 tempest-VolumesNegativeTest-1210908864-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:35.183138 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-24db7b59-696c-4315-af29-68518cf85448 tempest-VolumesNegativeTest-1210908864 tempest-VolumesNegativeTest-1210908864-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:35.184073 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-24db7b59-696c-4315-af29-68518cf85448 tempest-VolumesNegativeTest-1210908864 tempest-VolumesNegativeTest-1210908864-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:35.184524 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-24db7b59-696c-4315-af29-68518cf85448 tempest-VolumesNegativeTest-1210908864 tempest-VolumesNegativeTest-1210908864-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:35.184938 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-24db7b59-696c-4315-af29-68518cf85448 tempest-VolumesNegativeTest-1210908864 tempest-VolumesNegativeTest-1210908864-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:35.430615 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-fdef5533-777e-4c6d-8077-96927a9c321b tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:39:35.433790 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-fdef5533-777e-4c6d-8077-96927a9c321b tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] [instance: 96065a23-4a5f-4ffb-8b48-746d2dc2c301] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:39:35.442413 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-fdef5533-777e-4c6d-8077-96927a9c321b tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:35.443044 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-fdef5533-777e-4c6d-8077-96927a9c321b tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:35.444444 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-fdef5533-777e-4c6d-8077-96927a9c321b tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:35.445279 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-fdef5533-777e-4c6d-8077-96927a9c321b tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:35.445844 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-fdef5533-777e-4c6d-8077-96927a9c321b tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:35.446728 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-fdef5533-777e-4c6d-8077-96927a9c321b tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:35.469652 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-24db7b59-696c-4315-af29-68518cf85448 tempest-VolumesNegativeTest-1210908864 tempest-VolumesNegativeTest-1210908864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66eb8a35b8b64ad0adaa54971706420e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741f915aad03472e8373166c4d7fd380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:39:35.480063 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-24db7b59-696c-4315-af29-68518cf85448 tempest-VolumesNegativeTest-1210908864 tempest-VolumesNegativeTest-1210908864-project] 10.222.0.15 "GET /compute/v2.1/servers/0284c601-38fb-4270-8808-44aaf4b96c73" status: 200 len: 1471 microversion: 2.1 time: 0.308673 Oct 31 12:39:35.480934 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 456/922] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:39:35 2022] GET /compute/v2.1/servers/0284c601-38fb-4270-8808-44aaf4b96c73 => generated 1471 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 12:39:35.485770 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [req-4bf8b506-e9be-4b98-8280-a4a7d1533b79 req-7033b206-05ed-4063-95f1-17aa886cf022 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a62e143-71fb-4080-9691-fea9a84eaaca", "name": "network-vif-deleted", "tag": "49446827-3823-4653-b9b1-9419ae249ec6"}]} {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 12:39:35.490711 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-fdef5533-777e-4c6d-8077-96927a9c321b tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] 10.222.0.15 "GET /compute/v2.1/servers/96065a23-4a5f-4ffb-8b48-746d2dc2c301/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.064700 Oct 31 12:39:35.491792 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 467/923] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Oct 31 12:39:35 2022] GET /compute/v2.1/servers/96065a23-4a5f-4ffb-8b48-746d2dc2c301/os-volume_attachments => generated 25 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 31 12:39:35.495866 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [req-4bf8b506-e9be-4b98-8280-a4a7d1533b79 req-7033b206-05ed-4063-95f1-17aa886cf022 service nova] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:35.496336 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [req-4bf8b506-e9be-4b98-8280-a4a7d1533b79 req-7033b206-05ed-4063-95f1-17aa886cf022 service nova] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:35.496918 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [req-4bf8b506-e9be-4b98-8280-a4a7d1533b79 req-7033b206-05ed-4063-95f1-17aa886cf022 service nova] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:35.509105 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.compute.server_external_events [req-4bf8b506-e9be-4b98-8280-a4a7d1533b79 req-7033b206-05ed-4063-95f1-17aa886cf022 service nova] Creating event network-vif-deleted:49446827-3823-4653-b9b1-9419ae249ec6 for instance 0a62e143-71fb-4080-9691-fea9a84eaaca on hv-cinder-79617 Oct 31 12:39:35.515347 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [req-4bf8b506-e9be-4b98-8280-a4a7d1533b79 req-7033b206-05ed-4063-95f1-17aa886cf022 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032976 Oct 31 12:39:35.515954 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 457/924] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Oct 31 12:39:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 12:39:35.621647 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-d8df9397-27aa-48d9-a53a-0dfe27de0b16 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:39:35.623940 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-d8df9397-27aa-48d9-a53a-0dfe27de0b16 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] [instance: 96065a23-4a5f-4ffb-8b48-746d2dc2c301] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:39:35.629933 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-d8df9397-27aa-48d9-a53a-0dfe27de0b16 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:35.630493 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-d8df9397-27aa-48d9-a53a-0dfe27de0b16 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:35.630991 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-d8df9397-27aa-48d9-a53a-0dfe27de0b16 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:35.632247 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-d8df9397-27aa-48d9-a53a-0dfe27de0b16 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:35.632375 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-d8df9397-27aa-48d9-a53a-0dfe27de0b16 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:35.632860 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-d8df9397-27aa-48d9-a53a-0dfe27de0b16 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:35.649186 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG dbcounter [-] [125440] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=125440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:39:35.668911 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-d8df9397-27aa-48d9-a53a-0dfe27de0b16 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] 10.222.0.15 "GET /compute/v2.1/servers/96065a23-4a5f-4ffb-8b48-746d2dc2c301/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052175 Oct 31 12:39:35.669828 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 468/925] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Oct 31 12:39:35 2022] GET /compute/v2.1/servers/96065a23-4a5f-4ffb-8b48-746d2dc2c301/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 12:39:35.735009 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-23e9353f-e4bd-4dd3-aefe-924f477fde42 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:39:35.735630 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-23e9353f-e4bd-4dd3-aefe-924f477fde42 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] [instance: 96065a23-4a5f-4ffb-8b48-746d2dc2c301] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:39:35.743335 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-23e9353f-e4bd-4dd3-aefe-924f477fde42 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:35.743965 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-23e9353f-e4bd-4dd3-aefe-924f477fde42 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:35.745171 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-23e9353f-e4bd-4dd3-aefe-924f477fde42 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:35.746266 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-23e9353f-e4bd-4dd3-aefe-924f477fde42 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:35.747068 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-23e9353f-e4bd-4dd3-aefe-924f477fde42 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:35.747753 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-23e9353f-e4bd-4dd3-aefe-924f477fde42 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:35.777334 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-23e9353f-e4bd-4dd3-aefe-924f477fde42 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] [instance: 96065a23-4a5f-4ffb-8b48-746d2dc2c301] Going to try to terminate instance {{(pid=125441) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 12:39:35.814308 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG dbcounter [-] [125441] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=125441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:39:35.867580 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-23e9353f-e4bd-4dd3-aefe-924f477fde42 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] 10.222.0.15 "DELETE /compute/v2.1/servers/96065a23-4a5f-4ffb-8b48-746d2dc2c301" status: 204 len: 0 microversion: 2.1 time: 0.136337 Oct 31 12:39:35.868794 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 458/926] 10.222.0.15 () {58 vars in 1239 bytes} [Mon Oct 31 12:39:35 2022] DELETE /compute/v2.1/servers/96065a23-4a5f-4ffb-8b48-746d2dc2c301 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 12:39:35.877418 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-5afbf659-bbe2-4674-be51-2a995326b5a9 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:39:35.878026 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-5afbf659-bbe2-4674-be51-2a995326b5a9 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] [instance: 96065a23-4a5f-4ffb-8b48-746d2dc2c301] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:39:35.884425 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-5afbf659-bbe2-4674-be51-2a995326b5a9 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:35.885239 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-5afbf659-bbe2-4674-be51-2a995326b5a9 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:35.885675 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-5afbf659-bbe2-4674-be51-2a995326b5a9 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:35.886374 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-5afbf659-bbe2-4674-be51-2a995326b5a9 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:35.886830 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-5afbf659-bbe2-4674-be51-2a995326b5a9 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:35.887271 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-5afbf659-bbe2-4674-be51-2a995326b5a9 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:36.039981 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-4701bb2f-9576-4481-bf0d-b5b0fc7787c4 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:39:36.040732 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-4701bb2f-9576-4481-bf0d-b5b0fc7787c4 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] [instance: 0a62e143-71fb-4080-9691-fea9a84eaaca] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:39:36.044268 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG dbcounter [-] [125441] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=125441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:39:36.051671 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-4701bb2f-9576-4481-bf0d-b5b0fc7787c4 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:36.052281 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-4701bb2f-9576-4481-bf0d-b5b0fc7787c4 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:36.052929 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-4701bb2f-9576-4481-bf0d-b5b0fc7787c4 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:36.054008 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-4701bb2f-9576-4481-bf0d-b5b0fc7787c4 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:36.054910 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-4701bb2f-9576-4481-bf0d-b5b0fc7787c4 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:36.055596 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-4701bb2f-9576-4481-bf0d-b5b0fc7787c4 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:36.072537 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-5afbf659-bbe2-4674-be51-2a995326b5a9 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c1beb321e44908ab987b17f7b74484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a2bf9a5a484523a700e4e6c568d4de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:39:36.082340 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-5afbf659-bbe2-4674-be51-2a995326b5a9 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] 10.222.0.15 "GET /compute/v2.1/servers/96065a23-4a5f-4ffb-8b48-746d2dc2c301" status: 200 len: 1674 microversion: 2.1 time: 0.208666 Oct 31 12:39:36.082911 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 469/927] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:39:35 2022] GET /compute/v2.1/servers/96065a23-4a5f-4ffb-8b48-746d2dc2c301 => generated 1674 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:39:36.162257 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-4701bb2f-9576-4481-bf0d-b5b0fc7787c4 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c03f0365ee4a26b8c076ae365325b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfbc3a46f12942299b99cdd20c989e1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:39:36.173333 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-4701bb2f-9576-4481-bf0d-b5b0fc7787c4 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] 10.222.0.15 "GET /compute/v2.1/servers/0a62e143-71fb-4080-9691-fea9a84eaaca" status: 200 len: 1612 microversion: 2.1 time: 0.137994 Oct 31 12:39:36.174380 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 459/928] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:39:36 2022] GET /compute/v2.1/servers/0a62e143-71fb-4080-9691-fea9a84eaaca => generated 1612 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:39:36.503004 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-507d8cb9-b572-415b-8605-8a5f1daa981b tempest-VolumesNegativeTest-1210908864 tempest-VolumesNegativeTest-1210908864-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:39:36.503906 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-507d8cb9-b572-415b-8605-8a5f1daa981b tempest-VolumesNegativeTest-1210908864 tempest-VolumesNegativeTest-1210908864-project] [instance: 0284c601-38fb-4270-8808-44aaf4b96c73] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:39:36.509898 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-507d8cb9-b572-415b-8605-8a5f1daa981b tempest-VolumesNegativeTest-1210908864 tempest-VolumesNegativeTest-1210908864-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:36.510664 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-507d8cb9-b572-415b-8605-8a5f1daa981b tempest-VolumesNegativeTest-1210908864 tempest-VolumesNegativeTest-1210908864-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:36.511283 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-507d8cb9-b572-415b-8605-8a5f1daa981b tempest-VolumesNegativeTest-1210908864 tempest-VolumesNegativeTest-1210908864-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:36.512138 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-507d8cb9-b572-415b-8605-8a5f1daa981b tempest-VolumesNegativeTest-1210908864 tempest-VolumesNegativeTest-1210908864-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:36.512740 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-507d8cb9-b572-415b-8605-8a5f1daa981b tempest-VolumesNegativeTest-1210908864 tempest-VolumesNegativeTest-1210908864-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:36.513335 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-507d8cb9-b572-415b-8605-8a5f1daa981b tempest-VolumesNegativeTest-1210908864 tempest-VolumesNegativeTest-1210908864-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:36.787594 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-507d8cb9-b572-415b-8605-8a5f1daa981b tempest-VolumesNegativeTest-1210908864 tempest-VolumesNegativeTest-1210908864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66eb8a35b8b64ad0adaa54971706420e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741f915aad03472e8373166c4d7fd380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:39:36.800021 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-507d8cb9-b572-415b-8605-8a5f1daa981b tempest-VolumesNegativeTest-1210908864 tempest-VolumesNegativeTest-1210908864-project] 10.222.0.15 "GET /compute/v2.1/servers/0284c601-38fb-4270-8808-44aaf4b96c73" status: 200 len: 1471 microversion: 2.1 time: 0.300682 Oct 31 12:39:36.816203 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 470/929] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:39:36 2022] GET /compute/v2.1/servers/0284c601-38fb-4270-8808-44aaf4b96c73 => generated 1471 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:39:37.107085 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-78dfdcff-050b-4fbe-b39b-45bfd1ad1bcb tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:39:37.108375 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-78dfdcff-050b-4fbe-b39b-45bfd1ad1bcb tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] [instance: 96065a23-4a5f-4ffb-8b48-746d2dc2c301] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:39:37.116240 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-78dfdcff-050b-4fbe-b39b-45bfd1ad1bcb tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:37.116736 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-78dfdcff-050b-4fbe-b39b-45bfd1ad1bcb tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:37.117164 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-78dfdcff-050b-4fbe-b39b-45bfd1ad1bcb tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:37.118043 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-78dfdcff-050b-4fbe-b39b-45bfd1ad1bcb tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:37.118499 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-78dfdcff-050b-4fbe-b39b-45bfd1ad1bcb tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:37.118922 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-78dfdcff-050b-4fbe-b39b-45bfd1ad1bcb tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:37.196913 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-2ae0ad54-c1db-4966-9ea7-3b1aee1d9219 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:39:37.197566 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-2ae0ad54-c1db-4966-9ea7-3b1aee1d9219 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] [instance: 0a62e143-71fb-4080-9691-fea9a84eaaca] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:39:37.205296 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-2ae0ad54-c1db-4966-9ea7-3b1aee1d9219 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:37.206046 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-2ae0ad54-c1db-4966-9ea7-3b1aee1d9219 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:37.206491 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-2ae0ad54-c1db-4966-9ea7-3b1aee1d9219 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:37.207495 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-2ae0ad54-c1db-4966-9ea7-3b1aee1d9219 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:37.207987 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-2ae0ad54-c1db-4966-9ea7-3b1aee1d9219 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:37.208718 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-2ae0ad54-c1db-4966-9ea7-3b1aee1d9219 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:37.288823 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-78dfdcff-050b-4fbe-b39b-45bfd1ad1bcb tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c1beb321e44908ab987b17f7b74484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a2bf9a5a484523a700e4e6c568d4de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:39:37.296976 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-78dfdcff-050b-4fbe-b39b-45bfd1ad1bcb tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] 10.222.0.15 "GET /compute/v2.1/servers/96065a23-4a5f-4ffb-8b48-746d2dc2c301" status: 200 len: 1674 microversion: 2.1 time: 0.194425 Oct 31 12:39:37.297764 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 460/930] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:39:37 2022] GET /compute/v2.1/servers/96065a23-4a5f-4ffb-8b48-746d2dc2c301 => generated 1674 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:39:37.313642 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-2ae0ad54-c1db-4966-9ea7-3b1aee1d9219 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c03f0365ee4a26b8c076ae365325b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfbc3a46f12942299b99cdd20c989e1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:39:37.323278 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-2ae0ad54-c1db-4966-9ea7-3b1aee1d9219 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] 10.222.0.15 "GET /compute/v2.1/servers/0a62e143-71fb-4080-9691-fea9a84eaaca" status: 200 len: 1325 microversion: 2.1 time: 0.129645 Oct 31 12:39:37.323901 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 471/931] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:39:37 2022] GET /compute/v2.1/servers/0a62e143-71fb-4080-9691-fea9a84eaaca => generated 1325 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 12:39:37.827571 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-e65a9ea5-0787-4018-a2dd-d6e611be0318 tempest-VolumesNegativeTest-1210908864 tempest-VolumesNegativeTest-1210908864-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:39:37.830489 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-e65a9ea5-0787-4018-a2dd-d6e611be0318 tempest-VolumesNegativeTest-1210908864 tempest-VolumesNegativeTest-1210908864-project] [instance: 0284c601-38fb-4270-8808-44aaf4b96c73] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:39:37.839100 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-e65a9ea5-0787-4018-a2dd-d6e611be0318 tempest-VolumesNegativeTest-1210908864 tempest-VolumesNegativeTest-1210908864-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:37.840606 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-e65a9ea5-0787-4018-a2dd-d6e611be0318 tempest-VolumesNegativeTest-1210908864 tempest-VolumesNegativeTest-1210908864-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:37.841453 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-e65a9ea5-0787-4018-a2dd-d6e611be0318 tempest-VolumesNegativeTest-1210908864 tempest-VolumesNegativeTest-1210908864-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:37.842903 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-e65a9ea5-0787-4018-a2dd-d6e611be0318 tempest-VolumesNegativeTest-1210908864 tempest-VolumesNegativeTest-1210908864-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:37.844662 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-e65a9ea5-0787-4018-a2dd-d6e611be0318 tempest-VolumesNegativeTest-1210908864 tempest-VolumesNegativeTest-1210908864-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:37.845277 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-e65a9ea5-0787-4018-a2dd-d6e611be0318 tempest-VolumesNegativeTest-1210908864 tempest-VolumesNegativeTest-1210908864-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:38.066339 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-e65a9ea5-0787-4018-a2dd-d6e611be0318 tempest-VolumesNegativeTest-1210908864 tempest-VolumesNegativeTest-1210908864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66eb8a35b8b64ad0adaa54971706420e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741f915aad03472e8373166c4d7fd380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:39:38.078413 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-e65a9ea5-0787-4018-a2dd-d6e611be0318 tempest-VolumesNegativeTest-1210908864 tempest-VolumesNegativeTest-1210908864-project] 10.222.0.15 "GET /compute/v2.1/servers/0284c601-38fb-4270-8808-44aaf4b96c73" status: 200 len: 1471 microversion: 2.1 time: 0.254827 Oct 31 12:39:38.083690 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 461/932] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:39:37 2022] GET /compute/v2.1/servers/0284c601-38fb-4270-8808-44aaf4b96c73 => generated 1471 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 12:39:38.321195 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-18785c7e-a7ae-4a82-b309-6f8dc5eb7031 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:39:38.322080 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-18785c7e-a7ae-4a82-b309-6f8dc5eb7031 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] [instance: 96065a23-4a5f-4ffb-8b48-746d2dc2c301] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:39:38.329931 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-18785c7e-a7ae-4a82-b309-6f8dc5eb7031 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:38.330674 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-18785c7e-a7ae-4a82-b309-6f8dc5eb7031 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:38.331251 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-18785c7e-a7ae-4a82-b309-6f8dc5eb7031 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:38.332126 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-18785c7e-a7ae-4a82-b309-6f8dc5eb7031 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:38.332769 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-18785c7e-a7ae-4a82-b309-6f8dc5eb7031 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:38.333359 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-18785c7e-a7ae-4a82-b309-6f8dc5eb7031 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:38.348758 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-8d1386e4-c49c-4ae1-bd92-690b75dabf01 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:39:38.356165 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-8d1386e4-c49c-4ae1-bd92-690b75dabf01 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] [instance: 0a62e143-71fb-4080-9691-fea9a84eaaca] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:39:38.380461 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-8d1386e4-c49c-4ae1-bd92-690b75dabf01 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:38.381179 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-8d1386e4-c49c-4ae1-bd92-690b75dabf01 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:38.381782 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-8d1386e4-c49c-4ae1-bd92-690b75dabf01 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:38.382666 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-8d1386e4-c49c-4ae1-bd92-690b75dabf01 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:38.384551 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-8d1386e4-c49c-4ae1-bd92-690b75dabf01 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:38.388463 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-8d1386e4-c49c-4ae1-bd92-690b75dabf01 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:38.478258 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-8d1386e4-c49c-4ae1-bd92-690b75dabf01 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:38.480913 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-8d1386e4-c49c-4ae1-bd92-690b75dabf01 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:38.481471 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-8d1386e4-c49c-4ae1-bd92-690b75dabf01 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:38.482170 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.objects.instance [None req-8d1386e4-c49c-4ae1-bd92-690b75dabf01 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lazy-loading 'fault' on Instance uuid 0a62e143-71fb-4080-9691-fea9a84eaaca {{(pid=125441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 12:39:38.604881 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-8d1386e4-c49c-4ae1-bd92-690b75dabf01 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c03f0365ee4a26b8c076ae365325b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfbc3a46f12942299b99cdd20c989e1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:39:38.616314 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-8d1386e4-c49c-4ae1-bd92-690b75dabf01 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] 10.222.0.15 "GET /compute/v2.1/servers/0a62e143-71fb-4080-9691-fea9a84eaaca" status: 200 len: 1330 microversion: 2.1 time: 0.274341 Oct 31 12:39:38.617380 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 462/933] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:39:38 2022] GET /compute/v2.1/servers/0a62e143-71fb-4080-9691-fea9a84eaaca => generated 1330 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:39:38.855822 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-18785c7e-a7ae-4a82-b309-6f8dc5eb7031 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c1beb321e44908ab987b17f7b74484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a2bf9a5a484523a700e4e6c568d4de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:39:38.865989 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-18785c7e-a7ae-4a82-b309-6f8dc5eb7031 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] 10.222.0.15 "GET /compute/v2.1/servers/96065a23-4a5f-4ffb-8b48-746d2dc2c301" status: 200 len: 1674 microversion: 2.1 time: 0.548612 Oct 31 12:39:38.881228 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 472/934] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:39:38 2022] GET /compute/v2.1/servers/96065a23-4a5f-4ffb-8b48-746d2dc2c301 => generated 1674 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:39:39.101952 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-9d6f64bb-0ea5-4135-9435-ef6362688092 tempest-VolumesNegativeTest-1210908864 tempest-VolumesNegativeTest-1210908864-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:39:39.102816 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-9d6f64bb-0ea5-4135-9435-ef6362688092 tempest-VolumesNegativeTest-1210908864 tempest-VolumesNegativeTest-1210908864-project] [instance: 0284c601-38fb-4270-8808-44aaf4b96c73] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:39:39.109786 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-9d6f64bb-0ea5-4135-9435-ef6362688092 tempest-VolumesNegativeTest-1210908864 tempest-VolumesNegativeTest-1210908864-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:39.110616 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-9d6f64bb-0ea5-4135-9435-ef6362688092 tempest-VolumesNegativeTest-1210908864 tempest-VolumesNegativeTest-1210908864-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:39.111107 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-9d6f64bb-0ea5-4135-9435-ef6362688092 tempest-VolumesNegativeTest-1210908864 tempest-VolumesNegativeTest-1210908864-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:39.111888 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-9d6f64bb-0ea5-4135-9435-ef6362688092 tempest-VolumesNegativeTest-1210908864 tempest-VolumesNegativeTest-1210908864-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:39.112585 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-9d6f64bb-0ea5-4135-9435-ef6362688092 tempest-VolumesNegativeTest-1210908864 tempest-VolumesNegativeTest-1210908864-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:39.113066 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-9d6f64bb-0ea5-4135-9435-ef6362688092 tempest-VolumesNegativeTest-1210908864 tempest-VolumesNegativeTest-1210908864-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:39.345860 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-9d6f64bb-0ea5-4135-9435-ef6362688092 tempest-VolumesNegativeTest-1210908864 tempest-VolumesNegativeTest-1210908864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66eb8a35b8b64ad0adaa54971706420e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741f915aad03472e8373166c4d7fd380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:39:39.352857 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [req-d155aadb-dcda-430d-a7f0-16b73b750381 req-96627695-fedc-4ffe-8848-756b6ea75591 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0284c601-38fb-4270-8808-44aaf4b96c73", "name": "network-vif-deleted", "tag": "165b6d01-75c7-4d1f-9584-92ce0f4b1ea8"}]} {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 12:39:39.364026 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-9d6f64bb-0ea5-4135-9435-ef6362688092 tempest-VolumesNegativeTest-1210908864 tempest-VolumesNegativeTest-1210908864-project] 10.222.0.15 "GET /compute/v2.1/servers/0284c601-38fb-4270-8808-44aaf4b96c73" status: 200 len: 1471 microversion: 2.1 time: 0.264158 Oct 31 12:39:39.365938 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 463/935] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:39:39 2022] GET /compute/v2.1/servers/0284c601-38fb-4270-8808-44aaf4b96c73 => generated 1471 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:39:39.381608 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [req-d155aadb-dcda-430d-a7f0-16b73b750381 req-96627695-fedc-4ffe-8848-756b6ea75591 service nova] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:39.381608 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [req-d155aadb-dcda-430d-a7f0-16b73b750381 req-96627695-fedc-4ffe-8848-756b6ea75591 service nova] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:39.381608 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [req-d155aadb-dcda-430d-a7f0-16b73b750381 req-96627695-fedc-4ffe-8848-756b6ea75591 service nova] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:39.405696 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.compute.server_external_events [req-d155aadb-dcda-430d-a7f0-16b73b750381 req-96627695-fedc-4ffe-8848-756b6ea75591 service nova] Creating event network-vif-deleted:165b6d01-75c7-4d1f-9584-92ce0f4b1ea8 for instance 0284c601-38fb-4270-8808-44aaf4b96c73 on hv-cinder-79617 Oct 31 12:39:39.419209 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [req-d155aadb-dcda-430d-a7f0-16b73b750381 req-96627695-fedc-4ffe-8848-756b6ea75591 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069800 Oct 31 12:39:39.420124 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 473/936] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Oct 31 12:39:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 12:39:39.643100 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-f6377d7f-7dab-4c48-8fb2-43decc49c96f tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:39:39.647784 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-f6377d7f-7dab-4c48-8fb2-43decc49c96f tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] [instance: 0a62e143-71fb-4080-9691-fea9a84eaaca] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:39:39.661883 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-f6377d7f-7dab-4c48-8fb2-43decc49c96f tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:39.662665 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-f6377d7f-7dab-4c48-8fb2-43decc49c96f tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:39.663385 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-f6377d7f-7dab-4c48-8fb2-43decc49c96f tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:39.664302 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-f6377d7f-7dab-4c48-8fb2-43decc49c96f tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:39.664982 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-f6377d7f-7dab-4c48-8fb2-43decc49c96f tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:39.665640 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-f6377d7f-7dab-4c48-8fb2-43decc49c96f tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:39.684450 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.wsgi [None req-f6377d7f-7dab-4c48-8fb2-43decc49c96f tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] HTTP exception thrown: Instance 0a62e143-71fb-4080-9691-fea9a84eaaca could not be found. Oct 31 12:39:39.686647 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-f6377d7f-7dab-4c48-8fb2-43decc49c96f tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Request method failure captured: Oct 31 12:39:39.686647 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: request: GET /compute/v2.1/servers/0a62e143-71fb-4080-9691-fea9a84eaaca HTTP/1.1 Oct 31 12:39:39.686647 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: Accept: application/json Oct 31 12:39:39.686647 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: Accept-Encoding: identity Oct 31 12:39:39.686647 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: Connection: close Oct 31 12:39:39.686647 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: Content-Length: 0 Oct 31 12:39:39.686647 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: Content-Type: application/json Oct 31 12:39:39.686647 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: Host: 10.222.0.15 Oct 31 12:39:39.686647 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: Openstack-System-Scope: None Oct 31 12:39:39.686647 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: User-Agent: python-urllib3/1.26.12 Oct 31 12:39:39.686647 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Auth-Token: gAAAAABjX8B3Et2KM1ogPCTGs64pc6xLyfMw6yL0VTQe6oSz3vb_t3Nol1y36tJUXD6PegbQ8pwIEwo4L666w1x-Z79gwUGFQzXyfvvOjyyVZQL72gtR1ISe3h09afCWKpljHfxhI1Y-A2JuAkXEjCcgQXdDq6Gsj4TA71_GeBFeeItX_0KrPQA Oct 31 12:39:39.686647 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Domain-Id: None Oct 31 12:39:39.686647 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Domain-Name: None Oct 31 12:39:39.686647 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Identity-Status: Confirmed Oct 31 12:39:39.686647 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Is-Admin-Project: True Oct 31 12:39:39.686647 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Project-Domain-Id: default Oct 31 12:39:39.686647 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Project-Domain-Name: Default Oct 31 12:39:39.686647 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Project-Id: bfbc3a46f12942299b99cdd20c989e1f Oct 31 12:39:39.686647 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Project-Name: tempest-AttachVolumeNegativeTest-1648165012 Oct 31 12:39:39.686647 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Role: reader,member Oct 31 12:39:39.686647 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Roles: reader,member Oct 31 12:39:39.688018 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/bfbc3a46f12942299b99cdd20c989e1f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_bfbc3a46f12942299b99cdd20c989e1f", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/bfbc3a46f12942299b99cdd20c989e1f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/bfbc3a46f12942299b99cdd20c989e1f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Oct 31 12:39:39.688018 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Tenant: tempest-AttachVolumeNegativeTest-1648165012 Oct 31 12:39:39.688018 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Tenant-Id: bfbc3a46f12942299b99cdd20c989e1f Oct 31 12:39:39.688018 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1648165012 Oct 31 12:39:39.688018 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-User: tempest-AttachVolumeNegativeTest-1648165012-project Oct 31 12:39:39.688018 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-User-Domain-Id: default Oct 31 12:39:39.688018 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-User-Domain-Name: Default Oct 31 12:39:39.688018 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-User-Id: b2c03f0365ee4a26b8c076ae365325b2 Oct 31 12:39:39.688018 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-User-Name: tempest-AttachVolumeNegativeTest-1648165012-project Oct 31 12:39:39.688018 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: method: > Oct 31 12:39:39.688018 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: exception: Instance 0a62e143-71fb-4080-9691-fea9a84eaaca could not be found. Oct 31 12:39:39.688018 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: action_args: {'id': '0a62e143-71fb-4080-9691-fea9a84eaaca'} Oct 31 12:39:39.688770 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 12:39:39.688770 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 12:39:39.688770 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 12:39:39.688770 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 12:39:39.688770 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 12:39:39.688770 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 12:39:39.688770 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 12:39:39.688770 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 12:39:39.688770 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 12:39:39.688770 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 12:39:39.688770 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a62e143-71fb-4080-9691-fea9a84eaaca could not be found. Oct 31 12:39:39.688770 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Oct 31 12:39:39.688770 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 12:39:39.688770 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Oct 31 12:39:39.688770 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 12:39:39.688770 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 12:39:39.688770 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 12:39:39.688770 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 12:39:39.688770 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 12:39:39.688770 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 12:39:39.690040 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 12:39:39.690040 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 12:39:39.690040 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 12:39:39.690040 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 12:39:39.690040 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 12:39:39.690040 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 12:39:39.690040 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 12:39:39.690040 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a62e143-71fb-4080-9691-fea9a84eaaca could not be found. Oct 31 12:39:39.690040 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Oct 31 12:39:39.690040 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 12:39:39.690040 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Oct 31 12:39:39.690040 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 12:39:39.690040 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 12:39:39.690040 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 12:39:39.690040 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 12:39:39.690040 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 12:39:39.690040 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a62e143-71fb-4080-9691-fea9a84eaaca could not be found. Oct 31 12:39:39.690040 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Oct 31 12:39:39.693568 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-f6377d7f-7dab-4c48-8fb2-43decc49c96f tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Returning 404 to user: Instance 0a62e143-71fb-4080-9691-fea9a84eaaca could not be found. {{(pid=125441) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 12:39:39.694783 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-f6377d7f-7dab-4c48-8fb2-43decc49c96f tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] 10.222.0.15 "GET /compute/v2.1/servers/0a62e143-71fb-4080-9691-fea9a84eaaca" status: 404 len: 111 microversion: 2.1 time: 0.056633 Oct 31 12:39:39.696210 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 464/937] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:39:39 2022] GET /compute/v2.1/servers/0a62e143-71fb-4080-9691-fea9a84eaaca => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 12:39:39.706333 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-d7d75419-edd7-41c3-abb2-6d8ffc689850 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Calling method '.version_select at 0x7f2aa5198550>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:39:39.727319 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-d7d75419-edd7-41c3-abb2-6d8ffc689850 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-51787476" status: 202 len: 0 microversion: 2.1 time: 0.025179 Oct 31 12:39:39.728686 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 474/938] 10.222.0.15 () {58 vars in 1215 bytes} [Mon Oct 31 12:39:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-51787476 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 12:39:39.893288 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-f9e943cb-ba0e-439a-8aba-1eedf80f86cd tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:39:39.894444 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-f9e943cb-ba0e-439a-8aba-1eedf80f86cd tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] [instance: 96065a23-4a5f-4ffb-8b48-746d2dc2c301] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:39:39.907848 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-f9e943cb-ba0e-439a-8aba-1eedf80f86cd tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:39.908714 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-f9e943cb-ba0e-439a-8aba-1eedf80f86cd tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:39.909370 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-f9e943cb-ba0e-439a-8aba-1eedf80f86cd tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:39.910344 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-f9e943cb-ba0e-439a-8aba-1eedf80f86cd tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:39.911028 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-f9e943cb-ba0e-439a-8aba-1eedf80f86cd tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:39.911752 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-f9e943cb-ba0e-439a-8aba-1eedf80f86cd tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:40.074016 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-f9e943cb-ba0e-439a-8aba-1eedf80f86cd tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c1beb321e44908ab987b17f7b74484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a2bf9a5a484523a700e4e6c568d4de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:39:40.083528 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-f9e943cb-ba0e-439a-8aba-1eedf80f86cd tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] 10.222.0.15 "GET /compute/v2.1/servers/96065a23-4a5f-4ffb-8b48-746d2dc2c301" status: 200 len: 1606 microversion: 2.1 time: 0.195091 Oct 31 12:39:40.095546 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 465/939] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:39:39 2022] GET /compute/v2.1/servers/96065a23-4a5f-4ffb-8b48-746d2dc2c301 => generated 1606 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:39:40.399350 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-6ca893ac-186a-42bf-8d33-7ed6221ed52e tempest-VolumesNegativeTest-1210908864 tempest-VolumesNegativeTest-1210908864-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:39:40.407610 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-6ca893ac-186a-42bf-8d33-7ed6221ed52e tempest-VolumesNegativeTest-1210908864 tempest-VolumesNegativeTest-1210908864-project] [instance: 0284c601-38fb-4270-8808-44aaf4b96c73] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:39:40.434193 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-6ca893ac-186a-42bf-8d33-7ed6221ed52e tempest-VolumesNegativeTest-1210908864 tempest-VolumesNegativeTest-1210908864-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:40.434730 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-6ca893ac-186a-42bf-8d33-7ed6221ed52e tempest-VolumesNegativeTest-1210908864 tempest-VolumesNegativeTest-1210908864-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:40.443325 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-6ca893ac-186a-42bf-8d33-7ed6221ed52e tempest-VolumesNegativeTest-1210908864 tempest-VolumesNegativeTest-1210908864-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:40.446683 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-6ca893ac-186a-42bf-8d33-7ed6221ed52e tempest-VolumesNegativeTest-1210908864 tempest-VolumesNegativeTest-1210908864-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:40.448663 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-6ca893ac-186a-42bf-8d33-7ed6221ed52e tempest-VolumesNegativeTest-1210908864 tempest-VolumesNegativeTest-1210908864-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:40.449228 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-6ca893ac-186a-42bf-8d33-7ed6221ed52e tempest-VolumesNegativeTest-1210908864 tempest-VolumesNegativeTest-1210908864-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:40.473073 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.wsgi [None req-6ca893ac-186a-42bf-8d33-7ed6221ed52e tempest-VolumesNegativeTest-1210908864 tempest-VolumesNegativeTest-1210908864-project] HTTP exception thrown: Instance 0284c601-38fb-4270-8808-44aaf4b96c73 could not be found. Oct 31 12:39:40.475086 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-6ca893ac-186a-42bf-8d33-7ed6221ed52e tempest-VolumesNegativeTest-1210908864 tempest-VolumesNegativeTest-1210908864-project] Request method failure captured: Oct 31 12:39:40.475086 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: request: GET /compute/v2.1/servers/0284c601-38fb-4270-8808-44aaf4b96c73 HTTP/1.1 Oct 31 12:39:40.475086 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: Accept: application/json Oct 31 12:39:40.475086 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: Accept-Encoding: identity Oct 31 12:39:40.475086 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: Connection: close Oct 31 12:39:40.475086 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: Content-Length: 0 Oct 31 12:39:40.475086 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: Content-Type: application/json Oct 31 12:39:40.475086 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: Host: 10.222.0.15 Oct 31 12:39:40.475086 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: Openstack-System-Scope: None Oct 31 12:39:40.475086 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: User-Agent: python-urllib3/1.26.12 Oct 31 12:39:40.475086 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Auth-Token: gAAAAABjX8H1yCmpDAFZFgaNlpVk2HPvOrUsRPTEDicylZ96riyJ7GIuQCPIbbbrVBegfXsH09pCUi1nEdxiQrMAYmirCCSzd1dOwYZ6aQe7HQHr4BOBwG2fHDuvKYI8rdQWGQU3SSulta77FYns68AAO_G60-7PexjXTnBCm_fOsDk2UUwpk-8 Oct 31 12:39:40.475086 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Domain-Id: None Oct 31 12:39:40.475086 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Domain-Name: None Oct 31 12:39:40.475086 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Identity-Status: Confirmed Oct 31 12:39:40.475086 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Is-Admin-Project: True Oct 31 12:39:40.475086 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Project-Domain-Id: default Oct 31 12:39:40.475086 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Project-Domain-Name: Default Oct 31 12:39:40.475086 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Project-Id: 741f915aad03472e8373166c4d7fd380 Oct 31 12:39:40.475086 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Project-Name: tempest-VolumesNegativeTest-1210908864 Oct 31 12:39:40.475086 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Role: reader,member Oct 31 12:39:40.475086 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Roles: reader,member Oct 31 12:39:40.476854 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/741f915aad03472e8373166c4d7fd380"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_741f915aad03472e8373166c4d7fd380", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/741f915aad03472e8373166c4d7fd380"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/741f915aad03472e8373166c4d7fd380"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Oct 31 12:39:40.476854 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Tenant: tempest-VolumesNegativeTest-1210908864 Oct 31 12:39:40.476854 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Tenant-Id: 741f915aad03472e8373166c4d7fd380 Oct 31 12:39:40.476854 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Tenant-Name: tempest-VolumesNegativeTest-1210908864 Oct 31 12:39:40.476854 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-User: tempest-VolumesNegativeTest-1210908864-project Oct 31 12:39:40.476854 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-User-Domain-Id: default Oct 31 12:39:40.476854 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-User-Domain-Name: Default Oct 31 12:39:40.476854 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-User-Id: 66eb8a35b8b64ad0adaa54971706420e Oct 31 12:39:40.476854 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-User-Name: tempest-VolumesNegativeTest-1210908864-project Oct 31 12:39:40.476854 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: method: > Oct 31 12:39:40.476854 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: exception: Instance 0284c601-38fb-4270-8808-44aaf4b96c73 could not be found. Oct 31 12:39:40.476854 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: action_args: {'id': '0284c601-38fb-4270-8808-44aaf4b96c73'} Oct 31 12:39:40.477805 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 12:39:40.477805 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 12:39:40.477805 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 12:39:40.477805 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 12:39:40.477805 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 12:39:40.477805 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 12:39:40.477805 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 12:39:40.477805 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 12:39:40.477805 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 12:39:40.477805 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 12:39:40.477805 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0284c601-38fb-4270-8808-44aaf4b96c73 could not be found. Oct 31 12:39:40.477805 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Oct 31 12:39:40.477805 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 12:39:40.477805 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Oct 31 12:39:40.477805 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 12:39:40.477805 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 12:39:40.477805 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 12:39:40.477805 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 12:39:40.477805 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 12:39:40.477805 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 12:39:40.480057 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 12:39:40.480057 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 12:39:40.480057 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 12:39:40.480057 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 12:39:40.480057 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 12:39:40.480057 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 12:39:40.480057 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 12:39:40.480057 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0284c601-38fb-4270-8808-44aaf4b96c73 could not be found. Oct 31 12:39:40.480057 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Oct 31 12:39:40.480057 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 12:39:40.480057 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Oct 31 12:39:40.480057 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 12:39:40.480057 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 12:39:40.480057 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 12:39:40.480057 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 12:39:40.480057 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 12:39:40.480057 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0284c601-38fb-4270-8808-44aaf4b96c73 could not be found. Oct 31 12:39:40.480057 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Oct 31 12:39:40.483374 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-6ca893ac-186a-42bf-8d33-7ed6221ed52e tempest-VolumesNegativeTest-1210908864 tempest-VolumesNegativeTest-1210908864-project] Returning 404 to user: Instance 0284c601-38fb-4270-8808-44aaf4b96c73 could not be found. {{(pid=125440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 12:39:40.484449 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-6ca893ac-186a-42bf-8d33-7ed6221ed52e tempest-VolumesNegativeTest-1210908864 tempest-VolumesNegativeTest-1210908864-project] 10.222.0.15 "GET /compute/v2.1/servers/0284c601-38fb-4270-8808-44aaf4b96c73" status: 404 len: 111 microversion: 2.1 time: 0.097166 Oct 31 12:39:40.486224 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 475/940] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:39:40 2022] GET /compute/v2.1/servers/0284c601-38fb-4270-8808-44aaf4b96c73 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 12:39:41.113383 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-7043e239-40e7-4ee3-92a8-3bd43f5093f7 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:39:41.114658 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-7043e239-40e7-4ee3-92a8-3bd43f5093f7 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] [instance: 96065a23-4a5f-4ffb-8b48-746d2dc2c301] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:39:41.131365 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-7043e239-40e7-4ee3-92a8-3bd43f5093f7 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:41.134520 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-7043e239-40e7-4ee3-92a8-3bd43f5093f7 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:41.143131 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-7043e239-40e7-4ee3-92a8-3bd43f5093f7 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:41.147201 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-7043e239-40e7-4ee3-92a8-3bd43f5093f7 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:41.147901 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-7043e239-40e7-4ee3-92a8-3bd43f5093f7 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:41.150066 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-7043e239-40e7-4ee3-92a8-3bd43f5093f7 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:41.179868 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.wsgi [None req-7043e239-40e7-4ee3-92a8-3bd43f5093f7 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] HTTP exception thrown: Instance 96065a23-4a5f-4ffb-8b48-746d2dc2c301 could not be found. Oct 31 12:39:41.182547 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-7043e239-40e7-4ee3-92a8-3bd43f5093f7 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Request method failure captured: Oct 31 12:39:41.182547 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: request: GET /compute/v2.1/servers/96065a23-4a5f-4ffb-8b48-746d2dc2c301 HTTP/1.1 Oct 31 12:39:41.182547 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: Accept: application/json Oct 31 12:39:41.182547 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: Accept-Encoding: identity Oct 31 12:39:41.182547 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: Connection: close Oct 31 12:39:41.182547 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: Content-Length: 0 Oct 31 12:39:41.182547 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: Content-Type: application/json Oct 31 12:39:41.182547 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: Host: 10.222.0.15 Oct 31 12:39:41.182547 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: Openstack-System-Scope: None Oct 31 12:39:41.182547 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: User-Agent: python-urllib3/1.26.12 Oct 31 12:39:41.182547 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Auth-Token: gAAAAABjX8B2m1m9MuKBHO0SxDm7arupmshYlZMAAEgJbORjur4Qe9OXcQVHKBx6k7T788otdlxtGddMg-xkFyl2KDcVhkjBWCqqwl5KGIfG6sLllN0xH9I_wHEXqxzSWixQ1A2CE1FBbOiKiTEJ4kGxgYMjSo6WKiJZiEFxLVgKkbpX9vSJpEU Oct 31 12:39:41.182547 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Domain-Id: None Oct 31 12:39:41.182547 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Domain-Name: None Oct 31 12:39:41.182547 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Identity-Status: Confirmed Oct 31 12:39:41.182547 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Is-Admin-Project: True Oct 31 12:39:41.182547 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Project-Domain-Id: default Oct 31 12:39:41.182547 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Project-Domain-Name: Default Oct 31 12:39:41.182547 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Project-Id: b9a2bf9a5a484523a700e4e6c568d4de Oct 31 12:39:41.182547 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Project-Name: tempest-AttachVolumeTestJSON-447861972 Oct 31 12:39:41.182547 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Role: reader,member Oct 31 12:39:41.182547 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Roles: reader,member Oct 31 12:39:41.184179 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/b9a2bf9a5a484523a700e4e6c568d4de"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_b9a2bf9a5a484523a700e4e6c568d4de", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/b9a2bf9a5a484523a700e4e6c568d4de"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/b9a2bf9a5a484523a700e4e6c568d4de"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Oct 31 12:39:41.184179 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Tenant: tempest-AttachVolumeTestJSON-447861972 Oct 31 12:39:41.184179 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Tenant-Id: b9a2bf9a5a484523a700e4e6c568d4de Oct 31 12:39:41.184179 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Tenant-Name: tempest-AttachVolumeTestJSON-447861972 Oct 31 12:39:41.184179 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-User: tempest-AttachVolumeTestJSON-447861972-project Oct 31 12:39:41.184179 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-User-Domain-Id: default Oct 31 12:39:41.184179 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-User-Domain-Name: Default Oct 31 12:39:41.184179 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-User-Id: d6c1beb321e44908ab987b17f7b74484 Oct 31 12:39:41.184179 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-User-Name: tempest-AttachVolumeTestJSON-447861972-project Oct 31 12:39:41.184179 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: method: > Oct 31 12:39:41.184179 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: exception: Instance 96065a23-4a5f-4ffb-8b48-746d2dc2c301 could not be found. Oct 31 12:39:41.184179 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: action_args: {'id': '96065a23-4a5f-4ffb-8b48-746d2dc2c301'} Oct 31 12:39:41.185079 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 12:39:41.185079 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 12:39:41.185079 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 12:39:41.185079 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 12:39:41.185079 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 12:39:41.185079 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 12:39:41.185079 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 12:39:41.185079 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 12:39:41.185079 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 12:39:41.185079 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 12:39:41.185079 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 96065a23-4a5f-4ffb-8b48-746d2dc2c301 could not be found. Oct 31 12:39:41.185079 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Oct 31 12:39:41.185079 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 12:39:41.185079 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Oct 31 12:39:41.185079 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 12:39:41.185079 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 12:39:41.185079 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 12:39:41.185079 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 12:39:41.185079 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 12:39:41.185079 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 12:39:41.186503 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 12:39:41.186503 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 12:39:41.186503 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 12:39:41.186503 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 12:39:41.186503 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 12:39:41.186503 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 12:39:41.186503 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 12:39:41.186503 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 96065a23-4a5f-4ffb-8b48-746d2dc2c301 could not be found. Oct 31 12:39:41.186503 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Oct 31 12:39:41.186503 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 12:39:41.186503 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Oct 31 12:39:41.186503 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 12:39:41.186503 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 12:39:41.186503 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 12:39:41.186503 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 12:39:41.186503 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 12:39:41.186503 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 96065a23-4a5f-4ffb-8b48-746d2dc2c301 could not be found. Oct 31 12:39:41.186503 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Oct 31 12:39:41.188923 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-7043e239-40e7-4ee3-92a8-3bd43f5093f7 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Returning 404 to user: Instance 96065a23-4a5f-4ffb-8b48-746d2dc2c301 could not be found. {{(pid=125441) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 12:39:41.189939 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-7043e239-40e7-4ee3-92a8-3bd43f5093f7 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] 10.222.0.15 "GET /compute/v2.1/servers/96065a23-4a5f-4ffb-8b48-746d2dc2c301" status: 404 len: 111 microversion: 2.1 time: 0.082521 Oct 31 12:39:41.190993 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 466/941] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:39:41 2022] GET /compute/v2.1/servers/96065a23-4a5f-4ffb-8b48-746d2dc2c301 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 12:39:41.200145 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-6e2fc696-df87-4dd3-aa5b-4c530860c2d0 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Calling method '.version_select at 0x7f2aa54afe50>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:39:41.244567 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-6e2fc696-df87-4dd3-aa5b-4c530860c2d0 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1119950657" status: 202 len: 0 microversion: 2.1 time: 0.049058 Oct 31 12:39:41.245842 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 476/942] 10.222.0.15 () {58 vars in 1221 bytes} [Mon Oct 31 12:39:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1119950657 => generated 0 bytes in 51 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 12:39:41.477474 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [req-551610e2-fed2-4e04-b1c9-6c98e5c8d137 req-542d08e5-8b3e-47f4-a15f-1059b40ea191 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96065a23-4a5f-4ffb-8b48-746d2dc2c301", "name": "network-vif-deleted", "tag": "7b6ab379-5ce7-4b17-b091-dac7cbe3cfd0"}]} {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 12:39:41.527016 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [req-551610e2-fed2-4e04-b1c9-6c98e5c8d137 req-542d08e5-8b3e-47f4-a15f-1059b40ea191 service nova] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:41.527886 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [req-551610e2-fed2-4e04-b1c9-6c98e5c8d137 req-542d08e5-8b3e-47f4-a15f-1059b40ea191 service nova] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:41.528568 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [req-551610e2-fed2-4e04-b1c9-6c98e5c8d137 req-542d08e5-8b3e-47f4-a15f-1059b40ea191 service nova] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:41.574057 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.compute.server_external_events [req-551610e2-fed2-4e04-b1c9-6c98e5c8d137 req-542d08e5-8b3e-47f4-a15f-1059b40ea191 service nova] Creating event network-vif-deleted:7b6ab379-5ce7-4b17-b091-dac7cbe3cfd0 for instance 96065a23-4a5f-4ffb-8b48-746d2dc2c301 on hv-cinder-79617 Oct 31 12:39:41.594276 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [req-551610e2-fed2-4e04-b1c9-6c98e5c8d137 req-542d08e5-8b3e-47f4-a15f-1059b40ea191 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.128274 Oct 31 12:39:41.599574 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 467/943] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Oct 31 12:39:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 12:39:42.750767 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-4dc2c2e5-717b-41e7-9335-3c3904315547 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:39:42.751308 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-4dc2c2e5-717b-41e7-9335-3c3904315547 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] [instance: 0a62e143-71fb-4080-9691-fea9a84eaaca] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:39:42.763524 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-4dc2c2e5-717b-41e7-9335-3c3904315547 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:42.767810 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-4dc2c2e5-717b-41e7-9335-3c3904315547 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:42.768997 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-4dc2c2e5-717b-41e7-9335-3c3904315547 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:42.773447 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-4dc2c2e5-717b-41e7-9335-3c3904315547 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:42.773985 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-4dc2c2e5-717b-41e7-9335-3c3904315547 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:42.774594 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-4dc2c2e5-717b-41e7-9335-3c3904315547 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:42.802887 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.wsgi [None req-4dc2c2e5-717b-41e7-9335-3c3904315547 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] HTTP exception thrown: Instance 0a62e143-71fb-4080-9691-fea9a84eaaca could not be found. Oct 31 12:39:42.804513 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-4dc2c2e5-717b-41e7-9335-3c3904315547 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Request method failure captured: Oct 31 12:39:42.804513 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: request: DELETE /compute/v2.1/servers/0a62e143-71fb-4080-9691-fea9a84eaaca HTTP/1.1 Oct 31 12:39:42.804513 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: Accept: application/json Oct 31 12:39:42.804513 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: Accept-Encoding: identity Oct 31 12:39:42.804513 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: Connection: close Oct 31 12:39:42.804513 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: Content-Length: 0 Oct 31 12:39:42.804513 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: Content-Type: application/json Oct 31 12:39:42.804513 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: Host: 10.222.0.15 Oct 31 12:39:42.804513 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: Openstack-System-Scope: None Oct 31 12:39:42.804513 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: User-Agent: python-urllib3/1.26.12 Oct 31 12:39:42.804513 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Auth-Token: gAAAAABjX8B3Et2KM1ogPCTGs64pc6xLyfMw6yL0VTQe6oSz3vb_t3Nol1y36tJUXD6PegbQ8pwIEwo4L666w1x-Z79gwUGFQzXyfvvOjyyVZQL72gtR1ISe3h09afCWKpljHfxhI1Y-A2JuAkXEjCcgQXdDq6Gsj4TA71_GeBFeeItX_0KrPQA Oct 31 12:39:42.804513 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Domain-Id: None Oct 31 12:39:42.804513 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Domain-Name: None Oct 31 12:39:42.804513 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Identity-Status: Confirmed Oct 31 12:39:42.804513 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Is-Admin-Project: True Oct 31 12:39:42.804513 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Project-Domain-Id: default Oct 31 12:39:42.804513 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Project-Domain-Name: Default Oct 31 12:39:42.804513 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Project-Id: bfbc3a46f12942299b99cdd20c989e1f Oct 31 12:39:42.804513 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Project-Name: tempest-AttachVolumeNegativeTest-1648165012 Oct 31 12:39:42.804513 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Role: reader,member Oct 31 12:39:42.804513 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Roles: reader,member Oct 31 12:39:42.806109 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/bfbc3a46f12942299b99cdd20c989e1f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_bfbc3a46f12942299b99cdd20c989e1f", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/bfbc3a46f12942299b99cdd20c989e1f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/bfbc3a46f12942299b99cdd20c989e1f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Oct 31 12:39:42.806109 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Tenant: tempest-AttachVolumeNegativeTest-1648165012 Oct 31 12:39:42.806109 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Tenant-Id: bfbc3a46f12942299b99cdd20c989e1f Oct 31 12:39:42.806109 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1648165012 Oct 31 12:39:42.806109 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-User: tempest-AttachVolumeNegativeTest-1648165012-project Oct 31 12:39:42.806109 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-User-Domain-Id: default Oct 31 12:39:42.806109 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-User-Domain-Name: Default Oct 31 12:39:42.806109 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-User-Id: b2c03f0365ee4a26b8c076ae365325b2 Oct 31 12:39:42.806109 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-User-Name: tempest-AttachVolumeNegativeTest-1648165012-project Oct 31 12:39:42.806109 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: method: > Oct 31 12:39:42.806109 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: exception: Instance 0a62e143-71fb-4080-9691-fea9a84eaaca could not be found. Oct 31 12:39:42.806109 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: action_args: {'id': '0a62e143-71fb-4080-9691-fea9a84eaaca'} Oct 31 12:39:42.807082 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 12:39:42.807082 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 12:39:42.807082 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 12:39:42.807082 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 12:39:42.807082 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 12:39:42.807082 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 12:39:42.807082 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 12:39:42.807082 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 12:39:42.807082 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 12:39:42.807082 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 12:39:42.807082 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a62e143-71fb-4080-9691-fea9a84eaaca could not be found. Oct 31 12:39:42.807082 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Oct 31 12:39:42.807082 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 12:39:42.807082 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Oct 31 12:39:42.807082 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 12:39:42.807082 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 12:39:42.807082 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 12:39:42.807082 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 12:39:42.807082 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 12:39:42.807082 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 12:39:42.808304 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 12:39:42.808304 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 31 12:39:42.808304 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 31 12:39:42.808304 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 31 12:39:42.808304 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 31 12:39:42.808304 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 12:39:42.808304 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 12:39:42.808304 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 12:39:42.808304 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 12:39:42.808304 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a62e143-71fb-4080-9691-fea9a84eaaca could not be found. Oct 31 12:39:42.808304 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Oct 31 12:39:42.808304 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 12:39:42.808304 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Oct 31 12:39:42.808304 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 12:39:42.808304 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 12:39:42.808304 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 12:39:42.808304 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 12:39:42.808304 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 12:39:42.808304 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a62e143-71fb-4080-9691-fea9a84eaaca could not be found. Oct 31 12:39:42.808304 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Oct 31 12:39:42.809490 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-4dc2c2e5-717b-41e7-9335-3c3904315547 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Returning 404 to user: Instance 0a62e143-71fb-4080-9691-fea9a84eaaca could not be found. {{(pid=125440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 12:39:42.809490 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-4dc2c2e5-717b-41e7-9335-3c3904315547 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] 10.222.0.15 "DELETE /compute/v2.1/servers/0a62e143-71fb-4080-9691-fea9a84eaaca" status: 404 len: 111 microversion: 2.1 time: 0.060240 Oct 31 12:39:42.809490 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 477/944] 10.222.0.15 () {58 vars in 1239 bytes} [Mon Oct 31 12:39:42 2022] DELETE /compute/v2.1/servers/0a62e143-71fb-4080-9691-fea9a84eaaca => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 12:39:42.817174 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-6ae5f894-adf3-438e-b65b-4ec3e3f25016 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:39:42.819661 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-6ae5f894-adf3-438e-b65b-4ec3e3f25016 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] [instance: 0a62e143-71fb-4080-9691-fea9a84eaaca] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:39:42.839986 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-6ae5f894-adf3-438e-b65b-4ec3e3f25016 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:42.839986 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-6ae5f894-adf3-438e-b65b-4ec3e3f25016 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:42.839986 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-6ae5f894-adf3-438e-b65b-4ec3e3f25016 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:42.839986 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-6ae5f894-adf3-438e-b65b-4ec3e3f25016 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:42.840827 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-6ae5f894-adf3-438e-b65b-4ec3e3f25016 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:42.843097 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-6ae5f894-adf3-438e-b65b-4ec3e3f25016 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:42.856114 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.wsgi [None req-6ae5f894-adf3-438e-b65b-4ec3e3f25016 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] HTTP exception thrown: Instance 0a62e143-71fb-4080-9691-fea9a84eaaca could not be found. Oct 31 12:39:42.857765 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-6ae5f894-adf3-438e-b65b-4ec3e3f25016 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Request method failure captured: Oct 31 12:39:42.857765 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: request: GET /compute/v2.1/servers/0a62e143-71fb-4080-9691-fea9a84eaaca HTTP/1.1 Oct 31 12:39:42.857765 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: Accept: application/json Oct 31 12:39:42.857765 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: Accept-Encoding: identity Oct 31 12:39:42.857765 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: Connection: close Oct 31 12:39:42.857765 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: Content-Length: 0 Oct 31 12:39:42.857765 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: Content-Type: application/json Oct 31 12:39:42.857765 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: Host: 10.222.0.15 Oct 31 12:39:42.857765 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: Openstack-System-Scope: None Oct 31 12:39:42.857765 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: User-Agent: python-urllib3/1.26.12 Oct 31 12:39:42.857765 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Auth-Token: gAAAAABjX8B3Et2KM1ogPCTGs64pc6xLyfMw6yL0VTQe6oSz3vb_t3Nol1y36tJUXD6PegbQ8pwIEwo4L666w1x-Z79gwUGFQzXyfvvOjyyVZQL72gtR1ISe3h09afCWKpljHfxhI1Y-A2JuAkXEjCcgQXdDq6Gsj4TA71_GeBFeeItX_0KrPQA Oct 31 12:39:42.857765 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Domain-Id: None Oct 31 12:39:42.857765 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Domain-Name: None Oct 31 12:39:42.857765 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Identity-Status: Confirmed Oct 31 12:39:42.857765 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Is-Admin-Project: True Oct 31 12:39:42.857765 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Project-Domain-Id: default Oct 31 12:39:42.857765 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Project-Domain-Name: Default Oct 31 12:39:42.857765 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Project-Id: bfbc3a46f12942299b99cdd20c989e1f Oct 31 12:39:42.857765 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Project-Name: tempest-AttachVolumeNegativeTest-1648165012 Oct 31 12:39:42.857765 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Role: reader,member Oct 31 12:39:42.857765 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Roles: reader,member Oct 31 12:39:42.859124 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/bfbc3a46f12942299b99cdd20c989e1f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_bfbc3a46f12942299b99cdd20c989e1f", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/bfbc3a46f12942299b99cdd20c989e1f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/bfbc3a46f12942299b99cdd20c989e1f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Oct 31 12:39:42.859124 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Tenant: tempest-AttachVolumeNegativeTest-1648165012 Oct 31 12:39:42.859124 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Tenant-Id: bfbc3a46f12942299b99cdd20c989e1f Oct 31 12:39:42.859124 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1648165012 Oct 31 12:39:42.859124 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-User: tempest-AttachVolumeNegativeTest-1648165012-project Oct 31 12:39:42.859124 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-User-Domain-Id: default Oct 31 12:39:42.859124 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-User-Domain-Name: Default Oct 31 12:39:42.859124 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-User-Id: b2c03f0365ee4a26b8c076ae365325b2 Oct 31 12:39:42.859124 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-User-Name: tempest-AttachVolumeNegativeTest-1648165012-project Oct 31 12:39:42.859124 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: method: > Oct 31 12:39:42.859124 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: exception: Instance 0a62e143-71fb-4080-9691-fea9a84eaaca could not be found. Oct 31 12:39:42.859124 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: action_args: {'id': '0a62e143-71fb-4080-9691-fea9a84eaaca'} Oct 31 12:39:42.859936 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 12:39:42.859936 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 12:39:42.859936 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 12:39:42.859936 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 12:39:42.859936 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 12:39:42.859936 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 12:39:42.859936 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 12:39:42.859936 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 12:39:42.859936 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 12:39:42.859936 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 12:39:42.859936 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a62e143-71fb-4080-9691-fea9a84eaaca could not be found. Oct 31 12:39:42.859936 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Oct 31 12:39:42.859936 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 12:39:42.859936 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Oct 31 12:39:42.859936 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 12:39:42.859936 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 12:39:42.859936 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 12:39:42.859936 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 12:39:42.859936 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 12:39:42.859936 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 12:39:42.861514 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 12:39:42.861514 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 12:39:42.861514 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 12:39:42.861514 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 12:39:42.861514 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 12:39:42.861514 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 12:39:42.861514 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 12:39:42.861514 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a62e143-71fb-4080-9691-fea9a84eaaca could not be found. Oct 31 12:39:42.861514 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Oct 31 12:39:42.861514 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 12:39:42.861514 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Oct 31 12:39:42.861514 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 12:39:42.861514 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 12:39:42.861514 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 12:39:42.861514 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 12:39:42.861514 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 12:39:42.861514 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a62e143-71fb-4080-9691-fea9a84eaaca could not be found. Oct 31 12:39:42.861514 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Oct 31 12:39:42.862909 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-6ae5f894-adf3-438e-b65b-4ec3e3f25016 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Returning 404 to user: Instance 0a62e143-71fb-4080-9691-fea9a84eaaca could not be found. {{(pid=125441) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 12:39:42.862909 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-6ae5f894-adf3-438e-b65b-4ec3e3f25016 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] 10.222.0.15 "GET /compute/v2.1/servers/0a62e143-71fb-4080-9691-fea9a84eaaca" status: 404 len: 111 microversion: 2.1 time: 0.048044 Oct 31 12:39:42.863883 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 468/945] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:39:42 2022] GET /compute/v2.1/servers/0a62e143-71fb-4080-9691-fea9a84eaaca => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 12:39:44.084953 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-8d24344a-9050-435b-8f22-e6416428a080 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:39:44.086135 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-8d24344a-9050-435b-8f22-e6416428a080 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] [instance: 46cae3a9-45e8-401c-b201-2ed4402e9e97] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:39:44.096339 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-8d24344a-9050-435b-8f22-e6416428a080 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:44.097089 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-8d24344a-9050-435b-8f22-e6416428a080 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:44.097533 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-8d24344a-9050-435b-8f22-e6416428a080 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:44.098884 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-8d24344a-9050-435b-8f22-e6416428a080 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:44.099388 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-8d24344a-9050-435b-8f22-e6416428a080 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:44.099923 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-8d24344a-9050-435b-8f22-e6416428a080 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:44.117429 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.wsgi [None req-8d24344a-9050-435b-8f22-e6416428a080 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] HTTP exception thrown: Instance 46cae3a9-45e8-401c-b201-2ed4402e9e97 could not be found. Oct 31 12:39:44.120346 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-8d24344a-9050-435b-8f22-e6416428a080 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Request method failure captured: Oct 31 12:39:44.120346 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: request: DELETE /compute/v2.1/servers/46cae3a9-45e8-401c-b201-2ed4402e9e97 HTTP/1.1 Oct 31 12:39:44.120346 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: Accept: application/json Oct 31 12:39:44.120346 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: Accept-Encoding: identity Oct 31 12:39:44.120346 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: Connection: close Oct 31 12:39:44.120346 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: Content-Length: 0 Oct 31 12:39:44.120346 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: Content-Type: application/json Oct 31 12:39:44.120346 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: Host: 10.222.0.15 Oct 31 12:39:44.120346 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: Openstack-System-Scope: None Oct 31 12:39:44.120346 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: User-Agent: python-urllib3/1.26.12 Oct 31 12:39:44.120346 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Auth-Token: gAAAAABjX8B3Et2KM1ogPCTGs64pc6xLyfMw6yL0VTQe6oSz3vb_t3Nol1y36tJUXD6PegbQ8pwIEwo4L666w1x-Z79gwUGFQzXyfvvOjyyVZQL72gtR1ISe3h09afCWKpljHfxhI1Y-A2JuAkXEjCcgQXdDq6Gsj4TA71_GeBFeeItX_0KrPQA Oct 31 12:39:44.120346 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Domain-Id: None Oct 31 12:39:44.120346 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Domain-Name: None Oct 31 12:39:44.120346 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Identity-Status: Confirmed Oct 31 12:39:44.120346 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Is-Admin-Project: True Oct 31 12:39:44.120346 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Project-Domain-Id: default Oct 31 12:39:44.120346 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Project-Domain-Name: Default Oct 31 12:39:44.120346 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Project-Id: bfbc3a46f12942299b99cdd20c989e1f Oct 31 12:39:44.120346 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Project-Name: tempest-AttachVolumeNegativeTest-1648165012 Oct 31 12:39:44.120346 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Role: reader,member Oct 31 12:39:44.120346 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Roles: reader,member Oct 31 12:39:44.121792 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/bfbc3a46f12942299b99cdd20c989e1f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_bfbc3a46f12942299b99cdd20c989e1f", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/bfbc3a46f12942299b99cdd20c989e1f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/bfbc3a46f12942299b99cdd20c989e1f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Oct 31 12:39:44.121792 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Tenant: tempest-AttachVolumeNegativeTest-1648165012 Oct 31 12:39:44.121792 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Tenant-Id: bfbc3a46f12942299b99cdd20c989e1f Oct 31 12:39:44.121792 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1648165012 Oct 31 12:39:44.121792 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-User: tempest-AttachVolumeNegativeTest-1648165012-project Oct 31 12:39:44.121792 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-User-Domain-Id: default Oct 31 12:39:44.121792 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-User-Domain-Name: Default Oct 31 12:39:44.121792 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-User-Id: b2c03f0365ee4a26b8c076ae365325b2 Oct 31 12:39:44.121792 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-User-Name: tempest-AttachVolumeNegativeTest-1648165012-project Oct 31 12:39:44.121792 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: method: > Oct 31 12:39:44.121792 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: exception: Instance 46cae3a9-45e8-401c-b201-2ed4402e9e97 could not be found. Oct 31 12:39:44.121792 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: action_args: {'id': '46cae3a9-45e8-401c-b201-2ed4402e9e97'} Oct 31 12:39:44.122792 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 12:39:44.122792 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 12:39:44.122792 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 12:39:44.122792 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 12:39:44.122792 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 12:39:44.122792 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 12:39:44.122792 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 12:39:44.122792 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 12:39:44.122792 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 12:39:44.122792 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 12:39:44.122792 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 46cae3a9-45e8-401c-b201-2ed4402e9e97 could not be found. Oct 31 12:39:44.122792 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Oct 31 12:39:44.122792 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 12:39:44.122792 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Oct 31 12:39:44.122792 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 12:39:44.122792 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 12:39:44.122792 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 12:39:44.122792 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 12:39:44.122792 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 12:39:44.122792 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 12:39:44.124230 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 12:39:44.124230 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 31 12:39:44.124230 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 31 12:39:44.124230 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 31 12:39:44.124230 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 31 12:39:44.124230 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 12:39:44.124230 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 12:39:44.124230 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 12:39:44.124230 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 12:39:44.124230 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 46cae3a9-45e8-401c-b201-2ed4402e9e97 could not be found. Oct 31 12:39:44.124230 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Oct 31 12:39:44.124230 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 12:39:44.124230 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Oct 31 12:39:44.124230 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 12:39:44.124230 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 12:39:44.124230 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 12:39:44.124230 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 12:39:44.124230 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 12:39:44.124230 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 46cae3a9-45e8-401c-b201-2ed4402e9e97 could not be found. Oct 31 12:39:44.124230 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Oct 31 12:39:44.125435 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-8d24344a-9050-435b-8f22-e6416428a080 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Returning 404 to user: Instance 46cae3a9-45e8-401c-b201-2ed4402e9e97 could not be found. {{(pid=125440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 12:39:44.125435 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-8d24344a-9050-435b-8f22-e6416428a080 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] 10.222.0.15 "DELETE /compute/v2.1/servers/46cae3a9-45e8-401c-b201-2ed4402e9e97" status: 404 len: 111 microversion: 2.1 time: 0.044828 Oct 31 12:39:44.125898 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 478/946] 10.222.0.15 () {58 vars in 1239 bytes} [Mon Oct 31 12:39:44 2022] DELETE /compute/v2.1/servers/46cae3a9-45e8-401c-b201-2ed4402e9e97 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 12:39:44.136878 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-3314ad57-cbb8-41bf-aa63-c4d5c497e587 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:39:44.137713 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-3314ad57-cbb8-41bf-aa63-c4d5c497e587 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] [instance: 46cae3a9-45e8-401c-b201-2ed4402e9e97] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:39:44.144773 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-3314ad57-cbb8-41bf-aa63-c4d5c497e587 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:44.145336 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-3314ad57-cbb8-41bf-aa63-c4d5c497e587 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:44.146049 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-3314ad57-cbb8-41bf-aa63-c4d5c497e587 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:44.146951 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-3314ad57-cbb8-41bf-aa63-c4d5c497e587 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:44.147905 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-3314ad57-cbb8-41bf-aa63-c4d5c497e587 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:44.148539 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-3314ad57-cbb8-41bf-aa63-c4d5c497e587 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:44.173181 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.wsgi [None req-3314ad57-cbb8-41bf-aa63-c4d5c497e587 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] HTTP exception thrown: Instance 46cae3a9-45e8-401c-b201-2ed4402e9e97 could not be found. Oct 31 12:39:44.175310 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-3314ad57-cbb8-41bf-aa63-c4d5c497e587 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Request method failure captured: Oct 31 12:39:44.175310 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: request: GET /compute/v2.1/servers/46cae3a9-45e8-401c-b201-2ed4402e9e97 HTTP/1.1 Oct 31 12:39:44.175310 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: Accept: application/json Oct 31 12:39:44.175310 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: Accept-Encoding: identity Oct 31 12:39:44.175310 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: Connection: close Oct 31 12:39:44.175310 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: Content-Length: 0 Oct 31 12:39:44.175310 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: Content-Type: application/json Oct 31 12:39:44.175310 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: Host: 10.222.0.15 Oct 31 12:39:44.175310 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: Openstack-System-Scope: None Oct 31 12:39:44.175310 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: User-Agent: python-urllib3/1.26.12 Oct 31 12:39:44.175310 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Auth-Token: gAAAAABjX8B3Et2KM1ogPCTGs64pc6xLyfMw6yL0VTQe6oSz3vb_t3Nol1y36tJUXD6PegbQ8pwIEwo4L666w1x-Z79gwUGFQzXyfvvOjyyVZQL72gtR1ISe3h09afCWKpljHfxhI1Y-A2JuAkXEjCcgQXdDq6Gsj4TA71_GeBFeeItX_0KrPQA Oct 31 12:39:44.175310 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Domain-Id: None Oct 31 12:39:44.175310 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Domain-Name: None Oct 31 12:39:44.175310 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Identity-Status: Confirmed Oct 31 12:39:44.175310 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Is-Admin-Project: True Oct 31 12:39:44.175310 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Project-Domain-Id: default Oct 31 12:39:44.175310 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Project-Domain-Name: Default Oct 31 12:39:44.175310 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Project-Id: bfbc3a46f12942299b99cdd20c989e1f Oct 31 12:39:44.175310 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Project-Name: tempest-AttachVolumeNegativeTest-1648165012 Oct 31 12:39:44.175310 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Role: reader,member Oct 31 12:39:44.175310 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Roles: reader,member Oct 31 12:39:44.176604 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/bfbc3a46f12942299b99cdd20c989e1f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_bfbc3a46f12942299b99cdd20c989e1f", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/bfbc3a46f12942299b99cdd20c989e1f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/bfbc3a46f12942299b99cdd20c989e1f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Oct 31 12:39:44.176604 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Tenant: tempest-AttachVolumeNegativeTest-1648165012 Oct 31 12:39:44.176604 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Tenant-Id: bfbc3a46f12942299b99cdd20c989e1f Oct 31 12:39:44.176604 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1648165012 Oct 31 12:39:44.176604 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-User: tempest-AttachVolumeNegativeTest-1648165012-project Oct 31 12:39:44.176604 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-User-Domain-Id: default Oct 31 12:39:44.176604 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-User-Domain-Name: Default Oct 31 12:39:44.176604 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-User-Id: b2c03f0365ee4a26b8c076ae365325b2 Oct 31 12:39:44.176604 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-User-Name: tempest-AttachVolumeNegativeTest-1648165012-project Oct 31 12:39:44.176604 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: method: > Oct 31 12:39:44.176604 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: exception: Instance 46cae3a9-45e8-401c-b201-2ed4402e9e97 could not be found. Oct 31 12:39:44.176604 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: action_args: {'id': '46cae3a9-45e8-401c-b201-2ed4402e9e97'} Oct 31 12:39:44.177483 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 12:39:44.177483 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 12:39:44.177483 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 12:39:44.177483 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 12:39:44.177483 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 12:39:44.177483 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 12:39:44.177483 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 12:39:44.177483 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 12:39:44.177483 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 12:39:44.177483 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 12:39:44.177483 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 46cae3a9-45e8-401c-b201-2ed4402e9e97 could not be found. Oct 31 12:39:44.177483 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Oct 31 12:39:44.177483 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 12:39:44.177483 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Oct 31 12:39:44.177483 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 12:39:44.177483 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 12:39:44.177483 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 12:39:44.177483 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 12:39:44.177483 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 12:39:44.177483 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 12:39:44.178700 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 12:39:44.178700 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 12:39:44.178700 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 12:39:44.178700 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 12:39:44.178700 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 12:39:44.178700 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 12:39:44.178700 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 12:39:44.178700 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 46cae3a9-45e8-401c-b201-2ed4402e9e97 could not be found. Oct 31 12:39:44.178700 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Oct 31 12:39:44.178700 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 12:39:44.178700 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Oct 31 12:39:44.178700 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 12:39:44.178700 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 12:39:44.178700 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 12:39:44.178700 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 12:39:44.178700 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 12:39:44.178700 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 46cae3a9-45e8-401c-b201-2ed4402e9e97 could not be found. Oct 31 12:39:44.178700 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Oct 31 12:39:44.181093 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-3314ad57-cbb8-41bf-aa63-c4d5c497e587 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Returning 404 to user: Instance 46cae3a9-45e8-401c-b201-2ed4402e9e97 could not be found. {{(pid=125441) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 12:39:44.181858 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-3314ad57-cbb8-41bf-aa63-c4d5c497e587 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] 10.222.0.15 "GET /compute/v2.1/servers/46cae3a9-45e8-401c-b201-2ed4402e9e97" status: 404 len: 111 microversion: 2.1 time: 0.050042 Oct 31 12:39:44.182372 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 469/947] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:39:44 2022] GET /compute/v2.1/servers/46cae3a9-45e8-401c-b201-2ed4402e9e97 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 12:39:44.192117 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-7f5f9bbe-70e0-4a8c-9806-0db9ac5f5078 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:39:44.193199 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-7f5f9bbe-70e0-4a8c-9806-0db9ac5f5078 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] [instance: d1bb54dd-d9ba-4789-b2a0-c91a292cb466] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:39:44.200930 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-7f5f9bbe-70e0-4a8c-9806-0db9ac5f5078 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:44.201301 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-7f5f9bbe-70e0-4a8c-9806-0db9ac5f5078 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:44.202070 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-7f5f9bbe-70e0-4a8c-9806-0db9ac5f5078 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:44.203348 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-7f5f9bbe-70e0-4a8c-9806-0db9ac5f5078 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:44.203776 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-7f5f9bbe-70e0-4a8c-9806-0db9ac5f5078 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:44.204484 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-7f5f9bbe-70e0-4a8c-9806-0db9ac5f5078 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:44.224334 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.wsgi [None req-7f5f9bbe-70e0-4a8c-9806-0db9ac5f5078 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] HTTP exception thrown: Instance d1bb54dd-d9ba-4789-b2a0-c91a292cb466 could not be found. Oct 31 12:39:44.226202 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-7f5f9bbe-70e0-4a8c-9806-0db9ac5f5078 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Request method failure captured: Oct 31 12:39:44.226202 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: request: DELETE /compute/v2.1/servers/d1bb54dd-d9ba-4789-b2a0-c91a292cb466 HTTP/1.1 Oct 31 12:39:44.226202 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: Accept: application/json Oct 31 12:39:44.226202 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: Accept-Encoding: identity Oct 31 12:39:44.226202 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: Connection: close Oct 31 12:39:44.226202 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: Content-Length: 0 Oct 31 12:39:44.226202 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: Content-Type: application/json Oct 31 12:39:44.226202 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: Host: 10.222.0.15 Oct 31 12:39:44.226202 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: Openstack-System-Scope: None Oct 31 12:39:44.226202 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: User-Agent: python-urllib3/1.26.12 Oct 31 12:39:44.226202 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Auth-Token: gAAAAABjX8B3Et2KM1ogPCTGs64pc6xLyfMw6yL0VTQe6oSz3vb_t3Nol1y36tJUXD6PegbQ8pwIEwo4L666w1x-Z79gwUGFQzXyfvvOjyyVZQL72gtR1ISe3h09afCWKpljHfxhI1Y-A2JuAkXEjCcgQXdDq6Gsj4TA71_GeBFeeItX_0KrPQA Oct 31 12:39:44.226202 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Domain-Id: None Oct 31 12:39:44.226202 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Domain-Name: None Oct 31 12:39:44.226202 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Identity-Status: Confirmed Oct 31 12:39:44.226202 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Is-Admin-Project: True Oct 31 12:39:44.226202 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Project-Domain-Id: default Oct 31 12:39:44.226202 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Project-Domain-Name: Default Oct 31 12:39:44.226202 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Project-Id: bfbc3a46f12942299b99cdd20c989e1f Oct 31 12:39:44.226202 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Project-Name: tempest-AttachVolumeNegativeTest-1648165012 Oct 31 12:39:44.226202 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Role: reader,member Oct 31 12:39:44.226202 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Roles: reader,member Oct 31 12:39:44.227791 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/bfbc3a46f12942299b99cdd20c989e1f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_bfbc3a46f12942299b99cdd20c989e1f", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/bfbc3a46f12942299b99cdd20c989e1f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/bfbc3a46f12942299b99cdd20c989e1f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Oct 31 12:39:44.227791 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Tenant: tempest-AttachVolumeNegativeTest-1648165012 Oct 31 12:39:44.227791 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Tenant-Id: bfbc3a46f12942299b99cdd20c989e1f Oct 31 12:39:44.227791 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1648165012 Oct 31 12:39:44.227791 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-User: tempest-AttachVolumeNegativeTest-1648165012-project Oct 31 12:39:44.227791 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-User-Domain-Id: default Oct 31 12:39:44.227791 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-User-Domain-Name: Default Oct 31 12:39:44.227791 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-User-Id: b2c03f0365ee4a26b8c076ae365325b2 Oct 31 12:39:44.227791 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-User-Name: tempest-AttachVolumeNegativeTest-1648165012-project Oct 31 12:39:44.227791 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: method: > Oct 31 12:39:44.227791 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: exception: Instance d1bb54dd-d9ba-4789-b2a0-c91a292cb466 could not be found. Oct 31 12:39:44.227791 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: action_args: {'id': 'd1bb54dd-d9ba-4789-b2a0-c91a292cb466'} Oct 31 12:39:44.229056 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 12:39:44.229056 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 12:39:44.229056 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 12:39:44.229056 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 12:39:44.229056 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 12:39:44.229056 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 12:39:44.229056 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 12:39:44.229056 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 12:39:44.229056 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 12:39:44.229056 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 12:39:44.229056 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d1bb54dd-d9ba-4789-b2a0-c91a292cb466 could not be found. Oct 31 12:39:44.229056 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Oct 31 12:39:44.229056 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 12:39:44.229056 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Oct 31 12:39:44.229056 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 12:39:44.229056 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 12:39:44.229056 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 12:39:44.229056 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 12:39:44.229056 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 12:39:44.229056 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 12:39:44.230328 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 12:39:44.230328 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 31 12:39:44.230328 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 31 12:39:44.230328 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 31 12:39:44.230328 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 31 12:39:44.230328 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 12:39:44.230328 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 12:39:44.230328 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 12:39:44.230328 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 12:39:44.230328 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d1bb54dd-d9ba-4789-b2a0-c91a292cb466 could not be found. Oct 31 12:39:44.230328 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Oct 31 12:39:44.230328 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 12:39:44.230328 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Oct 31 12:39:44.230328 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 12:39:44.230328 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 12:39:44.230328 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 12:39:44.230328 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 12:39:44.230328 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 12:39:44.230328 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d1bb54dd-d9ba-4789-b2a0-c91a292cb466 could not be found. Oct 31 12:39:44.230328 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Oct 31 12:39:44.233671 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-7f5f9bbe-70e0-4a8c-9806-0db9ac5f5078 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Returning 404 to user: Instance d1bb54dd-d9ba-4789-b2a0-c91a292cb466 could not be found. {{(pid=125440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 12:39:44.234589 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-7f5f9bbe-70e0-4a8c-9806-0db9ac5f5078 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] 10.222.0.15 "DELETE /compute/v2.1/servers/d1bb54dd-d9ba-4789-b2a0-c91a292cb466" status: 404 len: 111 microversion: 2.1 time: 0.047890 Oct 31 12:39:44.235465 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 479/948] 10.222.0.15 () {58 vars in 1239 bytes} [Mon Oct 31 12:39:44 2022] DELETE /compute/v2.1/servers/d1bb54dd-d9ba-4789-b2a0-c91a292cb466 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 12:39:44.246138 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-adc15866-c3d5-406a-91d1-e8640d1e3f83 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:39:44.247723 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-adc15866-c3d5-406a-91d1-e8640d1e3f83 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] [instance: d1bb54dd-d9ba-4789-b2a0-c91a292cb466] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:39:44.256054 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-adc15866-c3d5-406a-91d1-e8640d1e3f83 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:44.256545 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-adc15866-c3d5-406a-91d1-e8640d1e3f83 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:44.257278 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-adc15866-c3d5-406a-91d1-e8640d1e3f83 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:44.257985 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-adc15866-c3d5-406a-91d1-e8640d1e3f83 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:44.258440 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-adc15866-c3d5-406a-91d1-e8640d1e3f83 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:44.258915 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-adc15866-c3d5-406a-91d1-e8640d1e3f83 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:44.279759 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.wsgi [None req-adc15866-c3d5-406a-91d1-e8640d1e3f83 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] HTTP exception thrown: Instance d1bb54dd-d9ba-4789-b2a0-c91a292cb466 could not be found. Oct 31 12:39:44.281292 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-adc15866-c3d5-406a-91d1-e8640d1e3f83 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Request method failure captured: Oct 31 12:39:44.281292 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: request: GET /compute/v2.1/servers/d1bb54dd-d9ba-4789-b2a0-c91a292cb466 HTTP/1.1 Oct 31 12:39:44.281292 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: Accept: application/json Oct 31 12:39:44.281292 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: Accept-Encoding: identity Oct 31 12:39:44.281292 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: Connection: close Oct 31 12:39:44.281292 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: Content-Length: 0 Oct 31 12:39:44.281292 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: Content-Type: application/json Oct 31 12:39:44.281292 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: Host: 10.222.0.15 Oct 31 12:39:44.281292 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: Openstack-System-Scope: None Oct 31 12:39:44.281292 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: User-Agent: python-urllib3/1.26.12 Oct 31 12:39:44.281292 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Auth-Token: gAAAAABjX8B3Et2KM1ogPCTGs64pc6xLyfMw6yL0VTQe6oSz3vb_t3Nol1y36tJUXD6PegbQ8pwIEwo4L666w1x-Z79gwUGFQzXyfvvOjyyVZQL72gtR1ISe3h09afCWKpljHfxhI1Y-A2JuAkXEjCcgQXdDq6Gsj4TA71_GeBFeeItX_0KrPQA Oct 31 12:39:44.281292 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Domain-Id: None Oct 31 12:39:44.281292 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Domain-Name: None Oct 31 12:39:44.281292 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Identity-Status: Confirmed Oct 31 12:39:44.281292 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Is-Admin-Project: True Oct 31 12:39:44.281292 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Project-Domain-Id: default Oct 31 12:39:44.281292 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Project-Domain-Name: Default Oct 31 12:39:44.281292 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Project-Id: bfbc3a46f12942299b99cdd20c989e1f Oct 31 12:39:44.281292 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Project-Name: tempest-AttachVolumeNegativeTest-1648165012 Oct 31 12:39:44.281292 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Role: reader,member Oct 31 12:39:44.281292 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Roles: reader,member Oct 31 12:39:44.282617 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/bfbc3a46f12942299b99cdd20c989e1f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_bfbc3a46f12942299b99cdd20c989e1f", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/bfbc3a46f12942299b99cdd20c989e1f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/bfbc3a46f12942299b99cdd20c989e1f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Oct 31 12:39:44.282617 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Tenant: tempest-AttachVolumeNegativeTest-1648165012 Oct 31 12:39:44.282617 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Tenant-Id: bfbc3a46f12942299b99cdd20c989e1f Oct 31 12:39:44.282617 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1648165012 Oct 31 12:39:44.282617 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-User: tempest-AttachVolumeNegativeTest-1648165012-project Oct 31 12:39:44.282617 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-User-Domain-Id: default Oct 31 12:39:44.282617 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-User-Domain-Name: Default Oct 31 12:39:44.282617 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-User-Id: b2c03f0365ee4a26b8c076ae365325b2 Oct 31 12:39:44.282617 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-User-Name: tempest-AttachVolumeNegativeTest-1648165012-project Oct 31 12:39:44.282617 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: method: > Oct 31 12:39:44.282617 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: exception: Instance d1bb54dd-d9ba-4789-b2a0-c91a292cb466 could not be found. Oct 31 12:39:44.282617 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: action_args: {'id': 'd1bb54dd-d9ba-4789-b2a0-c91a292cb466'} Oct 31 12:39:44.283384 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 12:39:44.283384 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 12:39:44.283384 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 12:39:44.283384 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 12:39:44.283384 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 12:39:44.283384 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 12:39:44.283384 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 12:39:44.283384 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 12:39:44.283384 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 12:39:44.283384 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 12:39:44.283384 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d1bb54dd-d9ba-4789-b2a0-c91a292cb466 could not be found. Oct 31 12:39:44.283384 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Oct 31 12:39:44.283384 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 12:39:44.283384 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Oct 31 12:39:44.283384 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 12:39:44.283384 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 12:39:44.283384 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 12:39:44.283384 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 12:39:44.283384 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 12:39:44.283384 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 12:39:44.284557 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 12:39:44.284557 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 12:39:44.284557 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 12:39:44.284557 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 12:39:44.284557 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 12:39:44.284557 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 12:39:44.284557 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 12:39:44.284557 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d1bb54dd-d9ba-4789-b2a0-c91a292cb466 could not be found. Oct 31 12:39:44.284557 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Oct 31 12:39:44.284557 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 12:39:44.284557 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Oct 31 12:39:44.284557 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 12:39:44.284557 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 12:39:44.284557 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 12:39:44.284557 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 12:39:44.284557 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 12:39:44.284557 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d1bb54dd-d9ba-4789-b2a0-c91a292cb466 could not be found. Oct 31 12:39:44.284557 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Oct 31 12:39:44.286611 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-adc15866-c3d5-406a-91d1-e8640d1e3f83 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Returning 404 to user: Instance d1bb54dd-d9ba-4789-b2a0-c91a292cb466 could not be found. {{(pid=125441) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 12:39:44.287838 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-adc15866-c3d5-406a-91d1-e8640d1e3f83 tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] 10.222.0.15 "GET /compute/v2.1/servers/d1bb54dd-d9ba-4789-b2a0-c91a292cb466" status: 404 len: 111 microversion: 2.1 time: 0.048539 Oct 31 12:39:44.288542 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 470/949] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:39:44 2022] GET /compute/v2.1/servers/d1bb54dd-d9ba-4789-b2a0-c91a292cb466 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 31 12:39:45.315583 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-2a99e4fc-6f6c-4d55-8d71-81d3c8f52d21 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:39:45.316180 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-2a99e4fc-6f6c-4d55-8d71-81d3c8f52d21 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] [instance: 96065a23-4a5f-4ffb-8b48-746d2dc2c301] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:39:45.323711 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-2a99e4fc-6f6c-4d55-8d71-81d3c8f52d21 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:45.324197 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-2a99e4fc-6f6c-4d55-8d71-81d3c8f52d21 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:45.324628 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-2a99e4fc-6f6c-4d55-8d71-81d3c8f52d21 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:45.325348 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-2a99e4fc-6f6c-4d55-8d71-81d3c8f52d21 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:45.325798 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-2a99e4fc-6f6c-4d55-8d71-81d3c8f52d21 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:45.326222 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-2a99e4fc-6f6c-4d55-8d71-81d3c8f52d21 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:45.341677 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.wsgi [None req-2a99e4fc-6f6c-4d55-8d71-81d3c8f52d21 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] HTTP exception thrown: Instance 96065a23-4a5f-4ffb-8b48-746d2dc2c301 could not be found. Oct 31 12:39:45.343278 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-2a99e4fc-6f6c-4d55-8d71-81d3c8f52d21 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Request method failure captured: Oct 31 12:39:45.343278 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: request: DELETE /compute/v2.1/servers/96065a23-4a5f-4ffb-8b48-746d2dc2c301 HTTP/1.1 Oct 31 12:39:45.343278 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: Accept: application/json Oct 31 12:39:45.343278 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: Accept-Encoding: identity Oct 31 12:39:45.343278 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: Connection: close Oct 31 12:39:45.343278 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: Content-Length: 0 Oct 31 12:39:45.343278 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: Content-Type: application/json Oct 31 12:39:45.343278 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: Host: 10.222.0.15 Oct 31 12:39:45.343278 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: Openstack-System-Scope: None Oct 31 12:39:45.343278 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: User-Agent: python-urllib3/1.26.12 Oct 31 12:39:45.343278 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Auth-Token: gAAAAABjX8B2m1m9MuKBHO0SxDm7arupmshYlZMAAEgJbORjur4Qe9OXcQVHKBx6k7T788otdlxtGddMg-xkFyl2KDcVhkjBWCqqwl5KGIfG6sLllN0xH9I_wHEXqxzSWixQ1A2CE1FBbOiKiTEJ4kGxgYMjSo6WKiJZiEFxLVgKkbpX9vSJpEU Oct 31 12:39:45.343278 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Domain-Id: None Oct 31 12:39:45.343278 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Domain-Name: None Oct 31 12:39:45.343278 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Identity-Status: Confirmed Oct 31 12:39:45.343278 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Is-Admin-Project: True Oct 31 12:39:45.343278 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Project-Domain-Id: default Oct 31 12:39:45.343278 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Project-Domain-Name: Default Oct 31 12:39:45.343278 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Project-Id: b9a2bf9a5a484523a700e4e6c568d4de Oct 31 12:39:45.343278 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Project-Name: tempest-AttachVolumeTestJSON-447861972 Oct 31 12:39:45.343278 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Role: reader,member Oct 31 12:39:45.343278 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Roles: reader,member Oct 31 12:39:45.344848 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/b9a2bf9a5a484523a700e4e6c568d4de"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_b9a2bf9a5a484523a700e4e6c568d4de", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/b9a2bf9a5a484523a700e4e6c568d4de"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/b9a2bf9a5a484523a700e4e6c568d4de"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Oct 31 12:39:45.344848 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Tenant: tempest-AttachVolumeTestJSON-447861972 Oct 31 12:39:45.344848 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Tenant-Id: b9a2bf9a5a484523a700e4e6c568d4de Oct 31 12:39:45.344848 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Tenant-Name: tempest-AttachVolumeTestJSON-447861972 Oct 31 12:39:45.344848 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-User: tempest-AttachVolumeTestJSON-447861972-project Oct 31 12:39:45.344848 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-User-Domain-Id: default Oct 31 12:39:45.344848 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-User-Domain-Name: Default Oct 31 12:39:45.344848 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-User-Id: d6c1beb321e44908ab987b17f7b74484 Oct 31 12:39:45.344848 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-User-Name: tempest-AttachVolumeTestJSON-447861972-project Oct 31 12:39:45.344848 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: method: > Oct 31 12:39:45.344848 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: exception: Instance 96065a23-4a5f-4ffb-8b48-746d2dc2c301 could not be found. Oct 31 12:39:45.344848 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: action_args: {'id': '96065a23-4a5f-4ffb-8b48-746d2dc2c301'} Oct 31 12:39:45.345677 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 12:39:45.345677 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 12:39:45.345677 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 12:39:45.345677 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 12:39:45.345677 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 12:39:45.345677 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 12:39:45.345677 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 12:39:45.345677 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 12:39:45.345677 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 12:39:45.345677 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 12:39:45.345677 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 96065a23-4a5f-4ffb-8b48-746d2dc2c301 could not be found. Oct 31 12:39:45.345677 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Oct 31 12:39:45.345677 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 12:39:45.345677 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Oct 31 12:39:45.345677 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 12:39:45.345677 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 12:39:45.345677 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 12:39:45.345677 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 12:39:45.345677 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 12:39:45.345677 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 12:39:45.346834 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 12:39:45.346834 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 31 12:39:45.346834 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 31 12:39:45.346834 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 31 12:39:45.346834 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 31 12:39:45.346834 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 12:39:45.346834 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 12:39:45.346834 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 12:39:45.346834 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 12:39:45.346834 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 96065a23-4a5f-4ffb-8b48-746d2dc2c301 could not be found. Oct 31 12:39:45.346834 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Oct 31 12:39:45.346834 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 12:39:45.346834 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Oct 31 12:39:45.346834 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 12:39:45.346834 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 12:39:45.346834 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 12:39:45.346834 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 12:39:45.346834 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 12:39:45.346834 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 96065a23-4a5f-4ffb-8b48-746d2dc2c301 could not be found. Oct 31 12:39:45.346834 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Oct 31 12:39:45.348052 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-2a99e4fc-6f6c-4d55-8d71-81d3c8f52d21 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Returning 404 to user: Instance 96065a23-4a5f-4ffb-8b48-746d2dc2c301 could not be found. {{(pid=125440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 12:39:45.348052 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-2a99e4fc-6f6c-4d55-8d71-81d3c8f52d21 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] 10.222.0.15 "DELETE /compute/v2.1/servers/96065a23-4a5f-4ffb-8b48-746d2dc2c301" status: 404 len: 111 microversion: 2.1 time: 0.033006 Oct 31 12:39:45.348052 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 480/950] 10.222.0.15 () {58 vars in 1239 bytes} [Mon Oct 31 12:39:45 2022] DELETE /compute/v2.1/servers/96065a23-4a5f-4ffb-8b48-746d2dc2c301 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 12:39:45.353390 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-4fb513d1-864d-4d5b-a75d-183d2a2760f6 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:39:45.354124 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-4fb513d1-864d-4d5b-a75d-183d2a2760f6 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] [instance: 96065a23-4a5f-4ffb-8b48-746d2dc2c301] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:39:45.361007 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-4fb513d1-864d-4d5b-a75d-183d2a2760f6 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:45.361493 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-4fb513d1-864d-4d5b-a75d-183d2a2760f6 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:45.361926 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-4fb513d1-864d-4d5b-a75d-183d2a2760f6 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:45.362630 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-4fb513d1-864d-4d5b-a75d-183d2a2760f6 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:45.363081 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-4fb513d1-864d-4d5b-a75d-183d2a2760f6 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:45.363605 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-4fb513d1-864d-4d5b-a75d-183d2a2760f6 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:45.378706 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.wsgi [None req-4fb513d1-864d-4d5b-a75d-183d2a2760f6 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] HTTP exception thrown: Instance 96065a23-4a5f-4ffb-8b48-746d2dc2c301 could not be found. Oct 31 12:39:45.380305 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-4fb513d1-864d-4d5b-a75d-183d2a2760f6 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Request method failure captured: Oct 31 12:39:45.380305 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: request: GET /compute/v2.1/servers/96065a23-4a5f-4ffb-8b48-746d2dc2c301 HTTP/1.1 Oct 31 12:39:45.380305 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: Accept: application/json Oct 31 12:39:45.380305 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: Accept-Encoding: identity Oct 31 12:39:45.380305 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: Connection: close Oct 31 12:39:45.380305 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: Content-Length: 0 Oct 31 12:39:45.380305 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: Content-Type: application/json Oct 31 12:39:45.380305 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: Host: 10.222.0.15 Oct 31 12:39:45.380305 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: Openstack-System-Scope: None Oct 31 12:39:45.380305 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: User-Agent: python-urllib3/1.26.12 Oct 31 12:39:45.380305 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Auth-Token: gAAAAABjX8B2m1m9MuKBHO0SxDm7arupmshYlZMAAEgJbORjur4Qe9OXcQVHKBx6k7T788otdlxtGddMg-xkFyl2KDcVhkjBWCqqwl5KGIfG6sLllN0xH9I_wHEXqxzSWixQ1A2CE1FBbOiKiTEJ4kGxgYMjSo6WKiJZiEFxLVgKkbpX9vSJpEU Oct 31 12:39:45.380305 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Domain-Id: None Oct 31 12:39:45.380305 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Domain-Name: None Oct 31 12:39:45.380305 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Identity-Status: Confirmed Oct 31 12:39:45.380305 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Is-Admin-Project: True Oct 31 12:39:45.380305 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Project-Domain-Id: default Oct 31 12:39:45.380305 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Project-Domain-Name: Default Oct 31 12:39:45.380305 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Project-Id: b9a2bf9a5a484523a700e4e6c568d4de Oct 31 12:39:45.380305 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Project-Name: tempest-AttachVolumeTestJSON-447861972 Oct 31 12:39:45.380305 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Role: reader,member Oct 31 12:39:45.380305 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Roles: reader,member Oct 31 12:39:45.381759 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/b9a2bf9a5a484523a700e4e6c568d4de"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_b9a2bf9a5a484523a700e4e6c568d4de", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/b9a2bf9a5a484523a700e4e6c568d4de"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/b9a2bf9a5a484523a700e4e6c568d4de"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Oct 31 12:39:45.381759 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Tenant: tempest-AttachVolumeTestJSON-447861972 Oct 31 12:39:45.381759 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Tenant-Id: b9a2bf9a5a484523a700e4e6c568d4de Oct 31 12:39:45.381759 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Tenant-Name: tempest-AttachVolumeTestJSON-447861972 Oct 31 12:39:45.381759 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-User: tempest-AttachVolumeTestJSON-447861972-project Oct 31 12:39:45.381759 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-User-Domain-Id: default Oct 31 12:39:45.381759 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-User-Domain-Name: Default Oct 31 12:39:45.381759 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-User-Id: d6c1beb321e44908ab987b17f7b74484 Oct 31 12:39:45.381759 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-User-Name: tempest-AttachVolumeTestJSON-447861972-project Oct 31 12:39:45.381759 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: method: > Oct 31 12:39:45.381759 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: exception: Instance 96065a23-4a5f-4ffb-8b48-746d2dc2c301 could not be found. Oct 31 12:39:45.381759 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: action_args: {'id': '96065a23-4a5f-4ffb-8b48-746d2dc2c301'} Oct 31 12:39:45.382547 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 12:39:45.382547 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 12:39:45.382547 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 12:39:45.382547 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 12:39:45.382547 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 12:39:45.382547 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 12:39:45.382547 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 12:39:45.382547 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 12:39:45.382547 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 12:39:45.382547 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 12:39:45.382547 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 96065a23-4a5f-4ffb-8b48-746d2dc2c301 could not be found. Oct 31 12:39:45.382547 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Oct 31 12:39:45.382547 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 12:39:45.382547 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Oct 31 12:39:45.382547 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 12:39:45.382547 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 12:39:45.382547 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 12:39:45.382547 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 12:39:45.382547 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 12:39:45.382547 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 12:39:45.383833 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 12:39:45.383833 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 12:39:45.383833 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 12:39:45.383833 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 12:39:45.383833 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 12:39:45.383833 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 12:39:45.383833 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 12:39:45.383833 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 96065a23-4a5f-4ffb-8b48-746d2dc2c301 could not be found. Oct 31 12:39:45.383833 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Oct 31 12:39:45.383833 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 12:39:45.383833 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Oct 31 12:39:45.383833 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 12:39:45.383833 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 12:39:45.383833 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 12:39:45.383833 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 12:39:45.383833 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 12:39:45.383833 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 96065a23-4a5f-4ffb-8b48-746d2dc2c301 could not be found. Oct 31 12:39:45.383833 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Oct 31 12:39:45.386255 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-4fb513d1-864d-4d5b-a75d-183d2a2760f6 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Returning 404 to user: Instance 96065a23-4a5f-4ffb-8b48-746d2dc2c301 could not be found. {{(pid=125441) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 12:39:45.386255 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-4fb513d1-864d-4d5b-a75d-183d2a2760f6 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] 10.222.0.15 "GET /compute/v2.1/servers/96065a23-4a5f-4ffb-8b48-746d2dc2c301" status: 404 len: 111 microversion: 2.1 time: 0.032193 Oct 31 12:39:45.386255 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 471/951] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:39:45 2022] GET /compute/v2.1/servers/96065a23-4a5f-4ffb-8b48-746d2dc2c301 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 12:39:45.449569 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-8796acbd-5597-444f-bf7b-40b9aa85265f tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:39:45.450056 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-8796acbd-5597-444f-bf7b-40b9aa85265f tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] [instance: 9906becc-a42b-4b4c-855a-450915f7a3f8] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:39:45.456039 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-8796acbd-5597-444f-bf7b-40b9aa85265f tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:45.456511 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-8796acbd-5597-444f-bf7b-40b9aa85265f tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:45.456987 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-8796acbd-5597-444f-bf7b-40b9aa85265f tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:45.457674 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-8796acbd-5597-444f-bf7b-40b9aa85265f tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:45.458110 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-8796acbd-5597-444f-bf7b-40b9aa85265f tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:45.458715 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-8796acbd-5597-444f-bf7b-40b9aa85265f tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:45.473236 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.wsgi [None req-8796acbd-5597-444f-bf7b-40b9aa85265f tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] HTTP exception thrown: Instance 9906becc-a42b-4b4c-855a-450915f7a3f8 could not be found. Oct 31 12:39:45.475541 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-8796acbd-5597-444f-bf7b-40b9aa85265f tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Request method failure captured: Oct 31 12:39:45.475541 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: request: DELETE /compute/v2.1/servers/9906becc-a42b-4b4c-855a-450915f7a3f8 HTTP/1.1 Oct 31 12:39:45.475541 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: Accept: application/json Oct 31 12:39:45.475541 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: Accept-Encoding: identity Oct 31 12:39:45.475541 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: Connection: close Oct 31 12:39:45.475541 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: Content-Length: 0 Oct 31 12:39:45.475541 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: Content-Type: application/json Oct 31 12:39:45.475541 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: Host: 10.222.0.15 Oct 31 12:39:45.475541 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: Openstack-System-Scope: None Oct 31 12:39:45.475541 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: User-Agent: python-urllib3/1.26.12 Oct 31 12:39:45.475541 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Auth-Token: gAAAAABjX8B3Et2KM1ogPCTGs64pc6xLyfMw6yL0VTQe6oSz3vb_t3Nol1y36tJUXD6PegbQ8pwIEwo4L666w1x-Z79gwUGFQzXyfvvOjyyVZQL72gtR1ISe3h09afCWKpljHfxhI1Y-A2JuAkXEjCcgQXdDq6Gsj4TA71_GeBFeeItX_0KrPQA Oct 31 12:39:45.475541 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Domain-Id: None Oct 31 12:39:45.475541 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Domain-Name: None Oct 31 12:39:45.475541 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Identity-Status: Confirmed Oct 31 12:39:45.475541 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Is-Admin-Project: True Oct 31 12:39:45.475541 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Project-Domain-Id: default Oct 31 12:39:45.475541 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Project-Domain-Name: Default Oct 31 12:39:45.475541 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Project-Id: bfbc3a46f12942299b99cdd20c989e1f Oct 31 12:39:45.475541 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Project-Name: tempest-AttachVolumeNegativeTest-1648165012 Oct 31 12:39:45.475541 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Role: reader,member Oct 31 12:39:45.475541 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Roles: reader,member Oct 31 12:39:45.477096 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/bfbc3a46f12942299b99cdd20c989e1f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_bfbc3a46f12942299b99cdd20c989e1f", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/bfbc3a46f12942299b99cdd20c989e1f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/bfbc3a46f12942299b99cdd20c989e1f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Oct 31 12:39:45.477096 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Tenant: tempest-AttachVolumeNegativeTest-1648165012 Oct 31 12:39:45.477096 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Tenant-Id: bfbc3a46f12942299b99cdd20c989e1f Oct 31 12:39:45.477096 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1648165012 Oct 31 12:39:45.477096 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-User: tempest-AttachVolumeNegativeTest-1648165012-project Oct 31 12:39:45.477096 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-User-Domain-Id: default Oct 31 12:39:45.477096 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-User-Domain-Name: Default Oct 31 12:39:45.477096 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-User-Id: b2c03f0365ee4a26b8c076ae365325b2 Oct 31 12:39:45.477096 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-User-Name: tempest-AttachVolumeNegativeTest-1648165012-project Oct 31 12:39:45.477096 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: method: > Oct 31 12:39:45.477096 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: exception: Instance 9906becc-a42b-4b4c-855a-450915f7a3f8 could not be found. Oct 31 12:39:45.477096 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: action_args: {'id': '9906becc-a42b-4b4c-855a-450915f7a3f8'} Oct 31 12:39:45.477994 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 12:39:45.477994 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 12:39:45.477994 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 12:39:45.477994 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 12:39:45.477994 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 12:39:45.477994 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 12:39:45.477994 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 12:39:45.477994 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 12:39:45.477994 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 12:39:45.477994 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 12:39:45.477994 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9906becc-a42b-4b4c-855a-450915f7a3f8 could not be found. Oct 31 12:39:45.477994 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Oct 31 12:39:45.477994 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 12:39:45.477994 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Oct 31 12:39:45.477994 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 12:39:45.477994 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 12:39:45.477994 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 12:39:45.477994 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 12:39:45.477994 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 12:39:45.477994 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 12:39:45.481080 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 12:39:45.481080 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 31 12:39:45.481080 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 31 12:39:45.481080 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 31 12:39:45.481080 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 31 12:39:45.481080 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 12:39:45.481080 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 12:39:45.481080 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 12:39:45.481080 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 12:39:45.481080 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9906becc-a42b-4b4c-855a-450915f7a3f8 could not be found. Oct 31 12:39:45.481080 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Oct 31 12:39:45.481080 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 12:39:45.481080 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Oct 31 12:39:45.481080 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 12:39:45.481080 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 12:39:45.481080 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 12:39:45.481080 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 12:39:45.481080 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 12:39:45.481080 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9906becc-a42b-4b4c-855a-450915f7a3f8 could not be found. Oct 31 12:39:45.481080 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Oct 31 12:39:45.483059 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-8796acbd-5597-444f-bf7b-40b9aa85265f tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Returning 404 to user: Instance 9906becc-a42b-4b4c-855a-450915f7a3f8 could not be found. {{(pid=125440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 12:39:45.483059 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-8796acbd-5597-444f-bf7b-40b9aa85265f tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] 10.222.0.15 "DELETE /compute/v2.1/servers/9906becc-a42b-4b4c-855a-450915f7a3f8" status: 404 len: 111 microversion: 2.1 time: 0.031630 Oct 31 12:39:45.483059 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 481/952] 10.222.0.15 () {58 vars in 1239 bytes} [Mon Oct 31 12:39:45 2022] DELETE /compute/v2.1/servers/9906becc-a42b-4b4c-855a-450915f7a3f8 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 12:39:45.486799 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-09f27296-5a40-4545-a11a-f6eb6ae69dae tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:39:45.487476 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-09f27296-5a40-4545-a11a-f6eb6ae69dae tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] [instance: 9906becc-a42b-4b4c-855a-450915f7a3f8] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:39:45.498179 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-09f27296-5a40-4545-a11a-f6eb6ae69dae tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:45.498179 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-09f27296-5a40-4545-a11a-f6eb6ae69dae tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:45.498179 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-09f27296-5a40-4545-a11a-f6eb6ae69dae tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:45.498179 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-09f27296-5a40-4545-a11a-f6eb6ae69dae tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:45.498581 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-09f27296-5a40-4545-a11a-f6eb6ae69dae tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:45.498581 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-09f27296-5a40-4545-a11a-f6eb6ae69dae tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:45.511121 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.wsgi [None req-09f27296-5a40-4545-a11a-f6eb6ae69dae tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] HTTP exception thrown: Instance 9906becc-a42b-4b4c-855a-450915f7a3f8 could not be found. Oct 31 12:39:45.512670 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-09f27296-5a40-4545-a11a-f6eb6ae69dae tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Request method failure captured: Oct 31 12:39:45.512670 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: request: GET /compute/v2.1/servers/9906becc-a42b-4b4c-855a-450915f7a3f8 HTTP/1.1 Oct 31 12:39:45.512670 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: Accept: application/json Oct 31 12:39:45.512670 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: Accept-Encoding: identity Oct 31 12:39:45.512670 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: Connection: close Oct 31 12:39:45.512670 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: Content-Length: 0 Oct 31 12:39:45.512670 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: Content-Type: application/json Oct 31 12:39:45.512670 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: Host: 10.222.0.15 Oct 31 12:39:45.512670 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: Openstack-System-Scope: None Oct 31 12:39:45.512670 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: User-Agent: python-urllib3/1.26.12 Oct 31 12:39:45.512670 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Auth-Token: gAAAAABjX8B3Et2KM1ogPCTGs64pc6xLyfMw6yL0VTQe6oSz3vb_t3Nol1y36tJUXD6PegbQ8pwIEwo4L666w1x-Z79gwUGFQzXyfvvOjyyVZQL72gtR1ISe3h09afCWKpljHfxhI1Y-A2JuAkXEjCcgQXdDq6Gsj4TA71_GeBFeeItX_0KrPQA Oct 31 12:39:45.512670 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Domain-Id: None Oct 31 12:39:45.512670 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Domain-Name: None Oct 31 12:39:45.512670 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Identity-Status: Confirmed Oct 31 12:39:45.512670 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Is-Admin-Project: True Oct 31 12:39:45.512670 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Project-Domain-Id: default Oct 31 12:39:45.512670 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Project-Domain-Name: Default Oct 31 12:39:45.512670 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Project-Id: bfbc3a46f12942299b99cdd20c989e1f Oct 31 12:39:45.512670 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Project-Name: tempest-AttachVolumeNegativeTest-1648165012 Oct 31 12:39:45.512670 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Role: reader,member Oct 31 12:39:45.512670 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Roles: reader,member Oct 31 12:39:45.515511 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/bfbc3a46f12942299b99cdd20c989e1f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_bfbc3a46f12942299b99cdd20c989e1f", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/bfbc3a46f12942299b99cdd20c989e1f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/bfbc3a46f12942299b99cdd20c989e1f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Oct 31 12:39:45.515511 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Tenant: tempest-AttachVolumeNegativeTest-1648165012 Oct 31 12:39:45.515511 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Tenant-Id: bfbc3a46f12942299b99cdd20c989e1f Oct 31 12:39:45.515511 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1648165012 Oct 31 12:39:45.515511 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-User: tempest-AttachVolumeNegativeTest-1648165012-project Oct 31 12:39:45.515511 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-User-Domain-Id: default Oct 31 12:39:45.515511 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-User-Domain-Name: Default Oct 31 12:39:45.515511 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-User-Id: b2c03f0365ee4a26b8c076ae365325b2 Oct 31 12:39:45.515511 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-User-Name: tempest-AttachVolumeNegativeTest-1648165012-project Oct 31 12:39:45.515511 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: method: > Oct 31 12:39:45.515511 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: exception: Instance 9906becc-a42b-4b4c-855a-450915f7a3f8 could not be found. Oct 31 12:39:45.515511 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: action_args: {'id': '9906becc-a42b-4b4c-855a-450915f7a3f8'} Oct 31 12:39:45.517816 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 12:39:45.517816 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 12:39:45.517816 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 12:39:45.517816 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 12:39:45.517816 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 12:39:45.517816 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 12:39:45.517816 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 12:39:45.517816 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 12:39:45.517816 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 12:39:45.517816 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 12:39:45.517816 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9906becc-a42b-4b4c-855a-450915f7a3f8 could not be found. Oct 31 12:39:45.517816 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Oct 31 12:39:45.517816 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 12:39:45.517816 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Oct 31 12:39:45.517816 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 12:39:45.517816 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 12:39:45.517816 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 12:39:45.517816 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 12:39:45.517816 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 12:39:45.517816 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 12:39:45.520586 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 12:39:45.520586 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 12:39:45.520586 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 12:39:45.520586 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 12:39:45.520586 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 12:39:45.520586 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 12:39:45.520586 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 12:39:45.520586 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9906becc-a42b-4b4c-855a-450915f7a3f8 could not be found. Oct 31 12:39:45.520586 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Oct 31 12:39:45.520586 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 12:39:45.520586 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Oct 31 12:39:45.520586 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 12:39:45.520586 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 12:39:45.520586 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 12:39:45.520586 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 12:39:45.520586 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 12:39:45.520586 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9906becc-a42b-4b4c-855a-450915f7a3f8 could not be found. Oct 31 12:39:45.520586 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Oct 31 12:39:45.521961 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-09f27296-5a40-4545-a11a-f6eb6ae69dae tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] Returning 404 to user: Instance 9906becc-a42b-4b4c-855a-450915f7a3f8 could not be found. {{(pid=125441) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 12:39:45.521961 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-09f27296-5a40-4545-a11a-f6eb6ae69dae tempest-AttachVolumeNegativeTest-1648165012 tempest-AttachVolumeNegativeTest-1648165012-project] 10.222.0.15 "GET /compute/v2.1/servers/9906becc-a42b-4b4c-855a-450915f7a3f8" status: 404 len: 111 microversion: 2.1 time: 0.032239 Oct 31 12:39:45.521961 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 472/953] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:39:45 2022] GET /compute/v2.1/servers/9906becc-a42b-4b4c-855a-450915f7a3f8 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 12:39:46.534916 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-3673eb4c-e1ff-4561-8ec5-4ed486391117 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:39:46.535504 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-3673eb4c-e1ff-4561-8ec5-4ed486391117 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] [instance: ff125cf8-e8a5-4f00-ade9-045b18ee33f4] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:39:46.542753 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-3673eb4c-e1ff-4561-8ec5-4ed486391117 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:46.543255 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-3673eb4c-e1ff-4561-8ec5-4ed486391117 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:46.543688 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-3673eb4c-e1ff-4561-8ec5-4ed486391117 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:46.544381 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-3673eb4c-e1ff-4561-8ec5-4ed486391117 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:46.544832 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-3673eb4c-e1ff-4561-8ec5-4ed486391117 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:46.545251 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-3673eb4c-e1ff-4561-8ec5-4ed486391117 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:46.563103 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.wsgi [None req-3673eb4c-e1ff-4561-8ec5-4ed486391117 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] HTTP exception thrown: Instance ff125cf8-e8a5-4f00-ade9-045b18ee33f4 could not be found. Oct 31 12:39:46.563103 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-3673eb4c-e1ff-4561-8ec5-4ed486391117 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Request method failure captured: Oct 31 12:39:46.563103 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: request: DELETE /compute/v2.1/servers/ff125cf8-e8a5-4f00-ade9-045b18ee33f4 HTTP/1.1 Oct 31 12:39:46.563103 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: Accept: application/json Oct 31 12:39:46.563103 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: Accept-Encoding: identity Oct 31 12:39:46.563103 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: Connection: close Oct 31 12:39:46.563103 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: Content-Length: 0 Oct 31 12:39:46.563103 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: Content-Type: application/json Oct 31 12:39:46.563103 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: Host: 10.222.0.15 Oct 31 12:39:46.563103 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: Openstack-System-Scope: None Oct 31 12:39:46.563103 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: User-Agent: python-urllib3/1.26.12 Oct 31 12:39:46.563103 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Auth-Token: gAAAAABjX8B2m1m9MuKBHO0SxDm7arupmshYlZMAAEgJbORjur4Qe9OXcQVHKBx6k7T788otdlxtGddMg-xkFyl2KDcVhkjBWCqqwl5KGIfG6sLllN0xH9I_wHEXqxzSWixQ1A2CE1FBbOiKiTEJ4kGxgYMjSo6WKiJZiEFxLVgKkbpX9vSJpEU Oct 31 12:39:46.563103 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Domain-Id: None Oct 31 12:39:46.563103 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Domain-Name: None Oct 31 12:39:46.563103 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Identity-Status: Confirmed Oct 31 12:39:46.563103 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Is-Admin-Project: True Oct 31 12:39:46.563103 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Project-Domain-Id: default Oct 31 12:39:46.563103 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Project-Domain-Name: Default Oct 31 12:39:46.563103 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Project-Id: b9a2bf9a5a484523a700e4e6c568d4de Oct 31 12:39:46.563103 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Project-Name: tempest-AttachVolumeTestJSON-447861972 Oct 31 12:39:46.563103 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Role: reader,member Oct 31 12:39:46.563103 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Roles: reader,member Oct 31 12:39:46.564852 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/b9a2bf9a5a484523a700e4e6c568d4de"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_b9a2bf9a5a484523a700e4e6c568d4de", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/b9a2bf9a5a484523a700e4e6c568d4de"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/b9a2bf9a5a484523a700e4e6c568d4de"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Oct 31 12:39:46.564852 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Tenant: tempest-AttachVolumeTestJSON-447861972 Oct 31 12:39:46.564852 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Tenant-Id: b9a2bf9a5a484523a700e4e6c568d4de Oct 31 12:39:46.564852 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Tenant-Name: tempest-AttachVolumeTestJSON-447861972 Oct 31 12:39:46.564852 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-User: tempest-AttachVolumeTestJSON-447861972-project Oct 31 12:39:46.564852 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-User-Domain-Id: default Oct 31 12:39:46.564852 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-User-Domain-Name: Default Oct 31 12:39:46.564852 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-User-Id: d6c1beb321e44908ab987b17f7b74484 Oct 31 12:39:46.564852 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-User-Name: tempest-AttachVolumeTestJSON-447861972-project Oct 31 12:39:46.564852 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: method: > Oct 31 12:39:46.564852 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: exception: Instance ff125cf8-e8a5-4f00-ade9-045b18ee33f4 could not be found. Oct 31 12:39:46.564852 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: action_args: {'id': 'ff125cf8-e8a5-4f00-ade9-045b18ee33f4'} Oct 31 12:39:46.565800 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 12:39:46.565800 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 12:39:46.565800 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 12:39:46.565800 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 12:39:46.565800 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 12:39:46.565800 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 12:39:46.565800 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 12:39:46.565800 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 12:39:46.565800 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 12:39:46.565800 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 12:39:46.565800 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ff125cf8-e8a5-4f00-ade9-045b18ee33f4 could not be found. Oct 31 12:39:46.565800 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Oct 31 12:39:46.565800 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 12:39:46.565800 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Oct 31 12:39:46.565800 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 12:39:46.565800 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 12:39:46.565800 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 12:39:46.565800 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 12:39:46.565800 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 12:39:46.565800 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 12:39:46.567395 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 12:39:46.567395 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 31 12:39:46.567395 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 31 12:39:46.567395 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 31 12:39:46.567395 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 31 12:39:46.567395 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 12:39:46.567395 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 12:39:46.567395 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 12:39:46.567395 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 12:39:46.567395 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ff125cf8-e8a5-4f00-ade9-045b18ee33f4 could not be found. Oct 31 12:39:46.567395 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Oct 31 12:39:46.567395 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 12:39:46.567395 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Oct 31 12:39:46.567395 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 12:39:46.567395 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 12:39:46.567395 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 12:39:46.567395 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 12:39:46.567395 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 12:39:46.567395 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ff125cf8-e8a5-4f00-ade9-045b18ee33f4 could not be found. Oct 31 12:39:46.567395 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Oct 31 12:39:46.569085 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-3673eb4c-e1ff-4561-8ec5-4ed486391117 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Returning 404 to user: Instance ff125cf8-e8a5-4f00-ade9-045b18ee33f4 could not be found. {{(pid=125440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 12:39:46.569085 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-3673eb4c-e1ff-4561-8ec5-4ed486391117 tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] 10.222.0.15 "DELETE /compute/v2.1/servers/ff125cf8-e8a5-4f00-ade9-045b18ee33f4" status: 404 len: 111 microversion: 2.1 time: 0.034026 Oct 31 12:39:46.569085 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 482/954] 10.222.0.15 () {58 vars in 1239 bytes} [Mon Oct 31 12:39:46 2022] DELETE /compute/v2.1/servers/ff125cf8-e8a5-4f00-ade9-045b18ee33f4 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 12:39:46.574326 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-b2b86b03-0bb6-4a50-aea8-34cff0573b8b tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:39:46.574940 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-b2b86b03-0bb6-4a50-aea8-34cff0573b8b tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] [instance: ff125cf8-e8a5-4f00-ade9-045b18ee33f4] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:39:46.586504 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-b2b86b03-0bb6-4a50-aea8-34cff0573b8b tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:46.586995 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-b2b86b03-0bb6-4a50-aea8-34cff0573b8b tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:46.587626 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-b2b86b03-0bb6-4a50-aea8-34cff0573b8b tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:46.588425 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-b2b86b03-0bb6-4a50-aea8-34cff0573b8b tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:39:46.588879 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-b2b86b03-0bb6-4a50-aea8-34cff0573b8b tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:39:46.589309 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-b2b86b03-0bb6-4a50-aea8-34cff0573b8b tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:39:46.604716 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.wsgi [None req-b2b86b03-0bb6-4a50-aea8-34cff0573b8b tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] HTTP exception thrown: Instance ff125cf8-e8a5-4f00-ade9-045b18ee33f4 could not be found. Oct 31 12:39:46.606276 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-b2b86b03-0bb6-4a50-aea8-34cff0573b8b tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Request method failure captured: Oct 31 12:39:46.606276 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: request: GET /compute/v2.1/servers/ff125cf8-e8a5-4f00-ade9-045b18ee33f4 HTTP/1.1 Oct 31 12:39:46.606276 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: Accept: application/json Oct 31 12:39:46.606276 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: Accept-Encoding: identity Oct 31 12:39:46.606276 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: Connection: close Oct 31 12:39:46.606276 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: Content-Length: 0 Oct 31 12:39:46.606276 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: Content-Type: application/json Oct 31 12:39:46.606276 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: Host: 10.222.0.15 Oct 31 12:39:46.606276 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: Openstack-System-Scope: None Oct 31 12:39:46.606276 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: User-Agent: python-urllib3/1.26.12 Oct 31 12:39:46.606276 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Auth-Token: gAAAAABjX8B2m1m9MuKBHO0SxDm7arupmshYlZMAAEgJbORjur4Qe9OXcQVHKBx6k7T788otdlxtGddMg-xkFyl2KDcVhkjBWCqqwl5KGIfG6sLllN0xH9I_wHEXqxzSWixQ1A2CE1FBbOiKiTEJ4kGxgYMjSo6WKiJZiEFxLVgKkbpX9vSJpEU Oct 31 12:39:46.606276 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Domain-Id: None Oct 31 12:39:46.606276 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Domain-Name: None Oct 31 12:39:46.606276 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Identity-Status: Confirmed Oct 31 12:39:46.606276 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Is-Admin-Project: True Oct 31 12:39:46.606276 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Project-Domain-Id: default Oct 31 12:39:46.606276 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Project-Domain-Name: Default Oct 31 12:39:46.606276 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Project-Id: b9a2bf9a5a484523a700e4e6c568d4de Oct 31 12:39:46.606276 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Project-Name: tempest-AttachVolumeTestJSON-447861972 Oct 31 12:39:46.606276 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Role: reader,member Oct 31 12:39:46.606276 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Roles: reader,member Oct 31 12:39:46.607636 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/b9a2bf9a5a484523a700e4e6c568d4de"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_b9a2bf9a5a484523a700e4e6c568d4de", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/b9a2bf9a5a484523a700e4e6c568d4de"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/b9a2bf9a5a484523a700e4e6c568d4de"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Oct 31 12:39:46.607636 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Tenant: tempest-AttachVolumeTestJSON-447861972 Oct 31 12:39:46.607636 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Tenant-Id: b9a2bf9a5a484523a700e4e6c568d4de Oct 31 12:39:46.607636 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Tenant-Name: tempest-AttachVolumeTestJSON-447861972 Oct 31 12:39:46.607636 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-User: tempest-AttachVolumeTestJSON-447861972-project Oct 31 12:39:46.607636 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-User-Domain-Id: default Oct 31 12:39:46.607636 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-User-Domain-Name: Default Oct 31 12:39:46.607636 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-User-Id: d6c1beb321e44908ab987b17f7b74484 Oct 31 12:39:46.607636 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-User-Name: tempest-AttachVolumeTestJSON-447861972-project Oct 31 12:39:46.607636 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: method: > Oct 31 12:39:46.607636 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: exception: Instance ff125cf8-e8a5-4f00-ade9-045b18ee33f4 could not be found. Oct 31 12:39:46.607636 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: action_args: {'id': 'ff125cf8-e8a5-4f00-ade9-045b18ee33f4'} Oct 31 12:39:46.608411 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 12:39:46.608411 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 12:39:46.608411 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 12:39:46.608411 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 12:39:46.608411 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 12:39:46.608411 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 12:39:46.608411 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 12:39:46.608411 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 12:39:46.608411 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 12:39:46.608411 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 12:39:46.608411 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ff125cf8-e8a5-4f00-ade9-045b18ee33f4 could not be found. Oct 31 12:39:46.608411 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Oct 31 12:39:46.608411 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 12:39:46.608411 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Oct 31 12:39:46.608411 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 12:39:46.608411 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 12:39:46.608411 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 12:39:46.608411 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 12:39:46.608411 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 12:39:46.608411 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 12:39:46.609686 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 12:39:46.609686 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 12:39:46.609686 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 12:39:46.609686 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 12:39:46.609686 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 12:39:46.609686 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 12:39:46.609686 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 12:39:46.609686 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ff125cf8-e8a5-4f00-ade9-045b18ee33f4 could not be found. Oct 31 12:39:46.609686 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Oct 31 12:39:46.609686 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 12:39:46.609686 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Oct 31 12:39:46.609686 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 12:39:46.609686 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 12:39:46.609686 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 12:39:46.609686 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 12:39:46.609686 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 12:39:46.609686 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ff125cf8-e8a5-4f00-ade9-045b18ee33f4 could not be found. Oct 31 12:39:46.609686 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Oct 31 12:39:46.610847 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-b2b86b03-0bb6-4a50-aea8-34cff0573b8b tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] Returning 404 to user: Instance ff125cf8-e8a5-4f00-ade9-045b18ee33f4 could not be found. {{(pid=125441) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 12:39:46.610847 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-b2b86b03-0bb6-4a50-aea8-34cff0573b8b tempest-AttachVolumeTestJSON-447861972 tempest-AttachVolumeTestJSON-447861972-project] 10.222.0.15 "GET /compute/v2.1/servers/ff125cf8-e8a5-4f00-ade9-045b18ee33f4" status: 404 len: 111 microversion: 2.1 time: 0.037653 Oct 31 12:39:46.610847 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 473/955] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:39:46 2022] GET /compute/v2.1/servers/ff125cf8-e8a5-4f00-ade9-045b18ee33f4 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 12:39:51.846007 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-b00fd886-8502-4962-9a7f-04cadfc531c1 tempest-VolumesNegativeTest-923536468 tempest-VolumesNegativeTest-923536468-project] Action: 'create', calling method: .version_select at 0x7f2aa5198430>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-607634865", "metadata": {"Type": "work"}}} {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 12:39:51.858305 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-b00fd886-8502-4962-9a7f-04cadfc531c1 tempest-VolumesNegativeTest-923536468 tempest-VolumesNegativeTest-923536468-project] Request method failure captured: Oct 31 12:39:51.858305 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 31 12:39:51.858305 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: Accept: application/json Oct 31 12:39:51.858305 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: Accept-Encoding: identity Oct 31 12:39:51.858305 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: Connection: close Oct 31 12:39:51.858305 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: Content-Length: 121 Oct 31 12:39:51.858305 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: Content-Type: application/json Oct 31 12:39:51.858305 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: Host: 10.222.0.15 Oct 31 12:39:51.858305 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: Openstack-System-Scope: None Oct 31 12:39:51.858305 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: User-Agent: python-urllib3/1.26.12 Oct 31 12:39:51.858305 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Auth-Token: gAAAAABjX8IXPwzLR3Wnw5OkKDTid-yZNyL-jEkjgfSIl8PXB4i_j7TiH3qi4D1iehTvXl7cAQIDVVAXf2G9pCopnoRIe6c5n3oWx2BTEEKivYlb-18Mv8P2oXsTu019CaUuY3aCmuWEyd0k4bM1m9kZyP_blYHEPlNlsVbX-bbzVnAqatJIJvs Oct 31 12:39:51.858305 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Domain-Id: None Oct 31 12:39:51.858305 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Domain-Name: None Oct 31 12:39:51.858305 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Identity-Status: Confirmed Oct 31 12:39:51.858305 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Is-Admin-Project: True Oct 31 12:39:51.858305 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Project-Domain-Id: default Oct 31 12:39:51.858305 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Project-Domain-Name: Default Oct 31 12:39:51.858305 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Project-Id: 8686fe87fb534b65a0f5cf77dbbc18a5 Oct 31 12:39:51.858305 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Project-Name: tempest-VolumesNegativeTest-923536468 Oct 31 12:39:51.858305 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Role: reader,member Oct 31 12:39:51.858305 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Roles: reader,member Oct 31 12:39:51.860039 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/8686fe87fb534b65a0f5cf77dbbc18a5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_8686fe87fb534b65a0f5cf77dbbc18a5", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/8686fe87fb534b65a0f5cf77dbbc18a5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/8686fe87fb534b65a0f5cf77dbbc18a5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Oct 31 12:39:51.860039 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Tenant: tempest-VolumesNegativeTest-923536468 Oct 31 12:39:51.860039 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Tenant-Id: 8686fe87fb534b65a0f5cf77dbbc18a5 Oct 31 12:39:51.860039 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Tenant-Name: tempest-VolumesNegativeTest-923536468 Oct 31 12:39:51.860039 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-User: tempest-VolumesNegativeTest-923536468-project Oct 31 12:39:51.860039 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-User-Domain-Id: default Oct 31 12:39:51.860039 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-User-Domain-Name: Default Oct 31 12:39:51.860039 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-User-Id: 3ef96b7cf1274462b8a82d814fdb1043 Oct 31 12:39:51.860039 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-User-Name: tempest-VolumesNegativeTest-923536468-project Oct 31 12:39:51.860039 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: Oct 31 12:39:51.860039 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-607634865", "metadata": {"Type": "work"}}} Oct 31 12:39:51.860039 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: method: Oct 31 12:39:51.860039 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 31 12:39:51.861324 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-607634865', 'metadata': {'Type': 'work'}}}} Oct 31 12:39:51.861324 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 12:39:51.861324 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 12:39:51.861324 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 31 12:39:51.861324 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 31 12:39:51.861324 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 31 12:39:51.861324 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi raise error Oct 31 12:39:51.861324 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Oct 31 12:39:51.861324 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Oct 31 12:39:51.861324 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 31 12:39:51.861324 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 31 12:39:51.861324 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Oct 31 12:39:51.861324 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 31 12:39:51.861324 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi '#$%' Oct 31 12:39:51.861324 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Oct 31 12:39:51.861324 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 12:39:51.861324 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Oct 31 12:39:51.861324 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 12:39:51.861324 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 12:39:51.861324 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 12:39:51.861324 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 12:39:51.861324 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 12:39:51.862688 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 12:39:51.862688 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 12:39:51.862688 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 12:39:51.862688 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 12:39:51.862688 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 31 12:39:51.862688 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 31 12:39:51.862688 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 31 12:39:51.862688 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 31 12:39:51.862688 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 31 12:39:51.862688 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 31 12:39:51.862688 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 31 12:39:51.862688 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Oct 31 12:39:51.862688 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 12:39:51.862688 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Oct 31 12:39:51.862688 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 12:39:51.862688 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 12:39:51.862688 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 12:39:51.862688 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 31 12:39:51.862688 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 31 12:39:51.864025 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 31 12:39:51.864025 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Oct 31 12:39:51.864025 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-b00fd886-8502-4962-9a7f-04cadfc531c1 tempest-VolumesNegativeTest-923536468 tempest-VolumesNegativeTest-923536468-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=125440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 12:39:51.864025 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-b00fd886-8502-4962-9a7f-04cadfc531c1 tempest-VolumesNegativeTest-923536468 tempest-VolumesNegativeTest-923536468-project] 10.222.0.15 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.131439 Oct 31 12:39:51.864025 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 483/956] 10.222.0.15 () {60 vars in 1156 bytes} [Mon Oct 31 12:39:51 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 133 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 31 12:39:51.870573 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-573ac206-fe50-41bb-b1d5-2d5c3a3c8a2f tempest-VolumesNegativeTest-923536468 tempest-VolumesNegativeTest-923536468-project] Action: 'create', calling method: .version_select at 0x7f2aa518aa60>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-412888185", "metadata": {"Type": "work"}}} {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 12:39:51.875422 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-573ac206-fe50-41bb-b1d5-2d5c3a3c8a2f tempest-VolumesNegativeTest-923536468 tempest-VolumesNegativeTest-923536468-project] Request method failure captured: Oct 31 12:39:51.875422 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 31 12:39:51.875422 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: Accept: application/json Oct 31 12:39:51.875422 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: Accept-Encoding: identity Oct 31 12:39:51.875422 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: Connection: close Oct 31 12:39:51.875422 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: Content-Length: 119 Oct 31 12:39:51.875422 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: Content-Type: application/json Oct 31 12:39:51.875422 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: Host: 10.222.0.15 Oct 31 12:39:51.875422 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: Openstack-System-Scope: None Oct 31 12:39:51.875422 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: User-Agent: python-urllib3/1.26.12 Oct 31 12:39:51.875422 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Auth-Token: gAAAAABjX8IXPwzLR3Wnw5OkKDTid-yZNyL-jEkjgfSIl8PXB4i_j7TiH3qi4D1iehTvXl7cAQIDVVAXf2G9pCopnoRIe6c5n3oWx2BTEEKivYlb-18Mv8P2oXsTu019CaUuY3aCmuWEyd0k4bM1m9kZyP_blYHEPlNlsVbX-bbzVnAqatJIJvs Oct 31 12:39:51.875422 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Domain-Id: None Oct 31 12:39:51.875422 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Domain-Name: None Oct 31 12:39:51.875422 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Identity-Status: Confirmed Oct 31 12:39:51.875422 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Is-Admin-Project: True Oct 31 12:39:51.875422 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Project-Domain-Id: default Oct 31 12:39:51.875422 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Project-Domain-Name: Default Oct 31 12:39:51.875422 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Project-Id: 8686fe87fb534b65a0f5cf77dbbc18a5 Oct 31 12:39:51.875422 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Project-Name: tempest-VolumesNegativeTest-923536468 Oct 31 12:39:51.875422 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Role: reader,member Oct 31 12:39:51.875422 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Roles: reader,member Oct 31 12:39:51.877113 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/8686fe87fb534b65a0f5cf77dbbc18a5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_8686fe87fb534b65a0f5cf77dbbc18a5", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/8686fe87fb534b65a0f5cf77dbbc18a5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/8686fe87fb534b65a0f5cf77dbbc18a5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Oct 31 12:39:51.877113 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Tenant: tempest-VolumesNegativeTest-923536468 Oct 31 12:39:51.877113 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Tenant-Id: 8686fe87fb534b65a0f5cf77dbbc18a5 Oct 31 12:39:51.877113 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Tenant-Name: tempest-VolumesNegativeTest-923536468 Oct 31 12:39:51.877113 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-User: tempest-VolumesNegativeTest-923536468-project Oct 31 12:39:51.877113 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-User-Domain-Id: default Oct 31 12:39:51.877113 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-User-Domain-Name: Default Oct 31 12:39:51.877113 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-User-Id: 3ef96b7cf1274462b8a82d814fdb1043 Oct 31 12:39:51.877113 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-User-Name: tempest-VolumesNegativeTest-923536468-project Oct 31 12:39:51.877113 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: Oct 31 12:39:51.877113 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-412888185", "metadata": {"Type": "work"}}} Oct 31 12:39:51.877113 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: method: Oct 31 12:39:51.877113 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 31 12:39:51.877995 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-412888185', 'metadata': {'Type': 'work'}}}} Oct 31 12:39:51.877995 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 12:39:51.877995 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 12:39:51.877995 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 31 12:39:51.877995 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 31 12:39:51.877995 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 31 12:39:51.877995 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi raise error Oct 31 12:39:51.877995 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 31 12:39:51.877995 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Oct 31 12:39:51.877995 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Oct 31 12:39:51.877995 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 31 12:39:51.877995 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Oct 31 12:39:51.877995 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 31 12:39:51.877995 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi '0' Oct 31 12:39:51.877995 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Oct 31 12:39:51.877995 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 12:39:51.877995 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Oct 31 12:39:51.877995 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 12:39:51.877995 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 12:39:51.877995 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 12:39:51.877995 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 12:39:51.877995 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 12:39:51.879605 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 12:39:51.879605 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 12:39:51.879605 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 12:39:51.879605 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 12:39:51.879605 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 31 12:39:51.879605 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 31 12:39:51.879605 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 31 12:39:51.879605 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 31 12:39:51.879605 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 31 12:39:51.879605 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 31 12:39:51.879605 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 31 12:39:51.879605 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Oct 31 12:39:51.879605 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 12:39:51.879605 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Oct 31 12:39:51.879605 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 12:39:51.879605 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 12:39:51.879605 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 12:39:51.879605 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 31 12:39:51.879605 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 31 12:39:51.880821 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 31 12:39:51.880821 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Oct 31 12:39:51.880821 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-573ac206-fe50-41bb-b1d5-2d5c3a3c8a2f tempest-VolumesNegativeTest-923536468 tempest-VolumesNegativeTest-923536468-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=125441) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 12:39:51.880821 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-573ac206-fe50-41bb-b1d5-2d5c3a3c8a2f tempest-VolumesNegativeTest-923536468 tempest-VolumesNegativeTest-923536468-project] 10.222.0.15 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.011060 Oct 31 12:39:51.880821 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 474/957] 10.222.0.15 () {60 vars in 1156 bytes} [Mon Oct 31 12:39:51 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 31 12:39:51.887620 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-f33d3d26-1364-4a1e-8756-97e2f2245bd6 tempest-VolumesNegativeTest-923536468 tempest-VolumesNegativeTest-923536468-project] Action: 'create', calling method: .version_select at 0x7f2aa51a6940>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1098963004", "metadata": {"Type": "work"}}} {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 12:39:51.892243 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-f33d3d26-1364-4a1e-8756-97e2f2245bd6 tempest-VolumesNegativeTest-923536468 tempest-VolumesNegativeTest-923536468-project] Request method failure captured: Oct 31 12:39:51.892243 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 31 12:39:51.892243 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: Accept: application/json Oct 31 12:39:51.892243 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: Accept-Encoding: identity Oct 31 12:39:51.892243 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: Connection: close Oct 31 12:39:51.892243 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: Content-Length: 119 Oct 31 12:39:51.892243 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: Content-Type: application/json Oct 31 12:39:51.892243 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: Host: 10.222.0.15 Oct 31 12:39:51.892243 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: Openstack-System-Scope: None Oct 31 12:39:51.892243 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: User-Agent: python-urllib3/1.26.12 Oct 31 12:39:51.892243 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Auth-Token: gAAAAABjX8IXPwzLR3Wnw5OkKDTid-yZNyL-jEkjgfSIl8PXB4i_j7TiH3qi4D1iehTvXl7cAQIDVVAXf2G9pCopnoRIe6c5n3oWx2BTEEKivYlb-18Mv8P2oXsTu019CaUuY3aCmuWEyd0k4bM1m9kZyP_blYHEPlNlsVbX-bbzVnAqatJIJvs Oct 31 12:39:51.892243 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Domain-Id: None Oct 31 12:39:51.892243 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Domain-Name: None Oct 31 12:39:51.892243 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Identity-Status: Confirmed Oct 31 12:39:51.892243 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Is-Admin-Project: True Oct 31 12:39:51.892243 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Project-Domain-Id: default Oct 31 12:39:51.892243 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Project-Domain-Name: Default Oct 31 12:39:51.892243 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Project-Id: 8686fe87fb534b65a0f5cf77dbbc18a5 Oct 31 12:39:51.892243 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Project-Name: tempest-VolumesNegativeTest-923536468 Oct 31 12:39:51.892243 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Role: reader,member Oct 31 12:39:51.892243 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Roles: reader,member Oct 31 12:39:51.894208 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/8686fe87fb534b65a0f5cf77dbbc18a5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_8686fe87fb534b65a0f5cf77dbbc18a5", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/8686fe87fb534b65a0f5cf77dbbc18a5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/8686fe87fb534b65a0f5cf77dbbc18a5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Oct 31 12:39:51.894208 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Tenant: tempest-VolumesNegativeTest-923536468 Oct 31 12:39:51.894208 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Tenant-Id: 8686fe87fb534b65a0f5cf77dbbc18a5 Oct 31 12:39:51.894208 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Tenant-Name: tempest-VolumesNegativeTest-923536468 Oct 31 12:39:51.894208 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-User: tempest-VolumesNegativeTest-923536468-project Oct 31 12:39:51.894208 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-User-Domain-Id: default Oct 31 12:39:51.894208 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-User-Domain-Name: Default Oct 31 12:39:51.894208 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-User-Id: 3ef96b7cf1274462b8a82d814fdb1043 Oct 31 12:39:51.894208 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-User-Name: tempest-VolumesNegativeTest-923536468-project Oct 31 12:39:51.894208 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: Oct 31 12:39:51.894208 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1098963004", "metadata": {"Type": "work"}}} Oct 31 12:39:51.894208 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: method: Oct 31 12:39:51.894208 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 31 12:39:51.895356 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1098963004', 'metadata': {'Type': 'work'}}}} Oct 31 12:39:51.895356 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 12:39:51.895356 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 12:39:51.895356 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 31 12:39:51.895356 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 31 12:39:51.895356 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 31 12:39:51.895356 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi raise error Oct 31 12:39:51.895356 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Oct 31 12:39:51.895356 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Oct 31 12:39:51.895356 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 31 12:39:51.895356 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 31 12:39:51.895356 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Oct 31 12:39:51.895356 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 31 12:39:51.895356 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi '' Oct 31 12:39:51.895356 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Oct 31 12:39:51.895356 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 12:39:51.895356 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Oct 31 12:39:51.895356 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 12:39:51.895356 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 12:39:51.895356 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 12:39:51.895356 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 12:39:51.895356 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 12:39:51.897459 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 12:39:51.897459 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 12:39:51.897459 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 12:39:51.897459 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 12:39:51.897459 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 31 12:39:51.897459 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 31 12:39:51.897459 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 31 12:39:51.897459 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 31 12:39:51.897459 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 31 12:39:51.897459 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 31 12:39:51.897459 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 31 12:39:51.897459 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Oct 31 12:39:51.897459 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 12:39:51.897459 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Oct 31 12:39:51.897459 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 12:39:51.897459 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 12:39:51.897459 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 12:39:51.897459 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 31 12:39:51.897459 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 31 12:39:51.899715 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 31 12:39:51.899715 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Oct 31 12:39:51.899715 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-f33d3d26-1364-4a1e-8756-97e2f2245bd6 tempest-VolumesNegativeTest-923536468 tempest-VolumesNegativeTest-923536468-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=125440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 12:39:51.899715 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-f33d3d26-1364-4a1e-8756-97e2f2245bd6 tempest-VolumesNegativeTest-923536468 tempest-VolumesNegativeTest-923536468-project] 10.222.0.15 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.010314 Oct 31 12:39:51.899715 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 484/958] 10.222.0.15 () {60 vars in 1156 bytes} [Mon Oct 31 12:39:51 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 31 12:39:51.903883 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-4f1d3815-5824-4970-b49c-eb33da49c9d6 tempest-VolumesNegativeTest-923536468 tempest-VolumesNegativeTest-923536468-project] Calling method '.version_select at 0x7f2aa51c73a0>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:39:51.943961 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.wsgi [None req-4f1d3815-5824-4970-b49c-eb33da49c9d6 tempest-VolumesNegativeTest-923536468 tempest-VolumesNegativeTest-923536468-project] HTTP exception thrown: Volume tempest-invalid-1677926756 could not be found. Oct 31 12:39:51.945946 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-4f1d3815-5824-4970-b49c-eb33da49c9d6 tempest-VolumesNegativeTest-923536468 tempest-VolumesNegativeTest-923536468-project] Request method failure captured: Oct 31 12:39:51.945946 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1677926756 HTTP/1.1 Oct 31 12:39:51.945946 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: Accept: application/json Oct 31 12:39:51.945946 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: Accept-Encoding: identity Oct 31 12:39:51.945946 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: Connection: close Oct 31 12:39:51.945946 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: Content-Length: 0 Oct 31 12:39:51.945946 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: Content-Type: application/json Oct 31 12:39:51.945946 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: Host: 10.222.0.15 Oct 31 12:39:51.945946 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: Openstack-System-Scope: None Oct 31 12:39:51.945946 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: User-Agent: python-urllib3/1.26.12 Oct 31 12:39:51.945946 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Auth-Token: gAAAAABjX8IXPwzLR3Wnw5OkKDTid-yZNyL-jEkjgfSIl8PXB4i_j7TiH3qi4D1iehTvXl7cAQIDVVAXf2G9pCopnoRIe6c5n3oWx2BTEEKivYlb-18Mv8P2oXsTu019CaUuY3aCmuWEyd0k4bM1m9kZyP_blYHEPlNlsVbX-bbzVnAqatJIJvs Oct 31 12:39:51.945946 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Domain-Id: None Oct 31 12:39:51.945946 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Domain-Name: None Oct 31 12:39:51.945946 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Identity-Status: Confirmed Oct 31 12:39:51.945946 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Is-Admin-Project: True Oct 31 12:39:51.945946 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Project-Domain-Id: default Oct 31 12:39:51.945946 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Project-Domain-Name: Default Oct 31 12:39:51.945946 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Project-Id: 8686fe87fb534b65a0f5cf77dbbc18a5 Oct 31 12:39:51.945946 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Project-Name: tempest-VolumesNegativeTest-923536468 Oct 31 12:39:51.945946 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Role: reader,member Oct 31 12:39:51.945946 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Roles: reader,member Oct 31 12:39:51.948323 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/8686fe87fb534b65a0f5cf77dbbc18a5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_8686fe87fb534b65a0f5cf77dbbc18a5", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/8686fe87fb534b65a0f5cf77dbbc18a5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/8686fe87fb534b65a0f5cf77dbbc18a5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Oct 31 12:39:51.948323 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Tenant: tempest-VolumesNegativeTest-923536468 Oct 31 12:39:51.948323 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Tenant-Id: 8686fe87fb534b65a0f5cf77dbbc18a5 Oct 31 12:39:51.948323 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Tenant-Name: tempest-VolumesNegativeTest-923536468 Oct 31 12:39:51.948323 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-User: tempest-VolumesNegativeTest-923536468-project Oct 31 12:39:51.948323 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-User-Domain-Id: default Oct 31 12:39:51.948323 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-User-Domain-Name: Default Oct 31 12:39:51.948323 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-User-Id: 3ef96b7cf1274462b8a82d814fdb1043 Oct 31 12:39:51.948323 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-User-Name: tempest-VolumesNegativeTest-923536468-project Oct 31 12:39:51.948323 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: method: Oct 31 12:39:51.948323 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: exception: Volume tempest-invalid-1677926756 could not be found. Oct 31 12:39:51.948323 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: action_args: {'id': 'tempest-invalid-1677926756'} Oct 31 12:39:51.948323 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 12:39:51.949145 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 12:39:51.949145 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 31 12:39:51.949145 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 31 12:39:51.949145 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 31 12:39:51.949145 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 31 12:39:51.949145 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 31 12:39:51.949145 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 31 12:39:51.949145 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 31 12:39:51.949145 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 31 12:39:51.949145 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 31 12:39:51.949145 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 31 12:39:51.949145 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 31 12:39:51.949145 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 31 12:39:51.949145 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 31 12:39:51.949145 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 31 12:39:51.949145 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1677926756 could not be found. (HTTP 404) (Request-ID: req-195f7428-4a9c-4b09-bbb5-7688e74279a5) Oct 31 12:39:51.949145 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Oct 31 12:39:51.949145 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 12:39:51.949145 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Oct 31 12:39:51.950305 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 12:39:51.950305 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 31 12:39:51.950305 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 31 12:39:51.950305 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 31 12:39:51.950305 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 31 12:39:51.950305 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 31 12:39:51.950305 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 31 12:39:51.950305 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 31 12:39:51.950305 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 31 12:39:51.950305 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 31 12:39:51.950305 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 31 12:39:51.950305 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 31 12:39:51.950305 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 31 12:39:51.950305 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 31 12:39:51.950305 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 31 12:39:51.950305 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 31 12:39:51.950305 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 31 12:39:51.950305 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 31 12:39:51.950305 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 31 12:39:51.951465 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 31 12:39:51.951465 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 31 12:39:51.951465 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 31 12:39:51.951465 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 31 12:39:51.951465 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1677926756 could not be found. Oct 31 12:39:51.951465 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Oct 31 12:39:51.951465 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 12:39:51.951465 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Oct 31 12:39:51.951465 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 12:39:51.951465 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 12:39:51.951465 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 12:39:51.951465 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 12:39:51.951465 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 12:39:51.951465 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 12:39:51.951465 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 12:39:51.951465 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 12:39:51.951465 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 12:39:51.951465 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 31 12:39:51.951465 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 12:39:51.951465 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1677926756 could not be found. Oct 31 12:39:51.952857 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Oct 31 12:39:51.952857 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 12:39:51.952857 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Oct 31 12:39:51.952857 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 12:39:51.952857 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 12:39:51.952857 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 12:39:51.952857 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 12:39:51.952857 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 12:39:51.952857 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1677926756 could not be found. Oct 31 12:39:51.952857 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Oct 31 12:39:51.952857 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-4f1d3815-5824-4970-b49c-eb33da49c9d6 tempest-VolumesNegativeTest-923536468 tempest-VolumesNegativeTest-923536468-project] Returning 404 to user: Volume tempest-invalid-1677926756 could not be found. {{(pid=125441) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 12:39:51.952857 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-4f1d3815-5824-4970-b49c-eb33da49c9d6 tempest-VolumesNegativeTest-923536468 tempest-VolumesNegativeTest-923536468-project] 10.222.0.15 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1677926756" status: 404 len: 99 microversion: 2.1 time: 0.048396 Oct 31 12:39:51.952857 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 475/959] 10.222.0.15 () {58 vars in 1218 bytes} [Mon Oct 31 12:39:51 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1677926756 => generated 99 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 31 12:39:51.958851 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-a9a4267c-efe1-40f2-83f1-6f413b3ae1c5 tempest-VolumesNegativeTest-923536468 tempest-VolumesNegativeTest-923536468-project] 10.222.0.15 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003695 Oct 31 12:39:51.959549 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 485/960] 10.222.0.15 () {58 vars in 1140 bytes} [Mon Oct 31 12:39:51 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 31 12:39:51.969909 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-73c40a5f-9a22-4c73-9f4d-b679c21540d1 tempest-VolumesNegativeTest-923536468 tempest-VolumesNegativeTest-923536468-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003901 Oct 31 12:39:51.970708 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 476/961] 10.222.0.15 () {58 vars in 1137 bytes} [Mon Oct 31 12:39:51 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 31 12:39:51.980872 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-0bf91131-6105-4737-baab-92d08f71d0f2 tempest-VolumesNegativeTest-923536468 tempest-VolumesNegativeTest-923536468-project] Calling method '.version_select at 0x7f2aa518fa60>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:39:52.010007 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.wsgi [None req-0bf91131-6105-4737-baab-92d08f71d0f2 tempest-VolumesNegativeTest-923536468 tempest-VolumesNegativeTest-923536468-project] HTTP exception thrown: Volume ea176e52-7cc6-4aa3-b945-af0658a051d3 could not be found. Oct 31 12:39:52.012313 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-0bf91131-6105-4737-baab-92d08f71d0f2 tempest-VolumesNegativeTest-923536468 tempest-VolumesNegativeTest-923536468-project] Request method failure captured: Oct 31 12:39:52.012313 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: request: DELETE /compute/v2.1/os-volumes/ea176e52-7cc6-4aa3-b945-af0658a051d3 HTTP/1.1 Oct 31 12:39:52.012313 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: Accept: application/json Oct 31 12:39:52.012313 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: Accept-Encoding: identity Oct 31 12:39:52.012313 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: Connection: close Oct 31 12:39:52.012313 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: Content-Length: 0 Oct 31 12:39:52.012313 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: Content-Type: application/json Oct 31 12:39:52.012313 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: Host: 10.222.0.15 Oct 31 12:39:52.012313 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: Openstack-System-Scope: None Oct 31 12:39:52.012313 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: User-Agent: python-urllib3/1.26.12 Oct 31 12:39:52.012313 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Auth-Token: gAAAAABjX8IXPwzLR3Wnw5OkKDTid-yZNyL-jEkjgfSIl8PXB4i_j7TiH3qi4D1iehTvXl7cAQIDVVAXf2G9pCopnoRIe6c5n3oWx2BTEEKivYlb-18Mv8P2oXsTu019CaUuY3aCmuWEyd0k4bM1m9kZyP_blYHEPlNlsVbX-bbzVnAqatJIJvs Oct 31 12:39:52.012313 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Domain-Id: None Oct 31 12:39:52.012313 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Domain-Name: None Oct 31 12:39:52.012313 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Identity-Status: Confirmed Oct 31 12:39:52.012313 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Is-Admin-Project: True Oct 31 12:39:52.012313 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Project-Domain-Id: default Oct 31 12:39:52.012313 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Project-Domain-Name: Default Oct 31 12:39:52.012313 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Project-Id: 8686fe87fb534b65a0f5cf77dbbc18a5 Oct 31 12:39:52.012313 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Project-Name: tempest-VolumesNegativeTest-923536468 Oct 31 12:39:52.012313 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Role: reader,member Oct 31 12:39:52.012313 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Roles: reader,member Oct 31 12:39:52.013962 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/8686fe87fb534b65a0f5cf77dbbc18a5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_8686fe87fb534b65a0f5cf77dbbc18a5", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/8686fe87fb534b65a0f5cf77dbbc18a5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/8686fe87fb534b65a0f5cf77dbbc18a5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Oct 31 12:39:52.013962 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Tenant: tempest-VolumesNegativeTest-923536468 Oct 31 12:39:52.013962 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Tenant-Id: 8686fe87fb534b65a0f5cf77dbbc18a5 Oct 31 12:39:52.013962 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Tenant-Name: tempest-VolumesNegativeTest-923536468 Oct 31 12:39:52.013962 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-User: tempest-VolumesNegativeTest-923536468-project Oct 31 12:39:52.013962 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-User-Domain-Id: default Oct 31 12:39:52.013962 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-User-Domain-Name: Default Oct 31 12:39:52.013962 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-User-Id: 3ef96b7cf1274462b8a82d814fdb1043 Oct 31 12:39:52.013962 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-User-Name: tempest-VolumesNegativeTest-923536468-project Oct 31 12:39:52.013962 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: method: Oct 31 12:39:52.013962 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: exception: Volume ea176e52-7cc6-4aa3-b945-af0658a051d3 could not be found. Oct 31 12:39:52.013962 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: action_args: {'id': 'ea176e52-7cc6-4aa3-b945-af0658a051d3'} Oct 31 12:39:52.013962 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 12:39:52.014948 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 12:39:52.014948 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 31 12:39:52.014948 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 31 12:39:52.014948 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 31 12:39:52.014948 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 31 12:39:52.014948 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 31 12:39:52.014948 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 31 12:39:52.014948 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 31 12:39:52.014948 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 31 12:39:52.014948 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 31 12:39:52.014948 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 31 12:39:52.014948 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 31 12:39:52.014948 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 31 12:39:52.014948 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 31 12:39:52.014948 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 31 12:39:52.014948 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ea176e52-7cc6-4aa3-b945-af0658a051d3 could not be found. (HTTP 404) (Request-ID: req-fe417761-064b-4f65-b6d1-49a61203c1e2) Oct 31 12:39:52.014948 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Oct 31 12:39:52.014948 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 12:39:52.014948 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Oct 31 12:39:52.016667 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 12:39:52.016667 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 31 12:39:52.016667 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 31 12:39:52.016667 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 31 12:39:52.016667 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 31 12:39:52.016667 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 31 12:39:52.016667 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 31 12:39:52.016667 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 31 12:39:52.016667 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 31 12:39:52.016667 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 31 12:39:52.016667 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 31 12:39:52.016667 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 31 12:39:52.016667 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 31 12:39:52.016667 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 31 12:39:52.016667 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 31 12:39:52.016667 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 31 12:39:52.016667 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 31 12:39:52.016667 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 31 12:39:52.016667 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 31 12:39:52.018620 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 31 12:39:52.018620 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 31 12:39:52.018620 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 31 12:39:52.018620 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 31 12:39:52.018620 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ea176e52-7cc6-4aa3-b945-af0658a051d3 could not be found. Oct 31 12:39:52.018620 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Oct 31 12:39:52.018620 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 12:39:52.018620 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Oct 31 12:39:52.018620 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 12:39:52.018620 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 12:39:52.018620 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 12:39:52.018620 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 12:39:52.018620 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 12:39:52.018620 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 12:39:52.018620 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 12:39:52.018620 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 12:39:52.018620 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 12:39:52.018620 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 31 12:39:52.018620 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 12:39:52.020030 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ea176e52-7cc6-4aa3-b945-af0658a051d3 could not be found. Oct 31 12:39:52.020030 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Oct 31 12:39:52.020030 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 12:39:52.020030 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Oct 31 12:39:52.020030 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 12:39:52.020030 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 12:39:52.020030 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 12:39:52.020030 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 12:39:52.020030 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 12:39:52.020030 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ea176e52-7cc6-4aa3-b945-af0658a051d3 could not be found. Oct 31 12:39:52.020030 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Oct 31 12:39:52.020030 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-0bf91131-6105-4737-baab-92d08f71d0f2 tempest-VolumesNegativeTest-923536468 tempest-VolumesNegativeTest-923536468-project] Returning 404 to user: Volume ea176e52-7cc6-4aa3-b945-af0658a051d3 could not be found. {{(pid=125440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 12:39:52.020030 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-0bf91131-6105-4737-baab-92d08f71d0f2 tempest-VolumesNegativeTest-923536468 tempest-VolumesNegativeTest-923536468-project] 10.222.0.15 "DELETE /compute/v2.1/os-volumes/ea176e52-7cc6-4aa3-b945-af0658a051d3" status: 404 len: 109 microversion: 2.1 time: 0.037340 Oct 31 12:39:52.020030 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 486/962] 10.222.0.15 () {58 vars in 1248 bytes} [Mon Oct 31 12:39:51 2022] DELETE /compute/v2.1/os-volumes/ea176e52-7cc6-4aa3-b945-af0658a051d3 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 12:39:52.031352 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-4389bf03-4db5-4152-b3c2-0dad996b85d8 tempest-VolumesNegativeTest-923536468 tempest-VolumesNegativeTest-923536468-project] Calling method '.version_select at 0x7f2aa4eefe50>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:39:52.059525 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.wsgi [None req-4389bf03-4db5-4152-b3c2-0dad996b85d8 tempest-VolumesNegativeTest-923536468 tempest-VolumesNegativeTest-923536468-project] HTTP exception thrown: Volume d261f1a2-1d79-4c3c-b3d2-c45cc0f1f9ec could not be found. Oct 31 12:39:52.061467 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-4389bf03-4db5-4152-b3c2-0dad996b85d8 tempest-VolumesNegativeTest-923536468 tempest-VolumesNegativeTest-923536468-project] Request method failure captured: Oct 31 12:39:52.061467 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: request: GET /compute/v2.1/os-volumes/d261f1a2-1d79-4c3c-b3d2-c45cc0f1f9ec HTTP/1.1 Oct 31 12:39:52.061467 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: Accept: application/json Oct 31 12:39:52.061467 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: Accept-Encoding: identity Oct 31 12:39:52.061467 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: Connection: close Oct 31 12:39:52.061467 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: Content-Length: 0 Oct 31 12:39:52.061467 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: Content-Type: application/json Oct 31 12:39:52.061467 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: Host: 10.222.0.15 Oct 31 12:39:52.061467 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: Openstack-System-Scope: None Oct 31 12:39:52.061467 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: User-Agent: python-urllib3/1.26.12 Oct 31 12:39:52.061467 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Auth-Token: gAAAAABjX8IXPwzLR3Wnw5OkKDTid-yZNyL-jEkjgfSIl8PXB4i_j7TiH3qi4D1iehTvXl7cAQIDVVAXf2G9pCopnoRIe6c5n3oWx2BTEEKivYlb-18Mv8P2oXsTu019CaUuY3aCmuWEyd0k4bM1m9kZyP_blYHEPlNlsVbX-bbzVnAqatJIJvs Oct 31 12:39:52.061467 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Domain-Id: None Oct 31 12:39:52.061467 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Domain-Name: None Oct 31 12:39:52.061467 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Identity-Status: Confirmed Oct 31 12:39:52.061467 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Is-Admin-Project: True Oct 31 12:39:52.061467 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Project-Domain-Id: default Oct 31 12:39:52.061467 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Project-Domain-Name: Default Oct 31 12:39:52.061467 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Project-Id: 8686fe87fb534b65a0f5cf77dbbc18a5 Oct 31 12:39:52.061467 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Project-Name: tempest-VolumesNegativeTest-923536468 Oct 31 12:39:52.061467 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Role: reader,member Oct 31 12:39:52.061467 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Roles: reader,member Oct 31 12:39:52.063048 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/8686fe87fb534b65a0f5cf77dbbc18a5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_8686fe87fb534b65a0f5cf77dbbc18a5", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/8686fe87fb534b65a0f5cf77dbbc18a5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/8686fe87fb534b65a0f5cf77dbbc18a5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Oct 31 12:39:52.063048 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Tenant: tempest-VolumesNegativeTest-923536468 Oct 31 12:39:52.063048 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Tenant-Id: 8686fe87fb534b65a0f5cf77dbbc18a5 Oct 31 12:39:52.063048 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Tenant-Name: tempest-VolumesNegativeTest-923536468 Oct 31 12:39:52.063048 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-User: tempest-VolumesNegativeTest-923536468-project Oct 31 12:39:52.063048 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-User-Domain-Id: default Oct 31 12:39:52.063048 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-User-Domain-Name: Default Oct 31 12:39:52.063048 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-User-Id: 3ef96b7cf1274462b8a82d814fdb1043 Oct 31 12:39:52.063048 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-User-Name: tempest-VolumesNegativeTest-923536468-project Oct 31 12:39:52.063048 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: method: Oct 31 12:39:52.063048 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: exception: Volume d261f1a2-1d79-4c3c-b3d2-c45cc0f1f9ec could not be found. Oct 31 12:39:52.063048 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: action_args: {'id': 'd261f1a2-1d79-4c3c-b3d2-c45cc0f1f9ec'} Oct 31 12:39:52.063048 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 12:39:52.063946 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 12:39:52.063946 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 31 12:39:52.063946 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 31 12:39:52.063946 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 31 12:39:52.063946 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 31 12:39:52.063946 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 31 12:39:52.063946 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 31 12:39:52.063946 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 31 12:39:52.063946 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 31 12:39:52.063946 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 31 12:39:52.063946 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 31 12:39:52.063946 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 31 12:39:52.063946 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 31 12:39:52.063946 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 31 12:39:52.063946 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 31 12:39:52.063946 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d261f1a2-1d79-4c3c-b3d2-c45cc0f1f9ec could not be found. (HTTP 404) (Request-ID: req-5b2db54d-068f-4bff-8bd2-ec9638c3e38c) Oct 31 12:39:52.063946 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Oct 31 12:39:52.063946 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 12:39:52.063946 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Oct 31 12:39:52.065114 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 12:39:52.065114 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 31 12:39:52.065114 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 31 12:39:52.065114 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 31 12:39:52.065114 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 31 12:39:52.065114 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 31 12:39:52.065114 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 31 12:39:52.065114 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 31 12:39:52.065114 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 31 12:39:52.065114 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 31 12:39:52.065114 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 31 12:39:52.065114 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 31 12:39:52.065114 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 31 12:39:52.065114 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 31 12:39:52.065114 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 31 12:39:52.065114 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 31 12:39:52.065114 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 31 12:39:52.065114 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 31 12:39:52.065114 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 31 12:39:52.066250 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 31 12:39:52.066250 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 31 12:39:52.066250 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 31 12:39:52.066250 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 31 12:39:52.066250 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d261f1a2-1d79-4c3c-b3d2-c45cc0f1f9ec could not be found. Oct 31 12:39:52.066250 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Oct 31 12:39:52.066250 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 12:39:52.066250 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Oct 31 12:39:52.066250 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 12:39:52.066250 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 12:39:52.066250 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 12:39:52.066250 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 12:39:52.066250 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 12:39:52.066250 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 12:39:52.066250 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 12:39:52.066250 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 12:39:52.066250 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 12:39:52.066250 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 31 12:39:52.066250 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 12:39:52.067851 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d261f1a2-1d79-4c3c-b3d2-c45cc0f1f9ec could not be found. Oct 31 12:39:52.067851 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Oct 31 12:39:52.067851 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 12:39:52.067851 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Oct 31 12:39:52.067851 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 12:39:52.067851 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 12:39:52.067851 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 12:39:52.067851 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 12:39:52.067851 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 12:39:52.067851 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d261f1a2-1d79-4c3c-b3d2-c45cc0f1f9ec could not be found. Oct 31 12:39:52.067851 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Oct 31 12:39:52.067851 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-4389bf03-4db5-4152-b3c2-0dad996b85d8 tempest-VolumesNegativeTest-923536468 tempest-VolumesNegativeTest-923536468-project] Returning 404 to user: Volume d261f1a2-1d79-4c3c-b3d2-c45cc0f1f9ec could not be found. {{(pid=125441) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 12:39:52.067851 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-4389bf03-4db5-4152-b3c2-0dad996b85d8 tempest-VolumesNegativeTest-923536468 tempest-VolumesNegativeTest-923536468-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/d261f1a2-1d79-4c3c-b3d2-c45cc0f1f9ec" status: 404 len: 109 microversion: 2.1 time: 0.039824 Oct 31 12:39:52.067851 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 477/963] 10.222.0.15 () {58 vars in 1245 bytes} [Mon Oct 31 12:39:52 2022] GET /compute/v2.1/os-volumes/d261f1a2-1d79-4c3c-b3d2-c45cc0f1f9ec => generated 109 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 12:40:10.372184 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG dbcounter [-] [125440] Writing DB stats nova_api:SELECT=87,nova_api:UPDATE=2,nova_api:DELETE=2 {{(pid=125440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:40:10.372936 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG dbcounter [-] [125440] Writing DB stats nova_cell1:SELECT=43 {{(pid=125440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:40:10.378380 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-375487df-1651-4571-beb8-318b8024bd3a tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:40:10.380506 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-375487df-1651-4571-beb8-318b8024bd3a tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] [instance: b3800adf-8cae-407e-9a5e-9eb107bff58d] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:40:10.387959 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-375487df-1651-4571-beb8-318b8024bd3a tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:40:10.388435 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-375487df-1651-4571-beb8-318b8024bd3a tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:40:10.388864 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-375487df-1651-4571-beb8-318b8024bd3a tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:40:10.389548 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-375487df-1651-4571-beb8-318b8024bd3a tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:40:10.389996 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-375487df-1651-4571-beb8-318b8024bd3a tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:40:10.390412 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-375487df-1651-4571-beb8-318b8024bd3a tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:40:10.420595 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-375487df-1651-4571-beb8-318b8024bd3a tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] 10.222.0.15 "GET /compute/v2.1/servers/b3800adf-8cae-407e-9a5e-9eb107bff58d/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.049824 Oct 31 12:40:10.421158 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 487/964] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Oct 31 12:40:10 2022] GET /compute/v2.1/servers/b3800adf-8cae-407e-9a5e-9eb107bff58d/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:40:10.481230 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG dbcounter [-] [125441] Writing DB stats nova_api:SELECT=31 {{(pid=125441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:40:10.482378 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG dbcounter [-] [125441] Writing DB stats nova_cell1:SELECT=59,nova_cell1:INSERT=1 {{(pid=125441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:40:10.487786 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-9e16fa93-4c9c-4e86-955b-82448c004d66 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:40:10.488268 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-9e16fa93-4c9c-4e86-955b-82448c004d66 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] [instance: b3800adf-8cae-407e-9a5e-9eb107bff58d] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:40:10.495395 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-9e16fa93-4c9c-4e86-955b-82448c004d66 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:40:10.495875 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-9e16fa93-4c9c-4e86-955b-82448c004d66 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:40:10.496306 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-9e16fa93-4c9c-4e86-955b-82448c004d66 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:40:10.496993 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-9e16fa93-4c9c-4e86-955b-82448c004d66 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:40:10.497448 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-9e16fa93-4c9c-4e86-955b-82448c004d66 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:40:10.497869 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-9e16fa93-4c9c-4e86-955b-82448c004d66 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:40:10.523142 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-9e16fa93-4c9c-4e86-955b-82448c004d66 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] [instance: b3800adf-8cae-407e-9a5e-9eb107bff58d] Going to try to terminate instance {{(pid=125441) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 12:40:10.594766 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-9e16fa93-4c9c-4e86-955b-82448c004d66 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] 10.222.0.15 "DELETE /compute/v2.1/servers/b3800adf-8cae-407e-9a5e-9eb107bff58d" status: 204 len: 0 microversion: 2.20 time: 0.114643 Oct 31 12:40:10.595561 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 478/965] 10.222.0.15 () {60 vars in 1280 bytes} [Mon Oct 31 12:40:10 2022] DELETE /compute/v2.1/servers/b3800adf-8cae-407e-9a5e-9eb107bff58d => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 31 12:40:10.604207 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-9eced88c-f6ad-49e4-bbce-121d42722bd2 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:40:10.604643 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-9eced88c-f6ad-49e4-bbce-121d42722bd2 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] [instance: b3800adf-8cae-407e-9a5e-9eb107bff58d] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:40:10.610529 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-9eced88c-f6ad-49e4-bbce-121d42722bd2 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:40:10.611002 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-9eced88c-f6ad-49e4-bbce-121d42722bd2 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:40:10.611467 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-9eced88c-f6ad-49e4-bbce-121d42722bd2 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:40:10.612144 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-9eced88c-f6ad-49e4-bbce-121d42722bd2 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:40:10.612588 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-9eced88c-f6ad-49e4-bbce-121d42722bd2 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:40:10.613021 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-9eced88c-f6ad-49e4-bbce-121d42722bd2 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:40:10.748807 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-9eced88c-f6ad-49e4-bbce-121d42722bd2 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:40:10.756692 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-9eced88c-f6ad-49e4-bbce-121d42722bd2 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:40:10.758224 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-9eced88c-f6ad-49e4-bbce-121d42722bd2 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:40:10.759483 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-9eced88c-f6ad-49e4-bbce-121d42722bd2 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] 10.222.0.15 "GET /compute/v2.1/servers/b3800adf-8cae-407e-9a5e-9eb107bff58d" status: 200 len: 1724 microversion: 2.20 time: 0.159469 Oct 31 12:40:10.760091 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 488/966] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Oct 31 12:40:10 2022] GET /compute/v2.1/servers/b3800adf-8cae-407e-9a5e-9eb107bff58d => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 12:40:11.785622 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-15be804f-7e16-4923-b577-417b4881f570 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:40:11.786321 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-15be804f-7e16-4923-b577-417b4881f570 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] [instance: b3800adf-8cae-407e-9a5e-9eb107bff58d] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:40:11.793186 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-15be804f-7e16-4923-b577-417b4881f570 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:40:11.793663 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-15be804f-7e16-4923-b577-417b4881f570 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:40:11.794092 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-15be804f-7e16-4923-b577-417b4881f570 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:40:11.794773 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-15be804f-7e16-4923-b577-417b4881f570 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:40:11.795247 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-15be804f-7e16-4923-b577-417b4881f570 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:40:11.795665 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-15be804f-7e16-4923-b577-417b4881f570 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:40:11.923233 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-15be804f-7e16-4923-b577-417b4881f570 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:40:11.931120 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-15be804f-7e16-4923-b577-417b4881f570 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:40:11.933147 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-15be804f-7e16-4923-b577-417b4881f570 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:40:11.934291 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-15be804f-7e16-4923-b577-417b4881f570 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] 10.222.0.15 "GET /compute/v2.1/servers/b3800adf-8cae-407e-9a5e-9eb107bff58d" status: 200 len: 1724 microversion: 2.20 time: 0.152957 Oct 31 12:40:11.934842 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 479/967] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Oct 31 12:40:11 2022] GET /compute/v2.1/servers/b3800adf-8cae-407e-9a5e-9eb107bff58d => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 12:40:12.959571 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-9d1a85eb-b0ca-4ac6-b17c-57b942831b4c tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:40:12.960178 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-9d1a85eb-b0ca-4ac6-b17c-57b942831b4c tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] [instance: b3800adf-8cae-407e-9a5e-9eb107bff58d] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:40:12.966914 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-9d1a85eb-b0ca-4ac6-b17c-57b942831b4c tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:40:12.967426 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-9d1a85eb-b0ca-4ac6-b17c-57b942831b4c tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:40:12.967857 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-9d1a85eb-b0ca-4ac6-b17c-57b942831b4c tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:40:12.968551 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-9d1a85eb-b0ca-4ac6-b17c-57b942831b4c tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:40:12.968999 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-9d1a85eb-b0ca-4ac6-b17c-57b942831b4c tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:40:12.969413 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-9d1a85eb-b0ca-4ac6-b17c-57b942831b4c tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:40:13.055115 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-9d1a85eb-b0ca-4ac6-b17c-57b942831b4c tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:40:13.064751 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-9d1a85eb-b0ca-4ac6-b17c-57b942831b4c tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:40:13.066124 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-9d1a85eb-b0ca-4ac6-b17c-57b942831b4c tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6d1ace68aa84499a4929da60f3d71bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0eb090bf44403983e0cbb99e038321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:40:13.067329 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-9d1a85eb-b0ca-4ac6-b17c-57b942831b4c tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] 10.222.0.15 "GET /compute/v2.1/servers/b3800adf-8cae-407e-9a5e-9eb107bff58d" status: 200 len: 1656 microversion: 2.20 time: 0.111659 Oct 31 12:40:13.068116 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 489/968] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Oct 31 12:40:12 2022] GET /compute/v2.1/servers/b3800adf-8cae-407e-9a5e-9eb107bff58d => generated 1656 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 12:40:13.198683 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [req-3e6ea311-b30f-4238-8181-811ca025dda7 req-2a513066-fc0b-42f4-b49a-58b0303ff143 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3800adf-8cae-407e-9a5e-9eb107bff58d", "name": "network-vif-deleted", "tag": "360a1655-b233-4d4d-a557-dc89ddf2b18e"}]} {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 12:40:13.221472 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [req-3e6ea311-b30f-4238-8181-811ca025dda7 req-2a513066-fc0b-42f4-b49a-58b0303ff143 service nova] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:40:13.222030 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [req-3e6ea311-b30f-4238-8181-811ca025dda7 req-2a513066-fc0b-42f4-b49a-58b0303ff143 service nova] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:40:13.222458 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [req-3e6ea311-b30f-4238-8181-811ca025dda7 req-2a513066-fc0b-42f4-b49a-58b0303ff143 service nova] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:40:13.244258 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.compute.server_external_events [req-3e6ea311-b30f-4238-8181-811ca025dda7 req-2a513066-fc0b-42f4-b49a-58b0303ff143 service nova] Creating event network-vif-deleted:360a1655-b233-4d4d-a557-dc89ddf2b18e for instance b3800adf-8cae-407e-9a5e-9eb107bff58d on hv-cinder-79617 Oct 31 12:40:13.258005 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [req-3e6ea311-b30f-4238-8181-811ca025dda7 req-2a513066-fc0b-42f4-b49a-58b0303ff143 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063840 Oct 31 12:40:13.263409 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 480/969] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Oct 31 12:40:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 12:40:14.093344 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-9641b000-e36c-44e0-8374-e2341b692817 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:40:14.093967 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-9641b000-e36c-44e0-8374-e2341b692817 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] [instance: b3800adf-8cae-407e-9a5e-9eb107bff58d] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:40:14.100561 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-9641b000-e36c-44e0-8374-e2341b692817 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:40:14.101131 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-9641b000-e36c-44e0-8374-e2341b692817 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:40:14.101639 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-9641b000-e36c-44e0-8374-e2341b692817 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:40:14.102342 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-9641b000-e36c-44e0-8374-e2341b692817 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:40:14.103023 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-9641b000-e36c-44e0-8374-e2341b692817 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:40:14.104357 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-9641b000-e36c-44e0-8374-e2341b692817 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:40:14.125567 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.wsgi [None req-9641b000-e36c-44e0-8374-e2341b692817 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] HTTP exception thrown: Instance b3800adf-8cae-407e-9a5e-9eb107bff58d could not be found. Oct 31 12:40:14.127154 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-9641b000-e36c-44e0-8374-e2341b692817 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Request method failure captured: Oct 31 12:40:14.127154 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: request: GET /compute/v2.1/servers/b3800adf-8cae-407e-9a5e-9eb107bff58d HTTP/1.1 Oct 31 12:40:14.127154 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: Accept: application/json Oct 31 12:40:14.127154 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: Accept-Encoding: identity Oct 31 12:40:14.127154 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: Connection: close Oct 31 12:40:14.127154 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: Content-Length: 0 Oct 31 12:40:14.127154 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: Content-Type: application/json Oct 31 12:40:14.127154 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: Host: 10.222.0.15 Oct 31 12:40:14.127154 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: Openstack-System-Scope: None Oct 31 12:40:14.127154 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: User-Agent: python-urllib3/1.26.12 Oct 31 12:40:14.127154 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Auth-Token: gAAAAABjX8CAU-Z6rmTsOadbZ2-kygEvrKOAHC9p8QgbouuWspxvwvMw4rWKAxJEbLtzWEG5yT7mVZ5UZMVzhCA5u4L3XKKTnX7SSzRf0Pj2uxTByGhUnpS30ozcS7GtmDrKy6KDxXpkjjdIKR3RiXYqFb6liM6ngLcSsgOpnWm5p5T4R3bwl60 Oct 31 12:40:14.127154 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Domain-Id: None Oct 31 12:40:14.127154 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Domain-Name: None Oct 31 12:40:14.127154 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Identity-Status: Confirmed Oct 31 12:40:14.127154 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Is-Admin-Project: True Oct 31 12:40:14.127154 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Openstack-Nova-Api-Version: 2.20 Oct 31 12:40:14.127154 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Project-Domain-Id: default Oct 31 12:40:14.127154 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Project-Domain-Name: Default Oct 31 12:40:14.127154 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Project-Id: de0eb090bf44403983e0cbb99e038321 Oct 31 12:40:14.127154 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-192762088 Oct 31 12:40:14.127154 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Role: reader,member Oct 31 12:40:14.127154 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Roles: reader,member Oct 31 12:40:14.128980 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/de0eb090bf44403983e0cbb99e038321"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_de0eb090bf44403983e0cbb99e038321", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/de0eb090bf44403983e0cbb99e038321"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/de0eb090bf44403983e0cbb99e038321"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Oct 31 12:40:14.128980 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Tenant: tempest-AttachVolumeShelveTestJSON-192762088 Oct 31 12:40:14.128980 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Tenant-Id: de0eb090bf44403983e0cbb99e038321 Oct 31 12:40:14.128980 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-192762088 Oct 31 12:40:14.128980 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-User: tempest-AttachVolumeShelveTestJSON-192762088-project Oct 31 12:40:14.128980 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-User-Domain-Id: default Oct 31 12:40:14.128980 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-User-Domain-Name: Default Oct 31 12:40:14.128980 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-User-Id: a6d1ace68aa84499a4929da60f3d71bf Oct 31 12:40:14.128980 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-User-Name: tempest-AttachVolumeShelveTestJSON-192762088-project Oct 31 12:40:14.128980 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: method: > Oct 31 12:40:14.128980 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: exception: Instance b3800adf-8cae-407e-9a5e-9eb107bff58d could not be found. Oct 31 12:40:14.128980 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: action_args: {'id': 'b3800adf-8cae-407e-9a5e-9eb107bff58d'} Oct 31 12:40:14.130089 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 12:40:14.130089 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 12:40:14.130089 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 12:40:14.130089 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 12:40:14.130089 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 12:40:14.130089 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 12:40:14.130089 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 12:40:14.130089 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 12:40:14.130089 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 12:40:14.130089 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 12:40:14.130089 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b3800adf-8cae-407e-9a5e-9eb107bff58d could not be found. Oct 31 12:40:14.130089 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Oct 31 12:40:14.130089 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 12:40:14.130089 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Oct 31 12:40:14.130089 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 12:40:14.130089 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 12:40:14.130089 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 12:40:14.130089 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 12:40:14.130089 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 12:40:14.130089 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 12:40:14.131388 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 12:40:14.131388 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 12:40:14.131388 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 12:40:14.131388 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 12:40:14.131388 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 12:40:14.131388 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 12:40:14.131388 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 12:40:14.131388 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b3800adf-8cae-407e-9a5e-9eb107bff58d could not be found. Oct 31 12:40:14.131388 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Oct 31 12:40:14.131388 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 12:40:14.131388 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Oct 31 12:40:14.131388 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 12:40:14.131388 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 12:40:14.131388 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 12:40:14.131388 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 12:40:14.131388 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 12:40:14.131388 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b3800adf-8cae-407e-9a5e-9eb107bff58d could not be found. Oct 31 12:40:14.131388 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Oct 31 12:40:14.133506 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-9641b000-e36c-44e0-8374-e2341b692817 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Returning 404 to user: Instance b3800adf-8cae-407e-9a5e-9eb107bff58d could not be found. {{(pid=125440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 12:40:14.133506 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-9641b000-e36c-44e0-8374-e2341b692817 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] 10.222.0.15 "GET /compute/v2.1/servers/b3800adf-8cae-407e-9a5e-9eb107bff58d" status: 404 len: 111 microversion: 2.20 time: 0.039282 Oct 31 12:40:14.133506 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 490/970] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Oct 31 12:40:14 2022] GET /compute/v2.1/servers/b3800adf-8cae-407e-9a5e-9eb107bff58d => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 31 12:40:14.138729 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-d2246d9f-8376-4cc9-b524-713c3dc237a9 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Calling method '.version_select at 0x7f2aa5022670>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:40:14.168325 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-d2246d9f-8376-4cc9-b524-713c3dc237a9 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1803472968" status: 204 len: 0 microversion: 2.20 time: 0.034202 Oct 31 12:40:14.169492 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 481/971] 10.222.0.15 () {60 vars in 1262 bytes} [Mon Oct 31 12:40:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1803472968 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 31 12:40:16.051708 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-5cf54dda-fd03-4888-83ac-a68e5f9f7704 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:40:16.052230 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-5cf54dda-fd03-4888-83ac-a68e5f9f7704 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] [instance: b3800adf-8cae-407e-9a5e-9eb107bff58d] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:40:16.058435 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-5cf54dda-fd03-4888-83ac-a68e5f9f7704 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:40:16.058912 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-5cf54dda-fd03-4888-83ac-a68e5f9f7704 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:40:16.059373 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-5cf54dda-fd03-4888-83ac-a68e5f9f7704 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:40:16.060146 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-5cf54dda-fd03-4888-83ac-a68e5f9f7704 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:40:16.060713 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-5cf54dda-fd03-4888-83ac-a68e5f9f7704 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:40:16.061114 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-5cf54dda-fd03-4888-83ac-a68e5f9f7704 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:40:16.075651 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.wsgi [None req-5cf54dda-fd03-4888-83ac-a68e5f9f7704 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] HTTP exception thrown: Instance b3800adf-8cae-407e-9a5e-9eb107bff58d could not be found. Oct 31 12:40:16.077213 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-5cf54dda-fd03-4888-83ac-a68e5f9f7704 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Request method failure captured: Oct 31 12:40:16.077213 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: request: DELETE /compute/v2.1/servers/b3800adf-8cae-407e-9a5e-9eb107bff58d HTTP/1.1 Oct 31 12:40:16.077213 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: Accept: application/json Oct 31 12:40:16.077213 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: Accept-Encoding: identity Oct 31 12:40:16.077213 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: Connection: close Oct 31 12:40:16.077213 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: Content-Length: 0 Oct 31 12:40:16.077213 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: Content-Type: application/json Oct 31 12:40:16.077213 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: Host: 10.222.0.15 Oct 31 12:40:16.077213 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: Openstack-System-Scope: None Oct 31 12:40:16.077213 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: User-Agent: python-urllib3/1.26.12 Oct 31 12:40:16.077213 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Auth-Token: gAAAAABjX8CAU-Z6rmTsOadbZ2-kygEvrKOAHC9p8QgbouuWspxvwvMw4rWKAxJEbLtzWEG5yT7mVZ5UZMVzhCA5u4L3XKKTnX7SSzRf0Pj2uxTByGhUnpS30ozcS7GtmDrKy6KDxXpkjjdIKR3RiXYqFb6liM6ngLcSsgOpnWm5p5T4R3bwl60 Oct 31 12:40:16.077213 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Domain-Id: None Oct 31 12:40:16.077213 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Domain-Name: None Oct 31 12:40:16.077213 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Identity-Status: Confirmed Oct 31 12:40:16.077213 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Is-Admin-Project: True Oct 31 12:40:16.077213 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Openstack-Nova-Api-Version: 2.20 Oct 31 12:40:16.077213 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Project-Domain-Id: default Oct 31 12:40:16.077213 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Project-Domain-Name: Default Oct 31 12:40:16.077213 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Project-Id: de0eb090bf44403983e0cbb99e038321 Oct 31 12:40:16.077213 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-192762088 Oct 31 12:40:16.077213 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Role: reader,member Oct 31 12:40:16.077213 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Roles: reader,member Oct 31 12:40:16.079198 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/de0eb090bf44403983e0cbb99e038321"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_de0eb090bf44403983e0cbb99e038321", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/de0eb090bf44403983e0cbb99e038321"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/de0eb090bf44403983e0cbb99e038321"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Oct 31 12:40:16.079198 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Tenant: tempest-AttachVolumeShelveTestJSON-192762088 Oct 31 12:40:16.079198 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Tenant-Id: de0eb090bf44403983e0cbb99e038321 Oct 31 12:40:16.079198 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-192762088 Oct 31 12:40:16.079198 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-User: tempest-AttachVolumeShelveTestJSON-192762088-project Oct 31 12:40:16.079198 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-User-Domain-Id: default Oct 31 12:40:16.079198 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-User-Domain-Name: Default Oct 31 12:40:16.079198 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-User-Id: a6d1ace68aa84499a4929da60f3d71bf Oct 31 12:40:16.079198 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-User-Name: tempest-AttachVolumeShelveTestJSON-192762088-project Oct 31 12:40:16.079198 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: method: > Oct 31 12:40:16.079198 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: exception: Instance b3800adf-8cae-407e-9a5e-9eb107bff58d could not be found. Oct 31 12:40:16.079198 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: action_args: {'id': 'b3800adf-8cae-407e-9a5e-9eb107bff58d'} Oct 31 12:40:16.083244 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 12:40:16.083244 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 12:40:16.083244 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 12:40:16.083244 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 12:40:16.083244 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 12:40:16.083244 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 12:40:16.083244 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 12:40:16.083244 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 12:40:16.083244 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 12:40:16.083244 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 12:40:16.083244 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b3800adf-8cae-407e-9a5e-9eb107bff58d could not be found. Oct 31 12:40:16.083244 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Oct 31 12:40:16.083244 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 12:40:16.083244 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Oct 31 12:40:16.083244 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 12:40:16.083244 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 12:40:16.083244 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 12:40:16.083244 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 12:40:16.083244 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 12:40:16.083244 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 12:40:16.084866 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 12:40:16.084866 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 31 12:40:16.084866 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 31 12:40:16.084866 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 31 12:40:16.084866 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 31 12:40:16.084866 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 12:40:16.084866 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 12:40:16.084866 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 12:40:16.084866 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 12:40:16.084866 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b3800adf-8cae-407e-9a5e-9eb107bff58d could not be found. Oct 31 12:40:16.084866 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Oct 31 12:40:16.084866 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 12:40:16.084866 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Oct 31 12:40:16.084866 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 12:40:16.084866 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 12:40:16.084866 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 12:40:16.084866 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 12:40:16.084866 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 12:40:16.084866 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b3800adf-8cae-407e-9a5e-9eb107bff58d could not be found. Oct 31 12:40:16.084866 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Oct 31 12:40:16.086426 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-5cf54dda-fd03-4888-83ac-a68e5f9f7704 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Returning 404 to user: Instance b3800adf-8cae-407e-9a5e-9eb107bff58d could not be found. {{(pid=125440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 12:40:16.086426 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-5cf54dda-fd03-4888-83ac-a68e5f9f7704 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] 10.222.0.15 "DELETE /compute/v2.1/servers/b3800adf-8cae-407e-9a5e-9eb107bff58d" status: 404 len: 111 microversion: 2.20 time: 0.031367 Oct 31 12:40:16.086426 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 491/972] 10.222.0.15 () {60 vars in 1280 bytes} [Mon Oct 31 12:40:16 2022] DELETE /compute/v2.1/servers/b3800adf-8cae-407e-9a5e-9eb107bff58d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 31 12:40:16.093999 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-a56df0f5-1abc-45d0-8a2c-ac252385ab75 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:40:16.095084 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-a56df0f5-1abc-45d0-8a2c-ac252385ab75 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] [instance: b3800adf-8cae-407e-9a5e-9eb107bff58d] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:40:16.103885 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-a56df0f5-1abc-45d0-8a2c-ac252385ab75 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:40:16.104448 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-a56df0f5-1abc-45d0-8a2c-ac252385ab75 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:40:16.105162 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-a56df0f5-1abc-45d0-8a2c-ac252385ab75 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:40:16.105931 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-a56df0f5-1abc-45d0-8a2c-ac252385ab75 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:40:16.106452 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-a56df0f5-1abc-45d0-8a2c-ac252385ab75 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:40:16.106937 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-a56df0f5-1abc-45d0-8a2c-ac252385ab75 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:40:16.124180 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.wsgi [None req-a56df0f5-1abc-45d0-8a2c-ac252385ab75 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] HTTP exception thrown: Instance b3800adf-8cae-407e-9a5e-9eb107bff58d could not be found. Oct 31 12:40:16.125965 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-a56df0f5-1abc-45d0-8a2c-ac252385ab75 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Request method failure captured: Oct 31 12:40:16.125965 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: request: GET /compute/v2.1/servers/b3800adf-8cae-407e-9a5e-9eb107bff58d HTTP/1.1 Oct 31 12:40:16.125965 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: Accept: application/json Oct 31 12:40:16.125965 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: Accept-Encoding: identity Oct 31 12:40:16.125965 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: Connection: close Oct 31 12:40:16.125965 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: Content-Length: 0 Oct 31 12:40:16.125965 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: Content-Type: application/json Oct 31 12:40:16.125965 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: Host: 10.222.0.15 Oct 31 12:40:16.125965 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: Openstack-System-Scope: None Oct 31 12:40:16.125965 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: User-Agent: python-urllib3/1.26.12 Oct 31 12:40:16.125965 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Auth-Token: gAAAAABjX8CAU-Z6rmTsOadbZ2-kygEvrKOAHC9p8QgbouuWspxvwvMw4rWKAxJEbLtzWEG5yT7mVZ5UZMVzhCA5u4L3XKKTnX7SSzRf0Pj2uxTByGhUnpS30ozcS7GtmDrKy6KDxXpkjjdIKR3RiXYqFb6liM6ngLcSsgOpnWm5p5T4R3bwl60 Oct 31 12:40:16.125965 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Domain-Id: None Oct 31 12:40:16.125965 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Domain-Name: None Oct 31 12:40:16.125965 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Identity-Status: Confirmed Oct 31 12:40:16.125965 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Is-Admin-Project: True Oct 31 12:40:16.125965 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Openstack-Nova-Api-Version: 2.20 Oct 31 12:40:16.125965 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Project-Domain-Id: default Oct 31 12:40:16.125965 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Project-Domain-Name: Default Oct 31 12:40:16.125965 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Project-Id: de0eb090bf44403983e0cbb99e038321 Oct 31 12:40:16.125965 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-192762088 Oct 31 12:40:16.125965 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Role: reader,member Oct 31 12:40:16.125965 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Roles: reader,member Oct 31 12:40:16.127761 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/de0eb090bf44403983e0cbb99e038321"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_de0eb090bf44403983e0cbb99e038321", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/de0eb090bf44403983e0cbb99e038321"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/de0eb090bf44403983e0cbb99e038321"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Oct 31 12:40:16.127761 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Tenant: tempest-AttachVolumeShelveTestJSON-192762088 Oct 31 12:40:16.127761 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Tenant-Id: de0eb090bf44403983e0cbb99e038321 Oct 31 12:40:16.127761 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-192762088 Oct 31 12:40:16.127761 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-User: tempest-AttachVolumeShelveTestJSON-192762088-project Oct 31 12:40:16.127761 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-User-Domain-Id: default Oct 31 12:40:16.127761 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-User-Domain-Name: Default Oct 31 12:40:16.127761 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-User-Id: a6d1ace68aa84499a4929da60f3d71bf Oct 31 12:40:16.127761 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-User-Name: tempest-AttachVolumeShelveTestJSON-192762088-project Oct 31 12:40:16.127761 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: method: > Oct 31 12:40:16.127761 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: exception: Instance b3800adf-8cae-407e-9a5e-9eb107bff58d could not be found. Oct 31 12:40:16.127761 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: action_args: {'id': 'b3800adf-8cae-407e-9a5e-9eb107bff58d'} Oct 31 12:40:16.128783 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 12:40:16.128783 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 12:40:16.128783 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 12:40:16.128783 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 12:40:16.128783 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 12:40:16.128783 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 12:40:16.128783 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 12:40:16.128783 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 12:40:16.128783 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 12:40:16.128783 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 12:40:16.128783 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b3800adf-8cae-407e-9a5e-9eb107bff58d could not be found. Oct 31 12:40:16.128783 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Oct 31 12:40:16.128783 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 12:40:16.128783 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Oct 31 12:40:16.128783 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 12:40:16.128783 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 12:40:16.128783 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 12:40:16.128783 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 12:40:16.128783 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 12:40:16.128783 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 12:40:16.133265 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 12:40:16.133265 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 12:40:16.133265 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 12:40:16.133265 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 12:40:16.133265 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 12:40:16.133265 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 12:40:16.133265 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 12:40:16.133265 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b3800adf-8cae-407e-9a5e-9eb107bff58d could not be found. Oct 31 12:40:16.133265 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Oct 31 12:40:16.133265 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 12:40:16.133265 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Oct 31 12:40:16.133265 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 12:40:16.133265 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 12:40:16.133265 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 12:40:16.133265 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 12:40:16.133265 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 12:40:16.133265 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b3800adf-8cae-407e-9a5e-9eb107bff58d could not be found. Oct 31 12:40:16.133265 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Oct 31 12:40:16.135152 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-a56df0f5-1abc-45d0-8a2c-ac252385ab75 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Returning 404 to user: Instance b3800adf-8cae-407e-9a5e-9eb107bff58d could not be found. {{(pid=125441) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 12:40:16.135152 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-a56df0f5-1abc-45d0-8a2c-ac252385ab75 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] 10.222.0.15 "GET /compute/v2.1/servers/b3800adf-8cae-407e-9a5e-9eb107bff58d" status: 404 len: 111 microversion: 2.20 time: 0.042941 Oct 31 12:40:16.135152 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 482/973] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Oct 31 12:40:16 2022] GET /compute/v2.1/servers/b3800adf-8cae-407e-9a5e-9eb107bff58d => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 31 12:40:17.287289 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-e24e2e0d-1564-4b62-a96f-d32c47325444 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:40:17.287794 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-e24e2e0d-1564-4b62-a96f-d32c47325444 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] [instance: 852e8870-b3ec-4a21-a9b5-e31a423ddd3d] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:40:17.294363 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-e24e2e0d-1564-4b62-a96f-d32c47325444 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:40:17.294842 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-e24e2e0d-1564-4b62-a96f-d32c47325444 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:40:17.295307 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-e24e2e0d-1564-4b62-a96f-d32c47325444 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:40:17.295996 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-e24e2e0d-1564-4b62-a96f-d32c47325444 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:40:17.296444 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-e24e2e0d-1564-4b62-a96f-d32c47325444 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:40:17.296863 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-e24e2e0d-1564-4b62-a96f-d32c47325444 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:40:17.310099 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.wsgi [None req-e24e2e0d-1564-4b62-a96f-d32c47325444 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] HTTP exception thrown: Instance 852e8870-b3ec-4a21-a9b5-e31a423ddd3d could not be found. Oct 31 12:40:17.311710 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-e24e2e0d-1564-4b62-a96f-d32c47325444 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Request method failure captured: Oct 31 12:40:17.311710 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: request: DELETE /compute/v2.1/servers/852e8870-b3ec-4a21-a9b5-e31a423ddd3d HTTP/1.1 Oct 31 12:40:17.311710 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: Accept: application/json Oct 31 12:40:17.311710 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: Accept-Encoding: identity Oct 31 12:40:17.311710 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: Connection: close Oct 31 12:40:17.311710 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: Content-Length: 0 Oct 31 12:40:17.311710 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: Content-Type: application/json Oct 31 12:40:17.311710 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: Host: 10.222.0.15 Oct 31 12:40:17.311710 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: Openstack-System-Scope: None Oct 31 12:40:17.311710 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: User-Agent: python-urllib3/1.26.12 Oct 31 12:40:17.311710 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Auth-Token: gAAAAABjX8CAU-Z6rmTsOadbZ2-kygEvrKOAHC9p8QgbouuWspxvwvMw4rWKAxJEbLtzWEG5yT7mVZ5UZMVzhCA5u4L3XKKTnX7SSzRf0Pj2uxTByGhUnpS30ozcS7GtmDrKy6KDxXpkjjdIKR3RiXYqFb6liM6ngLcSsgOpnWm5p5T4R3bwl60 Oct 31 12:40:17.311710 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Domain-Id: None Oct 31 12:40:17.311710 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Domain-Name: None Oct 31 12:40:17.311710 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Identity-Status: Confirmed Oct 31 12:40:17.311710 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Is-Admin-Project: True Oct 31 12:40:17.311710 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Openstack-Nova-Api-Version: 2.20 Oct 31 12:40:17.311710 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Project-Domain-Id: default Oct 31 12:40:17.311710 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Project-Domain-Name: Default Oct 31 12:40:17.311710 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Project-Id: de0eb090bf44403983e0cbb99e038321 Oct 31 12:40:17.311710 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-192762088 Oct 31 12:40:17.311710 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Role: reader,member Oct 31 12:40:17.311710 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Roles: reader,member Oct 31 12:40:17.313395 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/de0eb090bf44403983e0cbb99e038321"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_de0eb090bf44403983e0cbb99e038321", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/de0eb090bf44403983e0cbb99e038321"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/de0eb090bf44403983e0cbb99e038321"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Oct 31 12:40:17.313395 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Tenant: tempest-AttachVolumeShelveTestJSON-192762088 Oct 31 12:40:17.313395 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Tenant-Id: de0eb090bf44403983e0cbb99e038321 Oct 31 12:40:17.313395 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-192762088 Oct 31 12:40:17.313395 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-User: tempest-AttachVolumeShelveTestJSON-192762088-project Oct 31 12:40:17.313395 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-User-Domain-Id: default Oct 31 12:40:17.313395 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-User-Domain-Name: Default Oct 31 12:40:17.313395 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-User-Id: a6d1ace68aa84499a4929da60f3d71bf Oct 31 12:40:17.313395 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-User-Name: tempest-AttachVolumeShelveTestJSON-192762088-project Oct 31 12:40:17.313395 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: method: > Oct 31 12:40:17.313395 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: exception: Instance 852e8870-b3ec-4a21-a9b5-e31a423ddd3d could not be found. Oct 31 12:40:17.313395 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: action_args: {'id': '852e8870-b3ec-4a21-a9b5-e31a423ddd3d'} Oct 31 12:40:17.314343 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 12:40:17.314343 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 12:40:17.314343 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 12:40:17.314343 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 12:40:17.314343 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 12:40:17.314343 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 12:40:17.314343 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 12:40:17.314343 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 12:40:17.314343 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 12:40:17.314343 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 12:40:17.314343 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 852e8870-b3ec-4a21-a9b5-e31a423ddd3d could not be found. Oct 31 12:40:17.314343 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Oct 31 12:40:17.314343 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 12:40:17.314343 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Oct 31 12:40:17.314343 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 12:40:17.314343 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 12:40:17.314343 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 12:40:17.314343 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 12:40:17.314343 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 12:40:17.314343 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 12:40:17.315917 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 12:40:17.315917 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 31 12:40:17.315917 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 31 12:40:17.315917 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 31 12:40:17.315917 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 31 12:40:17.315917 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 12:40:17.315917 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 12:40:17.315917 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 12:40:17.315917 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 12:40:17.315917 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 852e8870-b3ec-4a21-a9b5-e31a423ddd3d could not be found. Oct 31 12:40:17.315917 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Oct 31 12:40:17.315917 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 12:40:17.315917 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Oct 31 12:40:17.315917 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 12:40:17.315917 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 12:40:17.315917 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 12:40:17.315917 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 12:40:17.315917 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 12:40:17.315917 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 852e8870-b3ec-4a21-a9b5-e31a423ddd3d could not be found. Oct 31 12:40:17.315917 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Oct 31 12:40:17.317514 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-e24e2e0d-1564-4b62-a96f-d32c47325444 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Returning 404 to user: Instance 852e8870-b3ec-4a21-a9b5-e31a423ddd3d could not be found. {{(pid=125440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 12:40:17.317514 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-e24e2e0d-1564-4b62-a96f-d32c47325444 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] 10.222.0.15 "DELETE /compute/v2.1/servers/852e8870-b3ec-4a21-a9b5-e31a423ddd3d" status: 404 len: 111 microversion: 2.20 time: 0.029781 Oct 31 12:40:17.317514 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 492/974] 10.222.0.15 () {60 vars in 1280 bytes} [Mon Oct 31 12:40:17 2022] DELETE /compute/v2.1/servers/852e8870-b3ec-4a21-a9b5-e31a423ddd3d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 31 12:40:17.321466 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-fd0631a8-5c9d-4983-92e9-4bcfff3380f6 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:40:17.322929 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-fd0631a8-5c9d-4983-92e9-4bcfff3380f6 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] [instance: 852e8870-b3ec-4a21-a9b5-e31a423ddd3d] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:40:17.329337 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-fd0631a8-5c9d-4983-92e9-4bcfff3380f6 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:40:17.329813 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-fd0631a8-5c9d-4983-92e9-4bcfff3380f6 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:40:17.330243 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-fd0631a8-5c9d-4983-92e9-4bcfff3380f6 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:40:17.330927 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-fd0631a8-5c9d-4983-92e9-4bcfff3380f6 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:40:17.331416 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-fd0631a8-5c9d-4983-92e9-4bcfff3380f6 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:40:17.331834 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-fd0631a8-5c9d-4983-92e9-4bcfff3380f6 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:40:17.349775 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.wsgi [None req-fd0631a8-5c9d-4983-92e9-4bcfff3380f6 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] HTTP exception thrown: Instance 852e8870-b3ec-4a21-a9b5-e31a423ddd3d could not be found. Oct 31 12:40:17.351337 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-fd0631a8-5c9d-4983-92e9-4bcfff3380f6 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Request method failure captured: Oct 31 12:40:17.351337 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: request: GET /compute/v2.1/servers/852e8870-b3ec-4a21-a9b5-e31a423ddd3d HTTP/1.1 Oct 31 12:40:17.351337 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: Accept: application/json Oct 31 12:40:17.351337 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: Accept-Encoding: identity Oct 31 12:40:17.351337 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: Connection: close Oct 31 12:40:17.351337 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: Content-Length: 0 Oct 31 12:40:17.351337 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: Content-Type: application/json Oct 31 12:40:17.351337 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: Host: 10.222.0.15 Oct 31 12:40:17.351337 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: Openstack-System-Scope: None Oct 31 12:40:17.351337 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: User-Agent: python-urllib3/1.26.12 Oct 31 12:40:17.351337 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Auth-Token: gAAAAABjX8CAU-Z6rmTsOadbZ2-kygEvrKOAHC9p8QgbouuWspxvwvMw4rWKAxJEbLtzWEG5yT7mVZ5UZMVzhCA5u4L3XKKTnX7SSzRf0Pj2uxTByGhUnpS30ozcS7GtmDrKy6KDxXpkjjdIKR3RiXYqFb6liM6ngLcSsgOpnWm5p5T4R3bwl60 Oct 31 12:40:17.351337 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Domain-Id: None Oct 31 12:40:17.351337 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Domain-Name: None Oct 31 12:40:17.351337 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Identity-Status: Confirmed Oct 31 12:40:17.351337 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Is-Admin-Project: True Oct 31 12:40:17.351337 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Openstack-Nova-Api-Version: 2.20 Oct 31 12:40:17.351337 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Project-Domain-Id: default Oct 31 12:40:17.351337 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Project-Domain-Name: Default Oct 31 12:40:17.351337 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Project-Id: de0eb090bf44403983e0cbb99e038321 Oct 31 12:40:17.351337 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-192762088 Oct 31 12:40:17.351337 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Role: reader,member Oct 31 12:40:17.351337 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Roles: reader,member Oct 31 12:40:17.353027 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/de0eb090bf44403983e0cbb99e038321"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_de0eb090bf44403983e0cbb99e038321", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/de0eb090bf44403983e0cbb99e038321"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/de0eb090bf44403983e0cbb99e038321"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Oct 31 12:40:17.353027 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Tenant: tempest-AttachVolumeShelveTestJSON-192762088 Oct 31 12:40:17.353027 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Tenant-Id: de0eb090bf44403983e0cbb99e038321 Oct 31 12:40:17.353027 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-192762088 Oct 31 12:40:17.353027 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-User: tempest-AttachVolumeShelveTestJSON-192762088-project Oct 31 12:40:17.353027 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-User-Domain-Id: default Oct 31 12:40:17.353027 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-User-Domain-Name: Default Oct 31 12:40:17.353027 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-User-Id: a6d1ace68aa84499a4929da60f3d71bf Oct 31 12:40:17.353027 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-User-Name: tempest-AttachVolumeShelveTestJSON-192762088-project Oct 31 12:40:17.353027 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: method: > Oct 31 12:40:17.353027 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: exception: Instance 852e8870-b3ec-4a21-a9b5-e31a423ddd3d could not be found. Oct 31 12:40:17.353027 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: action_args: {'id': '852e8870-b3ec-4a21-a9b5-e31a423ddd3d'} Oct 31 12:40:17.354131 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 12:40:17.354131 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 12:40:17.354131 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 12:40:17.354131 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 12:40:17.354131 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 12:40:17.354131 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 12:40:17.354131 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 12:40:17.354131 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 12:40:17.354131 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 12:40:17.354131 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 12:40:17.354131 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 852e8870-b3ec-4a21-a9b5-e31a423ddd3d could not be found. Oct 31 12:40:17.354131 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Oct 31 12:40:17.354131 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 12:40:17.354131 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Oct 31 12:40:17.354131 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 12:40:17.354131 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 12:40:17.354131 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 12:40:17.354131 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 12:40:17.354131 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 12:40:17.354131 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 12:40:17.355610 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 12:40:17.355610 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 12:40:17.355610 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 12:40:17.355610 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 12:40:17.355610 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 12:40:17.355610 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 12:40:17.355610 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 12:40:17.355610 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 852e8870-b3ec-4a21-a9b5-e31a423ddd3d could not be found. Oct 31 12:40:17.355610 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Oct 31 12:40:17.355610 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 12:40:17.355610 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Oct 31 12:40:17.355610 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 12:40:17.355610 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 12:40:17.355610 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 12:40:17.355610 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 12:40:17.355610 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 12:40:17.355610 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 852e8870-b3ec-4a21-a9b5-e31a423ddd3d could not be found. Oct 31 12:40:17.355610 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Oct 31 12:40:17.356918 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-fd0631a8-5c9d-4983-92e9-4bcfff3380f6 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] Returning 404 to user: Instance 852e8870-b3ec-4a21-a9b5-e31a423ddd3d could not be found. {{(pid=125441) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 12:40:17.356918 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-fd0631a8-5c9d-4983-92e9-4bcfff3380f6 tempest-AttachVolumeShelveTestJSON-192762088 tempest-AttachVolumeShelveTestJSON-192762088-project] 10.222.0.15 "GET /compute/v2.1/servers/852e8870-b3ec-4a21-a9b5-e31a423ddd3d" status: 404 len: 111 microversion: 2.20 time: 0.035121 Oct 31 12:40:17.356918 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 483/975] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Oct 31 12:40:17 2022] GET /compute/v2.1/servers/852e8870-b3ec-4a21-a9b5-e31a423ddd3d => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 31 12:40:25.588573 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-1968200d-e363-4178-97c0-f7330d777e59 tempest-VolumesTestJSON-461002105 tempest-VolumesTestJSON-461002105-project] Calling method '.version_select at 0x7f2aa88f2ca0>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:40:25.638412 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-1968200d-e363-4178-97c0-f7330d777e59 tempest-VolumesTestJSON-461002105 tempest-VolumesTestJSON-461002105-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/66a25296-9996-46a2-8629-5c489f6cb7d7" status: 200 len: 351 microversion: 2.1 time: 0.054137 Oct 31 12:40:25.639038 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 493/976] 10.222.0.15 () {58 vars in 1245 bytes} [Mon Oct 31 12:40:25 2022] GET /compute/v2.1/os-volumes/66a25296-9996-46a2-8629-5c489f6cb7d7 => generated 351 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 12:40:26.983345 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-4a2017e5-f1f6-4ed8-9c16-45b614d41a9c tempest-VolumesTestJSON-461002105 tempest-VolumesTestJSON-461002105-project] Calling method '.version_select at 0x7f2aa5022c10>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:40:27.033553 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-4a2017e5-f1f6-4ed8-9c16-45b614d41a9c tempest-VolumesTestJSON-461002105 tempest-VolumesTestJSON-461002105-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/29a64786-80ab-4e2f-8f11-3b2377bfc312" status: 200 len: 350 microversion: 2.1 time: 0.054004 Oct 31 12:40:27.034127 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 484/977] 10.222.0.15 () {58 vars in 1245 bytes} [Mon Oct 31 12:40:26 2022] GET /compute/v2.1/os-volumes/29a64786-80ab-4e2f-8f11-3b2377bfc312 => generated 350 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 12:40:28.371306 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG dbcounter [-] [125440] Writing DB stats nova_api:SELECT=12 {{(pid=125440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:40:28.372112 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG dbcounter [-] [125440] Writing DB stats nova_cell1:SELECT=24 {{(pid=125440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:40:28.376505 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-29fc72d6-1d7d-4d86-82d1-f7f2599f6f77 tempest-VolumesTestJSON-461002105 tempest-VolumesTestJSON-461002105-project] Calling method '.version_select at 0x7f2aa5314820>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:40:28.424179 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-29fc72d6-1d7d-4d86-82d1-f7f2599f6f77 tempest-VolumesTestJSON-461002105 tempest-VolumesTestJSON-461002105-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/622a061e-4a4d-470f-b4c8-baea293c433c" status: 200 len: 350 microversion: 2.1 time: 0.054143 Oct 31 12:40:28.424753 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 494/978] 10.222.0.15 () {58 vars in 1245 bytes} [Mon Oct 31 12:40:28 2022] GET /compute/v2.1/os-volumes/622a061e-4a4d-470f-b4c8-baea293c433c => generated 350 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 12:40:28.434534 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG dbcounter [-] [125441] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=125441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:40:28.435384 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG dbcounter [-] [125441] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:40:28.439642 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-6b550c64-5660-4895-8824-82c1750c6147 tempest-VolumesTestJSON-461002105 tempest-VolumesTestJSON-461002105-project] Calling method '.version_select at 0x7f2aa5111f70>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:40:28.528358 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-6b550c64-5660-4895-8824-82c1750c6147 tempest-VolumesTestJSON-461002105 tempest-VolumesTestJSON-461002105-project] 10.222.0.15 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.094503 Oct 31 12:40:28.528957 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 485/979] 10.222.0.15 () {58 vars in 1134 bytes} [Mon Oct 31 12:40:28 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:40:28.545867 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-65442419-6bc5-47d7-b9ab-2e0c006fc8b2 tempest-VolumesTestJSON-461002105 tempest-VolumesTestJSON-461002105-project] Calling method '.version_select at 0x7f2aa5076280>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:40:28.627679 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-65442419-6bc5-47d7-b9ab-2e0c006fc8b2 tempest-VolumesTestJSON-461002105 tempest-VolumesTestJSON-461002105-project] 10.222.0.15 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.086449 Oct 31 12:40:28.628244 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 495/980] 10.222.0.15 () {58 vars in 1149 bytes} [Mon Oct 31 12:40:28 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 12:40:28.641791 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-0e0b8a09-bee5-49f9-8fa7-18d84393ee7f tempest-VolumesTestJSON-461002105 tempest-VolumesTestJSON-461002105-project] Calling method '.version_select at 0x7f2aa51c7dc0>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:40:28.725376 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-0e0b8a09-bee5-49f9-8fa7-18d84393ee7f tempest-VolumesTestJSON-461002105 tempest-VolumesTestJSON-461002105-project] 10.222.0.15 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.087250 Oct 31 12:40:28.725948 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 486/981] 10.222.0.15 () {58 vars in 1134 bytes} [Mon Oct 31 12:40:28 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:40:28.739543 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-53929d50-2629-4b22-8b03-04f1441cb34f tempest-VolumesTestJSON-461002105 tempest-VolumesTestJSON-461002105-project] Calling method '.version_select at 0x7f2aa5219d30>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:40:28.822921 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-53929d50-2629-4b22-8b03-04f1441cb34f tempest-VolumesTestJSON-461002105 tempest-VolumesTestJSON-461002105-project] 10.222.0.15 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.087025 Oct 31 12:40:28.823926 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 496/982] 10.222.0.15 () {58 vars in 1167 bytes} [Mon Oct 31 12:40:28 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 12:40:28.837181 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-5a70603e-1872-4526-abbd-4679e00c01ee tempest-VolumesTestJSON-461002105 tempest-VolumesTestJSON-461002105-project] Calling method '.version_select at 0x7f2aa54e9310>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:40:28.925170 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-5a70603e-1872-4526-abbd-4679e00c01ee tempest-VolumesTestJSON-461002105 tempest-VolumesTestJSON-461002105-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.091687 Oct 31 12:40:28.925745 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 487/983] 10.222.0.15 () {58 vars in 1170 bytes} [Mon Oct 31 12:40:28 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 12:40:28.939879 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-34d01d4d-9e48-4ee3-8939-3e99e927b5d4 tempest-VolumesTestJSON-461002105 tempest-VolumesTestJSON-461002105-project] Calling method '.version_select at 0x7f2aa50dbd30>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:40:29.026254 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-34d01d4d-9e48-4ee3-8939-3e99e927b5d4 tempest-VolumesTestJSON-461002105 tempest-VolumesTestJSON-461002105-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.090126 Oct 31 12:40:29.027741 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 497/984] 10.222.0.15 () {58 vars in 1155 bytes} [Mon Oct 31 12:40:28 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:40:29.041382 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-a0cbf196-d276-43fa-8341-1c7dba9dda3e tempest-VolumesTestJSON-461002105 tempest-VolumesTestJSON-461002105-project] Calling method '.version_select at 0x7f2aa51113a0>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:40:29.133699 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-a0cbf196-d276-43fa-8341-1c7dba9dda3e tempest-VolumesTestJSON-461002105 tempest-VolumesTestJSON-461002105-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.096284 Oct 31 12:40:29.134272 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 488/985] 10.222.0.15 () {58 vars in 1188 bytes} [Mon Oct 31 12:40:29 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 12:40:29.150091 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-0b4f2a41-ee50-4107-b296-86a8a9302d33 tempest-VolumesTestJSON-461002105 tempest-VolumesTestJSON-461002105-project] Calling method '.version_select at 0x7f2aa51de430>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:40:29.238752 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-0b4f2a41-ee50-4107-b296-86a8a9302d33 tempest-VolumesTestJSON-461002105 tempest-VolumesTestJSON-461002105-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.092344 Oct 31 12:40:29.240500 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 498/986] 10.222.0.15 () {58 vars in 1155 bytes} [Mon Oct 31 12:40:29 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:41:20.684333 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-043fccc0-f620-492b-9755-7d541914ec21 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1344178637", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-899997443", "security_groups": [{"name": "tempest-secgroup-smoke-1289635870"}], "block_device_mapping_v2": [{"uuid": "e407ac3c-2176-4935-866b-a4fb2fac2b8c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "77732bf9-8ee2-480e-8cb2-0d5455add01d"}]}} {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 12:41:20.795292 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.network.neutron [None req-043fccc0-f620-492b-9755-7d541914ec21 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] validate_networks() for [('77732bf9-8ee2-480e-8cb2-0d5455add01d', None, None, None, None, None)] {{(pid=125441) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 12:41:21.158142 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.virt.hardware [None req-043fccc0-f620-492b-9755-7d541914ec21 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Flavor limits 0:0:0 {{(pid=125441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 12:41:21.158545 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.virt.hardware [None req-043fccc0-f620-492b-9755-7d541914ec21 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Image limits 0:0:0 {{(pid=125441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 12:41:21.159001 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.virt.hardware [None req-043fccc0-f620-492b-9755-7d541914ec21 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Flavor pref 0:0:0 {{(pid=125441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 12:41:21.159425 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.virt.hardware [None req-043fccc0-f620-492b-9755-7d541914ec21 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Image pref 0:0:0 {{(pid=125441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 12:41:21.159822 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.virt.hardware [None req-043fccc0-f620-492b-9755-7d541914ec21 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 12:41:21.168894 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-043fccc0-f620-492b-9755-7d541914ec21 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:41:21.169368 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-043fccc0-f620-492b-9755-7d541914ec21 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:41:21.169795 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-043fccc0-f620-492b-9755-7d541914ec21 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:41:21.170507 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-043fccc0-f620-492b-9755-7d541914ec21 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:41:21.170953 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-043fccc0-f620-492b-9755-7d541914ec21 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:41:21.171393 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-043fccc0-f620-492b-9755-7d541914ec21 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:41:21.189319 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.quota [None req-043fccc0-f620-492b-9755-7d541914ec21 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Getting quotas for project 8ae8c589d0b84ce096451a10717fc601. Resources: {'instances', 'cores', 'ram'} {{(pid=125441) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 12:41:21.193225 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.quota [None req-043fccc0-f620-492b-9755-7d541914ec21 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Getting quotas for user 49b76d81ee9446cf9014a2e695ef03e7 and project 8ae8c589d0b84ce096451a10717fc601. Resources: {'instances', 'cores', 'ram'} {{(pid=125441) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 12:41:21.248595 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-043fccc0-f620-492b-9755-7d541914ec21 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Going to run 1 instances... {{(pid=125441) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 12:41:21.250702 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-043fccc0-f620-492b-9755-7d541914ec21 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] [instance: 66820f24-a23a-4e02-a703-7c9832ffd729] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e407ac3c-2176-4935-866b-a4fb2fac2b8c',volume_size=None,volume_type=None)] {{(pid=125441) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 12:41:21.375708 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR oslo.messaging._drivers.impl_rabbit [None req-043fccc0-f620-492b-9755-7d541914ec21 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] [271067ff-c92e-4404-80d8-966a941226a3] AMQP server on 10.222.0.15:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 31 12:41:22.384713 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO oslo.messaging._drivers.impl_rabbit [None req-043fccc0-f620-492b-9755-7d541914ec21 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] [271067ff-c92e-4404-80d8-966a941226a3] Reconnected to AMQP server on 10.222.0.15:5672 via [amqp] client with port 54284. Oct 31 12:41:22.389074 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-043fccc0-f620-492b-9755-7d541914ec21 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.709512 Oct 31 12:41:22.389716 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 489/987] 10.222.0.15 () {60 vars in 1147 bytes} [Mon Oct 31 12:41:20 2022] POST /compute/v2.1/servers => generated 406 bytes in 1711 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 12:41:22.402817 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-582b9d3c-6a74-4fb2-8614-91fb07be0c46 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:41:22.403459 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-582b9d3c-6a74-4fb2-8614-91fb07be0c46 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] [instance: 66820f24-a23a-4e02-a703-7c9832ffd729] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:41:22.466276 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-582b9d3c-6a74-4fb2-8614-91fb07be0c46 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b76d81ee9446cf9014a2e695ef03e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae8c589d0b84ce096451a10717fc601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:41:22.474042 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-582b9d3c-6a74-4fb2-8614-91fb07be0c46 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] 10.222.0.15 "GET /compute/v2.1/servers/66820f24-a23a-4e02-a703-7c9832ffd729" status: 200 len: 1094 microversion: 2.1 time: 0.076276 Oct 31 12:41:22.474784 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 499/988] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:41:22 2022] GET /compute/v2.1/servers/66820f24-a23a-4e02-a703-7c9832ffd729 => generated 1094 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 12:41:23.500006 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-6780a902-f283-411d-97de-71b04916bf9b tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:41:23.500858 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-6780a902-f283-411d-97de-71b04916bf9b tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] [instance: 66820f24-a23a-4e02-a703-7c9832ffd729] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:41:23.563050 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-6780a902-f283-411d-97de-71b04916bf9b tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b76d81ee9446cf9014a2e695ef03e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae8c589d0b84ce096451a10717fc601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:41:23.570724 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-6780a902-f283-411d-97de-71b04916bf9b tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] 10.222.0.15 "GET /compute/v2.1/servers/66820f24-a23a-4e02-a703-7c9832ffd729" status: 200 len: 1094 microversion: 2.1 time: 0.075026 Oct 31 12:41:23.571345 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 490/989] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:41:23 2022] GET /compute/v2.1/servers/66820f24-a23a-4e02-a703-7c9832ffd729 => generated 1094 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:41:24.593293 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-cd79b02a-17da-4afa-8112-d3a11ec6ed37 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:41:24.593978 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-cd79b02a-17da-4afa-8112-d3a11ec6ed37 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] [instance: 66820f24-a23a-4e02-a703-7c9832ffd729] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:41:24.645961 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-cd79b02a-17da-4afa-8112-d3a11ec6ed37 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b76d81ee9446cf9014a2e695ef03e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae8c589d0b84ce096451a10717fc601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:41:24.653278 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-cd79b02a-17da-4afa-8112-d3a11ec6ed37 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] 10.222.0.15 "GET /compute/v2.1/servers/66820f24-a23a-4e02-a703-7c9832ffd729" status: 200 len: 1094 microversion: 2.1 time: 0.063925 Oct 31 12:41:24.653826 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 500/990] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:41:24 2022] GET /compute/v2.1/servers/66820f24-a23a-4e02-a703-7c9832ffd729 => generated 1094 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:41:24.917975 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-060efd60-83a7-4f35-8e84-dc758ad2e807 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-2119628453", "imageRef": "fbbea321-8f0d-4092-b070-b67a6931d610", "flavorRef": "452", "networks": [{"uuid": "b1c54bb5-5772-44f7-b3d3-caf7e007e1d6"}]}} {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 12:41:24.970173 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.network.neutron [None req-060efd60-83a7-4f35-8e84-dc758ad2e807 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] validate_networks() for [('b1c54bb5-5772-44f7-b3d3-caf7e007e1d6', None, None, None, None, None)] {{(pid=125441) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 12:41:25.312716 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.virt.hardware [None req-060efd60-83a7-4f35-8e84-dc758ad2e807 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Flavor limits 0:0:0 {{(pid=125441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 12:41:25.313165 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.virt.hardware [None req-060efd60-83a7-4f35-8e84-dc758ad2e807 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Image limits 0:0:0 {{(pid=125441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 12:41:25.313891 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.virt.hardware [None req-060efd60-83a7-4f35-8e84-dc758ad2e807 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Flavor pref 0:0:0 {{(pid=125441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 12:41:25.314300 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.virt.hardware [None req-060efd60-83a7-4f35-8e84-dc758ad2e807 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Image pref 0:0:0 {{(pid=125441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 12:41:25.314712 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.virt.hardware [None req-060efd60-83a7-4f35-8e84-dc758ad2e807 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 12:41:25.323607 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-060efd60-83a7-4f35-8e84-dc758ad2e807 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:41:25.324092 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-060efd60-83a7-4f35-8e84-dc758ad2e807 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:41:25.324518 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-060efd60-83a7-4f35-8e84-dc758ad2e807 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:41:25.325233 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-060efd60-83a7-4f35-8e84-dc758ad2e807 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:41:25.325683 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-060efd60-83a7-4f35-8e84-dc758ad2e807 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:41:25.326104 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-060efd60-83a7-4f35-8e84-dc758ad2e807 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:41:25.343017 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.quota [None req-060efd60-83a7-4f35-8e84-dc758ad2e807 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Getting quotas for project d49947a82d974a55a8cc7a6ad7b9c56e. Resources: {'instances', 'cores', 'ram'} {{(pid=125441) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 12:41:25.347458 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.quota [None req-060efd60-83a7-4f35-8e84-dc758ad2e807 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Getting quotas for user 77385d8c61994d5da4083775d202a93d and project d49947a82d974a55a8cc7a6ad7b9c56e. Resources: {'instances', 'cores', 'ram'} {{(pid=125441) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 12:41:25.358675 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-060efd60-83a7-4f35-8e84-dc758ad2e807 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Going to run 1 instances... {{(pid=125441) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 12:41:25.360933 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-060efd60-83a7-4f35-8e84-dc758ad2e807 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] [instance: 2e4b0eaa-4452-4b28-bb3d-3ff8ef63d973] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fbbea321-8f0d-4092-b070-b67a6931d610',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125441) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 12:41:25.407815 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-060efd60-83a7-4f35-8e84-dc758ad2e807 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.492946 Oct 31 12:41:25.408409 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 491/991] 10.222.0.15 () {60 vars in 1147 bytes} [Mon Oct 31 12:41:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 495 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 12:41:25.419493 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-e9efbf23-7e94-46cd-8055-143cb223ed1c tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:41:25.420104 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-e9efbf23-7e94-46cd-8055-143cb223ed1c tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] [instance: 2e4b0eaa-4452-4b28-bb3d-3ff8ef63d973] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:41:25.475510 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-e9efbf23-7e94-46cd-8055-143cb223ed1c tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77385d8c61994d5da4083775d202a93d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd49947a82d974a55a8cc7a6ad7b9c56e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:41:25.482530 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-e9efbf23-7e94-46cd-8055-143cb223ed1c tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] 10.222.0.15 "GET /compute/v2.1/servers/2e4b0eaa-4452-4b28-bb3d-3ff8ef63d973" status: 200 len: 1219 microversion: 2.1 time: 0.066956 Oct 31 12:41:25.483225 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 501/992] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:41:25 2022] GET /compute/v2.1/servers/2e4b0eaa-4452-4b28-bb3d-3ff8ef63d973 => generated 1219 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 12:41:25.677326 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-21ee054f-539f-4cb7-8f1b-b665d8f763e6 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:41:25.677940 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-21ee054f-539f-4cb7-8f1b-b665d8f763e6 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] [instance: 66820f24-a23a-4e02-a703-7c9832ffd729] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:41:25.684634 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-21ee054f-539f-4cb7-8f1b-b665d8f763e6 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:41:25.685120 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-21ee054f-539f-4cb7-8f1b-b665d8f763e6 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:41:25.685551 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-21ee054f-539f-4cb7-8f1b-b665d8f763e6 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:41:25.686265 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-21ee054f-539f-4cb7-8f1b-b665d8f763e6 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:41:25.686693 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-21ee054f-539f-4cb7-8f1b-b665d8f763e6 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:41:25.687109 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-21ee054f-539f-4cb7-8f1b-b665d8f763e6 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:41:25.752353 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-21ee054f-539f-4cb7-8f1b-b665d8f763e6 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b76d81ee9446cf9014a2e695ef03e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae8c589d0b84ce096451a10717fc601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:41:25.760774 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-21ee054f-539f-4cb7-8f1b-b665d8f763e6 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] 10.222.0.15 "GET /compute/v2.1/servers/66820f24-a23a-4e02-a703-7c9832ffd729" status: 200 len: 1144 microversion: 2.1 time: 0.087864 Oct 31 12:41:25.761344 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 492/993] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:41:25 2022] GET /compute/v2.1/servers/66820f24-a23a-4e02-a703-7c9832ffd729 => generated 1144 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:41:26.505667 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-d3b79eed-d0ef-42e9-8611-b242e6e8f303 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:41:26.506270 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-d3b79eed-d0ef-42e9-8611-b242e6e8f303 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] [instance: 2e4b0eaa-4452-4b28-bb3d-3ff8ef63d973] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:41:26.513162 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-d3b79eed-d0ef-42e9-8611-b242e6e8f303 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:41:26.513634 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-d3b79eed-d0ef-42e9-8611-b242e6e8f303 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:41:26.514059 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-d3b79eed-d0ef-42e9-8611-b242e6e8f303 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:41:26.514734 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-d3b79eed-d0ef-42e9-8611-b242e6e8f303 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:41:26.515206 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-d3b79eed-d0ef-42e9-8611-b242e6e8f303 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:41:26.515622 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-d3b79eed-d0ef-42e9-8611-b242e6e8f303 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:41:26.579595 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-d3b79eed-d0ef-42e9-8611-b242e6e8f303 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77385d8c61994d5da4083775d202a93d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd49947a82d974a55a8cc7a6ad7b9c56e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:41:26.587149 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-d3b79eed-d0ef-42e9-8611-b242e6e8f303 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] 10.222.0.15 "GET /compute/v2.1/servers/2e4b0eaa-4452-4b28-bb3d-3ff8ef63d973" status: 200 len: 1271 microversion: 2.1 time: 0.085364 Oct 31 12:41:26.587728 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 502/994] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:41:26 2022] GET /compute/v2.1/servers/2e4b0eaa-4452-4b28-bb3d-3ff8ef63d973 => generated 1271 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:41:26.784899 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-c1787cdd-1bb3-4b64-bfe4-4eb85393b188 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:41:26.785518 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-c1787cdd-1bb3-4b64-bfe4-4eb85393b188 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] [instance: 66820f24-a23a-4e02-a703-7c9832ffd729] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:41:26.792022 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-c1787cdd-1bb3-4b64-bfe4-4eb85393b188 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:41:26.792507 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-c1787cdd-1bb3-4b64-bfe4-4eb85393b188 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:41:26.792959 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-c1787cdd-1bb3-4b64-bfe4-4eb85393b188 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:41:26.794106 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-c1787cdd-1bb3-4b64-bfe4-4eb85393b188 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:41:26.794932 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-c1787cdd-1bb3-4b64-bfe4-4eb85393b188 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:41:26.795613 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-c1787cdd-1bb3-4b64-bfe4-4eb85393b188 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:41:26.858027 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-c1787cdd-1bb3-4b64-bfe4-4eb85393b188 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b76d81ee9446cf9014a2e695ef03e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae8c589d0b84ce096451a10717fc601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:41:26.866623 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-c1787cdd-1bb3-4b64-bfe4-4eb85393b188 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] 10.222.0.15 "GET /compute/v2.1/servers/66820f24-a23a-4e02-a703-7c9832ffd729" status: 200 len: 1136 microversion: 2.1 time: 0.086161 Oct 31 12:41:26.867292 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 493/995] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:41:26 2022] GET /compute/v2.1/servers/66820f24-a23a-4e02-a703-7c9832ffd729 => generated 1136 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:41:27.609574 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-fc1d5f1f-7578-4d1f-8fe2-1da7335c54c3 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:41:27.610259 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-fc1d5f1f-7578-4d1f-8fe2-1da7335c54c3 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] [instance: 2e4b0eaa-4452-4b28-bb3d-3ff8ef63d973] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:41:27.616655 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-fc1d5f1f-7578-4d1f-8fe2-1da7335c54c3 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:41:27.617157 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-fc1d5f1f-7578-4d1f-8fe2-1da7335c54c3 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:41:27.617584 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-fc1d5f1f-7578-4d1f-8fe2-1da7335c54c3 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:41:27.618263 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-fc1d5f1f-7578-4d1f-8fe2-1da7335c54c3 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:41:27.618712 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-fc1d5f1f-7578-4d1f-8fe2-1da7335c54c3 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:41:27.619128 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-fc1d5f1f-7578-4d1f-8fe2-1da7335c54c3 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:41:27.679866 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-fc1d5f1f-7578-4d1f-8fe2-1da7335c54c3 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77385d8c61994d5da4083775d202a93d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd49947a82d974a55a8cc7a6ad7b9c56e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:41:27.687302 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-fc1d5f1f-7578-4d1f-8fe2-1da7335c54c3 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] 10.222.0.15 "GET /compute/v2.1/servers/2e4b0eaa-4452-4b28-bb3d-3ff8ef63d973" status: 200 len: 1271 microversion: 2.1 time: 0.081587 Oct 31 12:41:27.687885 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 503/996] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:41:27 2022] GET /compute/v2.1/servers/2e4b0eaa-4452-4b28-bb3d-3ff8ef63d973 => generated 1271 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:41:27.890525 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-3a6351e6-a0a2-4658-bf2c-9f4b4e03520e tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:41:27.891057 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-3a6351e6-a0a2-4658-bf2c-9f4b4e03520e tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] [instance: 66820f24-a23a-4e02-a703-7c9832ffd729] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:41:27.898208 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-3a6351e6-a0a2-4658-bf2c-9f4b4e03520e tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:41:27.898782 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-3a6351e6-a0a2-4658-bf2c-9f4b4e03520e tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:41:27.899233 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-3a6351e6-a0a2-4658-bf2c-9f4b4e03520e tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:41:27.899912 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-3a6351e6-a0a2-4658-bf2c-9f4b4e03520e tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:41:27.900358 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-3a6351e6-a0a2-4658-bf2c-9f4b4e03520e tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:41:27.900774 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-3a6351e6-a0a2-4658-bf2c-9f4b4e03520e tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:41:27.963320 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-3a6351e6-a0a2-4658-bf2c-9f4b4e03520e tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b76d81ee9446cf9014a2e695ef03e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae8c589d0b84ce096451a10717fc601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:41:27.970894 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-3a6351e6-a0a2-4658-bf2c-9f4b4e03520e tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] 10.222.0.15 "GET /compute/v2.1/servers/66820f24-a23a-4e02-a703-7c9832ffd729" status: 200 len: 1136 microversion: 2.1 time: 0.084275 Oct 31 12:41:27.971482 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 494/997] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:41:27 2022] GET /compute/v2.1/servers/66820f24-a23a-4e02-a703-7c9832ffd729 => generated 1136 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:41:28.711152 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-e5a9e2c6-8fd6-411b-846e-9161f9e39e0d tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:41:28.711779 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-e5a9e2c6-8fd6-411b-846e-9161f9e39e0d tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] [instance: 2e4b0eaa-4452-4b28-bb3d-3ff8ef63d973] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:41:28.718167 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-e5a9e2c6-8fd6-411b-846e-9161f9e39e0d tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:41:28.718641 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-e5a9e2c6-8fd6-411b-846e-9161f9e39e0d tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:41:28.719075 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-e5a9e2c6-8fd6-411b-846e-9161f9e39e0d tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:41:28.720351 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-e5a9e2c6-8fd6-411b-846e-9161f9e39e0d tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:41:28.720811 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-e5a9e2c6-8fd6-411b-846e-9161f9e39e0d tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:41:28.721227 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-e5a9e2c6-8fd6-411b-846e-9161f9e39e0d tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:41:28.784431 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-e5a9e2c6-8fd6-411b-846e-9161f9e39e0d tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77385d8c61994d5da4083775d202a93d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd49947a82d974a55a8cc7a6ad7b9c56e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:41:28.792024 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-e5a9e2c6-8fd6-411b-846e-9161f9e39e0d tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] 10.222.0.15 "GET /compute/v2.1/servers/2e4b0eaa-4452-4b28-bb3d-3ff8ef63d973" status: 200 len: 1271 microversion: 2.1 time: 0.084769 Oct 31 12:41:28.792589 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 504/998] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:41:28 2022] GET /compute/v2.1/servers/2e4b0eaa-4452-4b28-bb3d-3ff8ef63d973 => generated 1271 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:41:28.993688 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-8e7315d1-e532-42d5-b501-7d1d9ad8cf2f tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:41:28.994218 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-8e7315d1-e532-42d5-b501-7d1d9ad8cf2f tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] [instance: 66820f24-a23a-4e02-a703-7c9832ffd729] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:41:29.000540 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-8e7315d1-e532-42d5-b501-7d1d9ad8cf2f tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:41:29.001016 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-8e7315d1-e532-42d5-b501-7d1d9ad8cf2f tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:41:29.001448 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-8e7315d1-e532-42d5-b501-7d1d9ad8cf2f tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:41:29.002126 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-8e7315d1-e532-42d5-b501-7d1d9ad8cf2f tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:41:29.002577 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-8e7315d1-e532-42d5-b501-7d1d9ad8cf2f tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:41:29.002994 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-8e7315d1-e532-42d5-b501-7d1d9ad8cf2f tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:41:29.065833 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-8e7315d1-e532-42d5-b501-7d1d9ad8cf2f tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b76d81ee9446cf9014a2e695ef03e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae8c589d0b84ce096451a10717fc601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:41:29.081887 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-8e7315d1-e532-42d5-b501-7d1d9ad8cf2f tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] 10.222.0.15 "GET /compute/v2.1/servers/66820f24-a23a-4e02-a703-7c9832ffd729" status: 200 len: 1136 microversion: 2.1 time: 0.092078 Oct 31 12:41:29.082845 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 495/999] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:41:28 2022] GET /compute/v2.1/servers/66820f24-a23a-4e02-a703-7c9832ffd729 => generated 1136 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:41:29.817165 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-d289fe94-45b7-47ad-b36d-a4b99e12c8e2 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:41:29.817781 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-d289fe94-45b7-47ad-b36d-a4b99e12c8e2 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] [instance: 2e4b0eaa-4452-4b28-bb3d-3ff8ef63d973] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:41:29.824804 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-d289fe94-45b7-47ad-b36d-a4b99e12c8e2 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:41:29.825276 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-d289fe94-45b7-47ad-b36d-a4b99e12c8e2 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:41:29.825699 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-d289fe94-45b7-47ad-b36d-a4b99e12c8e2 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:41:29.826381 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-d289fe94-45b7-47ad-b36d-a4b99e12c8e2 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:41:29.826822 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-d289fe94-45b7-47ad-b36d-a4b99e12c8e2 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:41:29.827375 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-d289fe94-45b7-47ad-b36d-a4b99e12c8e2 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:41:30.105569 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-ecf18cee-d052-4994-9ac3-f44334b5be01 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:41:30.106317 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-ecf18cee-d052-4994-9ac3-f44334b5be01 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] [instance: 66820f24-a23a-4e02-a703-7c9832ffd729] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:41:30.112961 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-ecf18cee-d052-4994-9ac3-f44334b5be01 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:41:30.113433 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-ecf18cee-d052-4994-9ac3-f44334b5be01 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:41:30.113861 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-ecf18cee-d052-4994-9ac3-f44334b5be01 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:41:30.114542 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-ecf18cee-d052-4994-9ac3-f44334b5be01 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:41:30.114989 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-ecf18cee-d052-4994-9ac3-f44334b5be01 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:41:30.115433 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-ecf18cee-d052-4994-9ac3-f44334b5be01 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:41:30.155241 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-d289fe94-45b7-47ad-b36d-a4b99e12c8e2 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77385d8c61994d5da4083775d202a93d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd49947a82d974a55a8cc7a6ad7b9c56e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:41:30.166457 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-d289fe94-45b7-47ad-b36d-a4b99e12c8e2 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] 10.222.0.15 "GET /compute/v2.1/servers/2e4b0eaa-4452-4b28-bb3d-3ff8ef63d973" status: 200 len: 1319 microversion: 2.1 time: 0.354757 Oct 31 12:41:30.167636 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 505/1000] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:41:29 2022] GET /compute/v2.1/servers/2e4b0eaa-4452-4b28-bb3d-3ff8ef63d973 => generated 1319 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:41:30.199601 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-ecf18cee-d052-4994-9ac3-f44334b5be01 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b76d81ee9446cf9014a2e695ef03e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae8c589d0b84ce096451a10717fc601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:41:30.209127 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-ecf18cee-d052-4994-9ac3-f44334b5be01 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] 10.222.0.15 "GET /compute/v2.1/servers/66820f24-a23a-4e02-a703-7c9832ffd729" status: 200 len: 1210 microversion: 2.1 time: 0.107612 Oct 31 12:41:30.210049 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 496/1001] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:41:30 2022] GET /compute/v2.1/servers/66820f24-a23a-4e02-a703-7c9832ffd729 => generated 1210 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 12:41:31.190681 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-bfbb5ce8-a7d3-4c9b-898c-38dad914b991 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:41:31.191307 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-bfbb5ce8-a7d3-4c9b-898c-38dad914b991 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] [instance: 2e4b0eaa-4452-4b28-bb3d-3ff8ef63d973] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:41:31.197751 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-bfbb5ce8-a7d3-4c9b-898c-38dad914b991 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:41:31.198232 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-bfbb5ce8-a7d3-4c9b-898c-38dad914b991 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:41:31.198643 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-bfbb5ce8-a7d3-4c9b-898c-38dad914b991 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:41:31.199350 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-bfbb5ce8-a7d3-4c9b-898c-38dad914b991 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:41:31.199793 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-bfbb5ce8-a7d3-4c9b-898c-38dad914b991 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:41:31.200304 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-bfbb5ce8-a7d3-4c9b-898c-38dad914b991 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:41:31.233369 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-e707c66c-a241-4f57-b5a5-c473d317d72c tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:41:31.243685 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-e707c66c-a241-4f57-b5a5-c473d317d72c tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] [instance: 66820f24-a23a-4e02-a703-7c9832ffd729] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:41:31.251483 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-e707c66c-a241-4f57-b5a5-c473d317d72c tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:41:31.251981 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-e707c66c-a241-4f57-b5a5-c473d317d72c tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:41:31.252413 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-e707c66c-a241-4f57-b5a5-c473d317d72c tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:41:31.253225 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-e707c66c-a241-4f57-b5a5-c473d317d72c tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:41:31.253560 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-e707c66c-a241-4f57-b5a5-c473d317d72c tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:41:31.254036 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-e707c66c-a241-4f57-b5a5-c473d317d72c tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:41:31.409768 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-e707c66c-a241-4f57-b5a5-c473d317d72c tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b76d81ee9446cf9014a2e695ef03e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae8c589d0b84ce096451a10717fc601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:41:31.417837 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-e707c66c-a241-4f57-b5a5-c473d317d72c tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] 10.222.0.15 "GET /compute/v2.1/servers/66820f24-a23a-4e02-a703-7c9832ffd729" status: 200 len: 1266 microversion: 2.1 time: 0.189819 Oct 31 12:41:31.418433 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 497/1002] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:41:31 2022] GET /compute/v2.1/servers/66820f24-a23a-4e02-a703-7c9832ffd729 => generated 1266 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:41:31.493744 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-bfbb5ce8-a7d3-4c9b-898c-38dad914b991 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77385d8c61994d5da4083775d202a93d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd49947a82d974a55a8cc7a6ad7b9c56e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:41:31.509156 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-bfbb5ce8-a7d3-4c9b-898c-38dad914b991 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] 10.222.0.15 "GET /compute/v2.1/servers/2e4b0eaa-4452-4b28-bb3d-3ff8ef63d973" status: 200 len: 1319 microversion: 2.1 time: 0.322446 Oct 31 12:41:31.524628 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 506/1003] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:41:31 2022] GET /compute/v2.1/servers/2e4b0eaa-4452-4b28-bb3d-3ff8ef63d973 => generated 1319 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:41:31.541224 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [req-7f0a020f-dcf9-4fc5-9f68-d34c6cb6953b req-fcb531c1-8e9d-44ae-9da7-d8a7c4abb375 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e4b0eaa-4452-4b28-bb3d-3ff8ef63d973", "tag": "fd19230e-a933-459a-a46a-ee58aa368072"}]} {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 12:41:31.551237 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [req-7f0a020f-dcf9-4fc5-9f68-d34c6cb6953b req-fcb531c1-8e9d-44ae-9da7-d8a7c4abb375 service nova] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:41:31.551986 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [req-7f0a020f-dcf9-4fc5-9f68-d34c6cb6953b req-fcb531c1-8e9d-44ae-9da7-d8a7c4abb375 service nova] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:41:31.552409 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [req-7f0a020f-dcf9-4fc5-9f68-d34c6cb6953b req-fcb531c1-8e9d-44ae-9da7-d8a7c4abb375 service nova] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:41:31.564939 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.compute.server_external_events [req-7f0a020f-dcf9-4fc5-9f68-d34c6cb6953b req-fcb531c1-8e9d-44ae-9da7-d8a7c4abb375 service nova] Creating event network-changed:fd19230e-a933-459a-a46a-ee58aa368072 for instance 2e4b0eaa-4452-4b28-bb3d-3ff8ef63d973 on hv-cinder-79617 Oct 31 12:41:31.573364 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [req-7f0a020f-dcf9-4fc5-9f68-d34c6cb6953b req-fcb531c1-8e9d-44ae-9da7-d8a7c4abb375 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036315 Oct 31 12:41:31.574566 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 498/1004] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Oct 31 12:41:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 12:41:32.441249 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-3197395d-5d67-44d2-9407-ea059dff45d2 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:41:32.441850 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-3197395d-5d67-44d2-9407-ea059dff45d2 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] [instance: 66820f24-a23a-4e02-a703-7c9832ffd729] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:41:32.448704 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-3197395d-5d67-44d2-9407-ea059dff45d2 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:41:32.449176 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-3197395d-5d67-44d2-9407-ea059dff45d2 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:41:32.449617 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-3197395d-5d67-44d2-9407-ea059dff45d2 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:41:32.450308 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-3197395d-5d67-44d2-9407-ea059dff45d2 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:41:32.450782 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-3197395d-5d67-44d2-9407-ea059dff45d2 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:41:32.451219 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-3197395d-5d67-44d2-9407-ea059dff45d2 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:41:32.535740 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-243c8712-d51b-4f9b-9902-1afa723daa21 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:41:32.536434 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-243c8712-d51b-4f9b-9902-1afa723daa21 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] [instance: 2e4b0eaa-4452-4b28-bb3d-3ff8ef63d973] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:41:32.542856 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-243c8712-d51b-4f9b-9902-1afa723daa21 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:41:32.543382 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-243c8712-d51b-4f9b-9902-1afa723daa21 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:41:32.543813 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-243c8712-d51b-4f9b-9902-1afa723daa21 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:41:32.544620 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-243c8712-d51b-4f9b-9902-1afa723daa21 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:41:32.545080 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-243c8712-d51b-4f9b-9902-1afa723daa21 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:41:32.545625 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-243c8712-d51b-4f9b-9902-1afa723daa21 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:41:32.587066 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-3197395d-5d67-44d2-9407-ea059dff45d2 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b76d81ee9446cf9014a2e695ef03e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae8c589d0b84ce096451a10717fc601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:41:32.596045 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-3197395d-5d67-44d2-9407-ea059dff45d2 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] 10.222.0.15 "GET /compute/v2.1/servers/66820f24-a23a-4e02-a703-7c9832ffd729" status: 200 len: 1266 microversion: 2.1 time: 0.158678 Oct 31 12:41:32.596629 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 507/1005] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:41:32 2022] GET /compute/v2.1/servers/66820f24-a23a-4e02-a703-7c9832ffd729 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:41:32.677447 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-243c8712-d51b-4f9b-9902-1afa723daa21 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77385d8c61994d5da4083775d202a93d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd49947a82d974a55a8cc7a6ad7b9c56e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:41:32.685004 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-243c8712-d51b-4f9b-9902-1afa723daa21 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] 10.222.0.15 "GET /compute/v2.1/servers/2e4b0eaa-4452-4b28-bb3d-3ff8ef63d973" status: 200 len: 1319 microversion: 2.1 time: 0.154785 Oct 31 12:41:32.685563 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 499/1006] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:41:32 2022] GET /compute/v2.1/servers/2e4b0eaa-4452-4b28-bb3d-3ff8ef63d973 => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 12:41:33.596152 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [req-2db26f72-3c62-487e-8d3d-399b19811553 req-f5e3c7ee-3419-4170-b885-aa0c370c2ee5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "66820f24-a23a-4e02-a703-7c9832ffd729", "tag": "bf3768f3-740b-45b9-92a5-0798ffcfacc8"}]} {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 12:41:33.605828 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [req-2db26f72-3c62-487e-8d3d-399b19811553 req-f5e3c7ee-3419-4170-b885-aa0c370c2ee5 service nova] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:41:33.606335 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [req-2db26f72-3c62-487e-8d3d-399b19811553 req-f5e3c7ee-3419-4170-b885-aa0c370c2ee5 service nova] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:41:33.606760 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [req-2db26f72-3c62-487e-8d3d-399b19811553 req-f5e3c7ee-3419-4170-b885-aa0c370c2ee5 service nova] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:41:33.617813 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.compute.server_external_events [req-2db26f72-3c62-487e-8d3d-399b19811553 req-f5e3c7ee-3419-4170-b885-aa0c370c2ee5 service nova] Creating event network-changed:bf3768f3-740b-45b9-92a5-0798ffcfacc8 for instance 66820f24-a23a-4e02-a703-7c9832ffd729 on hv-cinder-79617 Oct 31 12:41:33.618356 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-c8ff471b-5af4-4f48-8a85-263e9908754b tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:41:33.618965 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-c8ff471b-5af4-4f48-8a85-263e9908754b tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] [instance: 66820f24-a23a-4e02-a703-7c9832ffd729] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:41:33.622846 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [req-2db26f72-3c62-487e-8d3d-399b19811553 req-f5e3c7ee-3419-4170-b885-aa0c370c2ee5 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031257 Oct 31 12:41:33.623467 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 508/1007] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Oct 31 12:41:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 12:41:33.625524 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-c8ff471b-5af4-4f48-8a85-263e9908754b tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:41:33.625948 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-c8ff471b-5af4-4f48-8a85-263e9908754b tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:41:33.626379 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-c8ff471b-5af4-4f48-8a85-263e9908754b tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:41:33.627064 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-c8ff471b-5af4-4f48-8a85-263e9908754b tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:41:33.627534 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-c8ff471b-5af4-4f48-8a85-263e9908754b tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:41:33.627947 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-c8ff471b-5af4-4f48-8a85-263e9908754b tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:41:33.710417 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-580be96f-698f-4c54-809b-ab1f68d5d2f1 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:41:33.711110 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-580be96f-698f-4c54-809b-ab1f68d5d2f1 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] [instance: 2e4b0eaa-4452-4b28-bb3d-3ff8ef63d973] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:41:33.717442 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-580be96f-698f-4c54-809b-ab1f68d5d2f1 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:41:33.717911 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-580be96f-698f-4c54-809b-ab1f68d5d2f1 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:41:33.718336 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-580be96f-698f-4c54-809b-ab1f68d5d2f1 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:41:33.719732 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-580be96f-698f-4c54-809b-ab1f68d5d2f1 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:41:33.720184 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-580be96f-698f-4c54-809b-ab1f68d5d2f1 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:41:33.720599 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-580be96f-698f-4c54-809b-ab1f68d5d2f1 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:41:33.757944 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-c8ff471b-5af4-4f48-8a85-263e9908754b tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b76d81ee9446cf9014a2e695ef03e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae8c589d0b84ce096451a10717fc601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:41:33.765713 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-c8ff471b-5af4-4f48-8a85-263e9908754b tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] 10.222.0.15 "GET /compute/v2.1/servers/66820f24-a23a-4e02-a703-7c9832ffd729" status: 200 len: 1266 microversion: 2.1 time: 0.151118 Oct 31 12:41:33.767066 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 500/1008] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:41:33 2022] GET /compute/v2.1/servers/66820f24-a23a-4e02-a703-7c9832ffd729 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 12:41:33.852302 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-580be96f-698f-4c54-809b-ab1f68d5d2f1 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77385d8c61994d5da4083775d202a93d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd49947a82d974a55a8cc7a6ad7b9c56e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:41:33.860507 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-580be96f-698f-4c54-809b-ab1f68d5d2f1 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] 10.222.0.15 "GET /compute/v2.1/servers/2e4b0eaa-4452-4b28-bb3d-3ff8ef63d973" status: 200 len: 1319 microversion: 2.1 time: 0.153761 Oct 31 12:41:33.861060 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 509/1009] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:41:33 2022] GET /compute/v2.1/servers/2e4b0eaa-4452-4b28-bb3d-3ff8ef63d973 => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 12:41:34.789700 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-762deb84-7ae3-47d4-96f6-4e680b9dc1dc tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:41:34.790315 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-762deb84-7ae3-47d4-96f6-4e680b9dc1dc tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] [instance: 66820f24-a23a-4e02-a703-7c9832ffd729] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:41:34.798743 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-762deb84-7ae3-47d4-96f6-4e680b9dc1dc tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:41:34.799635 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-762deb84-7ae3-47d4-96f6-4e680b9dc1dc tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:41:34.800076 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-762deb84-7ae3-47d4-96f6-4e680b9dc1dc tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:41:34.800974 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-762deb84-7ae3-47d4-96f6-4e680b9dc1dc tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:41:34.801408 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-762deb84-7ae3-47d4-96f6-4e680b9dc1dc tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:41:34.801831 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-762deb84-7ae3-47d4-96f6-4e680b9dc1dc tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:41:34.882485 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-c54e8383-21f9-409a-b96f-4278b4ad6277 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:41:34.883774 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-c54e8383-21f9-409a-b96f-4278b4ad6277 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] [instance: 2e4b0eaa-4452-4b28-bb3d-3ff8ef63d973] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:41:34.890009 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-c54e8383-21f9-409a-b96f-4278b4ad6277 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:41:34.890490 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-c54e8383-21f9-409a-b96f-4278b4ad6277 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:41:34.891717 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-c54e8383-21f9-409a-b96f-4278b4ad6277 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:41:34.892771 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-c54e8383-21f9-409a-b96f-4278b4ad6277 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:41:34.893303 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-c54e8383-21f9-409a-b96f-4278b4ad6277 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:41:34.893932 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-c54e8383-21f9-409a-b96f-4278b4ad6277 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:41:34.943567 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-762deb84-7ae3-47d4-96f6-4e680b9dc1dc tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b76d81ee9446cf9014a2e695ef03e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae8c589d0b84ce096451a10717fc601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:41:34.951251 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-762deb84-7ae3-47d4-96f6-4e680b9dc1dc tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] 10.222.0.15 "GET /compute/v2.1/servers/66820f24-a23a-4e02-a703-7c9832ffd729" status: 200 len: 1266 microversion: 2.1 time: 0.165602 Oct 31 12:41:34.951825 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 501/1010] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:41:34 2022] GET /compute/v2.1/servers/66820f24-a23a-4e02-a703-7c9832ffd729 => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:41:35.112885 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-c54e8383-21f9-409a-b96f-4278b4ad6277 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77385d8c61994d5da4083775d202a93d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd49947a82d974a55a8cc7a6ad7b9c56e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:41:35.121777 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-c54e8383-21f9-409a-b96f-4278b4ad6277 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] 10.222.0.15 "GET /compute/v2.1/servers/2e4b0eaa-4452-4b28-bb3d-3ff8ef63d973" status: 200 len: 1319 microversion: 2.1 time: 0.243240 Oct 31 12:41:35.122348 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 510/1011] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:41:34 2022] GET /compute/v2.1/servers/2e4b0eaa-4452-4b28-bb3d-3ff8ef63d973 => generated 1319 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 12:41:35.973964 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-090a60eb-1c50-4eff-b469-a3cab1761ecc tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:41:35.974581 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-090a60eb-1c50-4eff-b469-a3cab1761ecc tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] [instance: 66820f24-a23a-4e02-a703-7c9832ffd729] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:41:35.976733 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG dbcounter [-] [125441] Writing DB stats nova_cell0:SELECT=4 {{(pid=125441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:41:35.977319 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG dbcounter [-] [125441] Writing DB stats nova_cell0:SELECT=14 {{(pid=125441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:41:35.983506 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-090a60eb-1c50-4eff-b469-a3cab1761ecc tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:41:35.983998 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-090a60eb-1c50-4eff-b469-a3cab1761ecc tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:41:35.984922 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-090a60eb-1c50-4eff-b469-a3cab1761ecc tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:41:35.988280 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-090a60eb-1c50-4eff-b469-a3cab1761ecc tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:41:35.988762 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-090a60eb-1c50-4eff-b469-a3cab1761ecc tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:41:35.989196 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-090a60eb-1c50-4eff-b469-a3cab1761ecc tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:41:36.142940 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-090a60eb-1c50-4eff-b469-a3cab1761ecc tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b76d81ee9446cf9014a2e695ef03e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae8c589d0b84ce096451a10717fc601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:41:36.145027 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-b9774527-dab5-496d-a3d3-f87d8f152f34 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:41:36.145658 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-b9774527-dab5-496d-a3d3-f87d8f152f34 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] [instance: 2e4b0eaa-4452-4b28-bb3d-3ff8ef63d973] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:41:36.148568 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG dbcounter [-] [125440] Writing DB stats nova_cell0:SELECT=6 {{(pid=125440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:41:36.150747 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-090a60eb-1c50-4eff-b469-a3cab1761ecc tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] 10.222.0.15 "GET /compute/v2.1/servers/66820f24-a23a-4e02-a703-7c9832ffd729" status: 200 len: 1266 microversion: 2.1 time: 0.180597 Oct 31 12:41:36.151544 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 502/1012] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:41:35 2022] GET /compute/v2.1/servers/66820f24-a23a-4e02-a703-7c9832ffd729 => generated 1266 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:41:36.153269 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-b9774527-dab5-496d-a3d3-f87d8f152f34 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:41:36.153746 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-b9774527-dab5-496d-a3d3-f87d8f152f34 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:41:36.154231 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-b9774527-dab5-496d-a3d3-f87d8f152f34 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:41:36.154981 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-b9774527-dab5-496d-a3d3-f87d8f152f34 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:41:36.155456 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-b9774527-dab5-496d-a3d3-f87d8f152f34 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:41:36.155868 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-b9774527-dab5-496d-a3d3-f87d8f152f34 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:41:36.472229 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-b9774527-dab5-496d-a3d3-f87d8f152f34 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77385d8c61994d5da4083775d202a93d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd49947a82d974a55a8cc7a6ad7b9c56e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:41:36.479748 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-b9774527-dab5-496d-a3d3-f87d8f152f34 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] 10.222.0.15 "GET /compute/v2.1/servers/2e4b0eaa-4452-4b28-bb3d-3ff8ef63d973" status: 200 len: 1319 microversion: 2.1 time: 0.339378 Oct 31 12:41:36.480312 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 511/1013] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:41:36 2022] GET /compute/v2.1/servers/2e4b0eaa-4452-4b28-bb3d-3ff8ef63d973 => generated 1319 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 12:41:37.175583 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-2600d41d-972d-40d2-b09e-3926939bbece tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:41:37.176201 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-2600d41d-972d-40d2-b09e-3926939bbece tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] [instance: 66820f24-a23a-4e02-a703-7c9832ffd729] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:41:37.182549 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-2600d41d-972d-40d2-b09e-3926939bbece tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:41:37.183035 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-2600d41d-972d-40d2-b09e-3926939bbece tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:41:37.183498 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-2600d41d-972d-40d2-b09e-3926939bbece tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:41:37.184195 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-2600d41d-972d-40d2-b09e-3926939bbece tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:41:37.184651 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-2600d41d-972d-40d2-b09e-3926939bbece tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:41:37.185072 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-2600d41d-972d-40d2-b09e-3926939bbece tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:41:37.330082 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-2600d41d-972d-40d2-b09e-3926939bbece tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b76d81ee9446cf9014a2e695ef03e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae8c589d0b84ce096451a10717fc601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:41:37.337845 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-2600d41d-972d-40d2-b09e-3926939bbece tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] 10.222.0.15 "GET /compute/v2.1/servers/66820f24-a23a-4e02-a703-7c9832ffd729" status: 200 len: 1266 microversion: 2.1 time: 0.168024 Oct 31 12:41:37.338875 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 503/1014] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:41:37 2022] GET /compute/v2.1/servers/66820f24-a23a-4e02-a703-7c9832ffd729 => generated 1266 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 12:41:37.503210 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-245cadd9-0543-49c9-a9c8-937ec624d6f4 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:41:37.503974 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-245cadd9-0543-49c9-a9c8-937ec624d6f4 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] [instance: 2e4b0eaa-4452-4b28-bb3d-3ff8ef63d973] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:41:37.510295 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-245cadd9-0543-49c9-a9c8-937ec624d6f4 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:41:37.510768 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-245cadd9-0543-49c9-a9c8-937ec624d6f4 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:41:37.511208 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-245cadd9-0543-49c9-a9c8-937ec624d6f4 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:41:37.511889 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-245cadd9-0543-49c9-a9c8-937ec624d6f4 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:41:37.512314 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-245cadd9-0543-49c9-a9c8-937ec624d6f4 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:41:37.512728 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-245cadd9-0543-49c9-a9c8-937ec624d6f4 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:41:37.650611 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-245cadd9-0543-49c9-a9c8-937ec624d6f4 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77385d8c61994d5da4083775d202a93d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd49947a82d974a55a8cc7a6ad7b9c56e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:41:37.658969 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-245cadd9-0543-49c9-a9c8-937ec624d6f4 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] 10.222.0.15 "GET /compute/v2.1/servers/2e4b0eaa-4452-4b28-bb3d-3ff8ef63d973" status: 200 len: 1319 microversion: 2.1 time: 0.160190 Oct 31 12:41:37.659572 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 512/1015] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:41:37 2022] GET /compute/v2.1/servers/2e4b0eaa-4452-4b28-bb3d-3ff8ef63d973 => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 12:41:38.361726 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-c0a3b5a9-1137-4f60-8bc7-c9ce71576d1c tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:41:38.362293 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-c0a3b5a9-1137-4f60-8bc7-c9ce71576d1c tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] [instance: 66820f24-a23a-4e02-a703-7c9832ffd729] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:41:38.368559 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-c0a3b5a9-1137-4f60-8bc7-c9ce71576d1c tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:41:38.369043 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-c0a3b5a9-1137-4f60-8bc7-c9ce71576d1c tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:41:38.369463 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-c0a3b5a9-1137-4f60-8bc7-c9ce71576d1c tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:41:38.370138 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-c0a3b5a9-1137-4f60-8bc7-c9ce71576d1c tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:41:38.370584 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-c0a3b5a9-1137-4f60-8bc7-c9ce71576d1c tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:41:38.370998 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-c0a3b5a9-1137-4f60-8bc7-c9ce71576d1c tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:41:38.498155 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-c0a3b5a9-1137-4f60-8bc7-c9ce71576d1c tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b76d81ee9446cf9014a2e695ef03e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae8c589d0b84ce096451a10717fc601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:41:38.505844 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-c0a3b5a9-1137-4f60-8bc7-c9ce71576d1c tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] 10.222.0.15 "GET /compute/v2.1/servers/66820f24-a23a-4e02-a703-7c9832ffd729" status: 200 len: 1266 microversion: 2.1 time: 0.148844 Oct 31 12:41:38.506405 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 504/1016] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:41:38 2022] GET /compute/v2.1/servers/66820f24-a23a-4e02-a703-7c9832ffd729 => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:41:38.682046 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-1a2ad1e4-1499-4b79-bcd4-2b308119bcf8 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:41:38.682508 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-1a2ad1e4-1499-4b79-bcd4-2b308119bcf8 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] [instance: 2e4b0eaa-4452-4b28-bb3d-3ff8ef63d973] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:41:38.689698 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-1a2ad1e4-1499-4b79-bcd4-2b308119bcf8 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:41:38.690189 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-1a2ad1e4-1499-4b79-bcd4-2b308119bcf8 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:41:38.690748 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-1a2ad1e4-1499-4b79-bcd4-2b308119bcf8 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:41:38.691472 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-1a2ad1e4-1499-4b79-bcd4-2b308119bcf8 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:41:38.691926 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-1a2ad1e4-1499-4b79-bcd4-2b308119bcf8 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:41:38.692347 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-1a2ad1e4-1499-4b79-bcd4-2b308119bcf8 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:41:38.820495 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-1a2ad1e4-1499-4b79-bcd4-2b308119bcf8 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77385d8c61994d5da4083775d202a93d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd49947a82d974a55a8cc7a6ad7b9c56e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:41:38.828537 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-1a2ad1e4-1499-4b79-bcd4-2b308119bcf8 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] 10.222.0.15 "GET /compute/v2.1/servers/2e4b0eaa-4452-4b28-bb3d-3ff8ef63d973" status: 200 len: 1319 microversion: 2.1 time: 0.150231 Oct 31 12:41:38.829179 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 513/1017] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:41:38 2022] GET /compute/v2.1/servers/2e4b0eaa-4452-4b28-bb3d-3ff8ef63d973 => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:41:39.528860 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-586d2053-0142-4f2e-a8d9-d671e8f47658 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:41:39.529466 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-586d2053-0142-4f2e-a8d9-d671e8f47658 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] [instance: 66820f24-a23a-4e02-a703-7c9832ffd729] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:41:39.536414 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-586d2053-0142-4f2e-a8d9-d671e8f47658 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:41:39.536891 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-586d2053-0142-4f2e-a8d9-d671e8f47658 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:41:39.537317 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-586d2053-0142-4f2e-a8d9-d671e8f47658 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:41:39.537998 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-586d2053-0142-4f2e-a8d9-d671e8f47658 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:41:39.538448 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-586d2053-0142-4f2e-a8d9-d671e8f47658 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:41:39.538865 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-586d2053-0142-4f2e-a8d9-d671e8f47658 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:41:39.666959 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-586d2053-0142-4f2e-a8d9-d671e8f47658 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b76d81ee9446cf9014a2e695ef03e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae8c589d0b84ce096451a10717fc601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:41:39.674697 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-586d2053-0142-4f2e-a8d9-d671e8f47658 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] 10.222.0.15 "GET /compute/v2.1/servers/66820f24-a23a-4e02-a703-7c9832ffd729" status: 200 len: 1266 microversion: 2.1 time: 0.149753 Oct 31 12:41:39.675293 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 505/1018] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:41:39 2022] GET /compute/v2.1/servers/66820f24-a23a-4e02-a703-7c9832ffd729 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:41:39.853614 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-d42b0302-0276-4330-b8d8-c10147e8aabb tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:41:39.854215 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-d42b0302-0276-4330-b8d8-c10147e8aabb tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] [instance: 2e4b0eaa-4452-4b28-bb3d-3ff8ef63d973] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:41:39.860533 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-d42b0302-0276-4330-b8d8-c10147e8aabb tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:41:39.861050 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-d42b0302-0276-4330-b8d8-c10147e8aabb tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:41:39.861478 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-d42b0302-0276-4330-b8d8-c10147e8aabb tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:41:39.862167 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-d42b0302-0276-4330-b8d8-c10147e8aabb tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:41:39.862611 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-d42b0302-0276-4330-b8d8-c10147e8aabb tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:41:39.863028 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-d42b0302-0276-4330-b8d8-c10147e8aabb tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:41:40.001470 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-d42b0302-0276-4330-b8d8-c10147e8aabb tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77385d8c61994d5da4083775d202a93d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd49947a82d974a55a8cc7a6ad7b9c56e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:41:40.008998 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-d42b0302-0276-4330-b8d8-c10147e8aabb tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] 10.222.0.15 "GET /compute/v2.1/servers/2e4b0eaa-4452-4b28-bb3d-3ff8ef63d973" status: 200 len: 1319 microversion: 2.1 time: 0.159196 Oct 31 12:41:40.009562 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 514/1019] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:41:39 2022] GET /compute/v2.1/servers/2e4b0eaa-4452-4b28-bb3d-3ff8ef63d973 => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:41:40.696887 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-f434c190-8a30-461c-85d2-e232f68f5d02 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:41:40.697497 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-f434c190-8a30-461c-85d2-e232f68f5d02 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] [instance: 66820f24-a23a-4e02-a703-7c9832ffd729] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:41:40.704037 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-f434c190-8a30-461c-85d2-e232f68f5d02 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:41:40.704532 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-f434c190-8a30-461c-85d2-e232f68f5d02 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:41:40.704966 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-f434c190-8a30-461c-85d2-e232f68f5d02 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:41:40.705656 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-f434c190-8a30-461c-85d2-e232f68f5d02 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:41:40.706106 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-f434c190-8a30-461c-85d2-e232f68f5d02 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:41:40.706527 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-f434c190-8a30-461c-85d2-e232f68f5d02 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:41:40.854995 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-f434c190-8a30-461c-85d2-e232f68f5d02 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b76d81ee9446cf9014a2e695ef03e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae8c589d0b84ce096451a10717fc601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:41:40.863884 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-f434c190-8a30-461c-85d2-e232f68f5d02 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] 10.222.0.15 "GET /compute/v2.1/servers/66820f24-a23a-4e02-a703-7c9832ffd729" status: 200 len: 1266 microversion: 2.1 time: 0.170901 Oct 31 12:41:40.864589 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 506/1020] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:41:40 2022] GET /compute/v2.1/servers/66820f24-a23a-4e02-a703-7c9832ffd729 => generated 1266 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:41:41.012574 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [req-02156799-217a-4979-a59e-614407a63526 req-52f36a6d-43f7-4014-bdda-17e347c60719 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e4b0eaa-4452-4b28-bb3d-3ff8ef63d973", "name": "network-vif-plugged", "status": "completed", "tag": "fd19230e-a933-459a-a46a-ee58aa368072"}]} {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 12:41:41.024763 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [req-02156799-217a-4979-a59e-614407a63526 req-52f36a6d-43f7-4014-bdda-17e347c60719 service nova] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:41:41.025419 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [req-02156799-217a-4979-a59e-614407a63526 req-52f36a6d-43f7-4014-bdda-17e347c60719 service nova] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:41:41.027611 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [req-02156799-217a-4979-a59e-614407a63526 req-52f36a6d-43f7-4014-bdda-17e347c60719 service nova] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:41:41.041198 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-801d6465-68eb-40ce-a499-0dea0986b510 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:41:41.041808 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-801d6465-68eb-40ce-a499-0dea0986b510 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] [instance: 2e4b0eaa-4452-4b28-bb3d-3ff8ef63d973] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:41:41.042367 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.compute.server_external_events [req-02156799-217a-4979-a59e-614407a63526 req-52f36a6d-43f7-4014-bdda-17e347c60719 service nova] Creating event network-vif-plugged:fd19230e-a933-459a-a46a-ee58aa368072 for instance 2e4b0eaa-4452-4b28-bb3d-3ff8ef63d973 on hv-cinder-79617 Oct 31 12:41:41.048510 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [req-02156799-217a-4979-a59e-614407a63526 req-52f36a6d-43f7-4014-bdda-17e347c60719 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039970 Oct 31 12:41:41.048933 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-801d6465-68eb-40ce-a499-0dea0986b510 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:41:41.049711 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-801d6465-68eb-40ce-a499-0dea0986b510 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:41:41.050301 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-801d6465-68eb-40ce-a499-0dea0986b510 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:41:41.050994 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 515/1021] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Oct 31 12:41:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 12:41:41.051373 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-801d6465-68eb-40ce-a499-0dea0986b510 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:41:41.052105 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-801d6465-68eb-40ce-a499-0dea0986b510 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:41:41.052683 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-801d6465-68eb-40ce-a499-0dea0986b510 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:41:41.209981 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-801d6465-68eb-40ce-a499-0dea0986b510 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77385d8c61994d5da4083775d202a93d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd49947a82d974a55a8cc7a6ad7b9c56e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:41:41.217860 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-801d6465-68eb-40ce-a499-0dea0986b510 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] 10.222.0.15 "GET /compute/v2.1/servers/2e4b0eaa-4452-4b28-bb3d-3ff8ef63d973" status: 200 len: 1319 microversion: 2.1 time: 0.184871 Oct 31 12:41:41.231197 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 507/1022] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:41:41 2022] GET /compute/v2.1/servers/2e4b0eaa-4452-4b28-bb3d-3ff8ef63d973 => generated 1319 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:41:41.886939 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-3ccd2dca-05d5-44c2-bcf8-8d586b91681b tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:41:41.887652 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-3ccd2dca-05d5-44c2-bcf8-8d586b91681b tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] [instance: 66820f24-a23a-4e02-a703-7c9832ffd729] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:41:41.895145 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-3ccd2dca-05d5-44c2-bcf8-8d586b91681b tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:41:41.895643 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-3ccd2dca-05d5-44c2-bcf8-8d586b91681b tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:41:41.896067 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-3ccd2dca-05d5-44c2-bcf8-8d586b91681b tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:41:41.896747 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-3ccd2dca-05d5-44c2-bcf8-8d586b91681b tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:41:41.897192 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-3ccd2dca-05d5-44c2-bcf8-8d586b91681b tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:41:41.897603 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-3ccd2dca-05d5-44c2-bcf8-8d586b91681b tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:41:42.048399 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-3ccd2dca-05d5-44c2-bcf8-8d586b91681b tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b76d81ee9446cf9014a2e695ef03e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae8c589d0b84ce096451a10717fc601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:41:42.059903 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-3ccd2dca-05d5-44c2-bcf8-8d586b91681b tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] 10.222.0.15 "GET /compute/v2.1/servers/66820f24-a23a-4e02-a703-7c9832ffd729" status: 200 len: 1266 microversion: 2.1 time: 0.177039 Oct 31 12:41:42.060518 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 516/1023] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:41:41 2022] GET /compute/v2.1/servers/66820f24-a23a-4e02-a703-7c9832ffd729 => generated 1266 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:41:42.243518 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-ee424bc6-ffc4-49ba-a90f-17e36e796f9d tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:41:42.244293 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-ee424bc6-ffc4-49ba-a90f-17e36e796f9d tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] [instance: 2e4b0eaa-4452-4b28-bb3d-3ff8ef63d973] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:41:42.252228 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-ee424bc6-ffc4-49ba-a90f-17e36e796f9d tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:41:42.252750 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-ee424bc6-ffc4-49ba-a90f-17e36e796f9d tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:41:42.253240 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-ee424bc6-ffc4-49ba-a90f-17e36e796f9d tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:41:42.253967 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-ee424bc6-ffc4-49ba-a90f-17e36e796f9d tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:41:42.254422 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-ee424bc6-ffc4-49ba-a90f-17e36e796f9d tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:41:42.255147 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-ee424bc6-ffc4-49ba-a90f-17e36e796f9d tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:41:42.276579 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG dbcounter [-] [125441] Writing DB stats nova_cell1:SELECT=100 {{(pid=125441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:41:42.396382 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-ee424bc6-ffc4-49ba-a90f-17e36e796f9d tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77385d8c61994d5da4083775d202a93d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd49947a82d974a55a8cc7a6ad7b9c56e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:41:42.404777 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-ee424bc6-ffc4-49ba-a90f-17e36e796f9d tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] 10.222.0.15 "GET /compute/v2.1/servers/2e4b0eaa-4452-4b28-bb3d-3ff8ef63d973" status: 200 len: 1319 microversion: 2.1 time: 0.165718 Oct 31 12:41:42.405365 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 508/1024] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:41:42 2022] GET /compute/v2.1/servers/2e4b0eaa-4452-4b28-bb3d-3ff8ef63d973 => generated 1319 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:41:43.083637 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-4e6d8351-3087-4eaa-91d9-5d008bb57ddf tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:41:43.084356 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-4e6d8351-3087-4eaa-91d9-5d008bb57ddf tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] [instance: 66820f24-a23a-4e02-a703-7c9832ffd729] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:41:43.090913 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-4e6d8351-3087-4eaa-91d9-5d008bb57ddf tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:41:43.091425 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-4e6d8351-3087-4eaa-91d9-5d008bb57ddf tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:41:43.091861 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-4e6d8351-3087-4eaa-91d9-5d008bb57ddf tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:41:43.092545 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-4e6d8351-3087-4eaa-91d9-5d008bb57ddf tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:41:43.092995 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-4e6d8351-3087-4eaa-91d9-5d008bb57ddf tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:41:43.093414 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-4e6d8351-3087-4eaa-91d9-5d008bb57ddf tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:41:43.232854 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-4e6d8351-3087-4eaa-91d9-5d008bb57ddf tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b76d81ee9446cf9014a2e695ef03e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae8c589d0b84ce096451a10717fc601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:41:43.241316 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-4e6d8351-3087-4eaa-91d9-5d008bb57ddf tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] 10.222.0.15 "GET /compute/v2.1/servers/66820f24-a23a-4e02-a703-7c9832ffd729" status: 200 len: 1266 microversion: 2.1 time: 0.161583 Oct 31 12:41:43.241987 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 517/1025] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:41:43 2022] GET /compute/v2.1/servers/66820f24-a23a-4e02-a703-7c9832ffd729 => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:41:43.429476 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-bf1b43e1-beb0-4af2-afaf-37fd08b42b79 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:41:43.430185 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-bf1b43e1-beb0-4af2-afaf-37fd08b42b79 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] [instance: 2e4b0eaa-4452-4b28-bb3d-3ff8ef63d973] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:41:43.437313 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-bf1b43e1-beb0-4af2-afaf-37fd08b42b79 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:41:43.438473 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-bf1b43e1-beb0-4af2-afaf-37fd08b42b79 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:41:43.439157 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-bf1b43e1-beb0-4af2-afaf-37fd08b42b79 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:41:43.439989 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-bf1b43e1-beb0-4af2-afaf-37fd08b42b79 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:41:43.440527 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-bf1b43e1-beb0-4af2-afaf-37fd08b42b79 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:41:43.441017 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-bf1b43e1-beb0-4af2-afaf-37fd08b42b79 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:41:43.583336 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-bf1b43e1-beb0-4af2-afaf-37fd08b42b79 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77385d8c61994d5da4083775d202a93d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd49947a82d974a55a8cc7a6ad7b9c56e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:41:43.591397 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-bf1b43e1-beb0-4af2-afaf-37fd08b42b79 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] 10.222.0.15 "GET /compute/v2.1/servers/2e4b0eaa-4452-4b28-bb3d-3ff8ef63d973" status: 200 len: 1507 microversion: 2.1 time: 0.166335 Oct 31 12:41:43.592055 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 509/1026] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:41:43 2022] GET /compute/v2.1/servers/2e4b0eaa-4452-4b28-bb3d-3ff8ef63d973 => generated 1507 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:41:44.265910 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-c1810039-7d71-4ab3-9ee8-1b9fb299a255 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:41:44.266684 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-c1810039-7d71-4ab3-9ee8-1b9fb299a255 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] [instance: 66820f24-a23a-4e02-a703-7c9832ffd729] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:41:44.273462 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-c1810039-7d71-4ab3-9ee8-1b9fb299a255 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:41:44.273943 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-c1810039-7d71-4ab3-9ee8-1b9fb299a255 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:41:44.274371 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-c1810039-7d71-4ab3-9ee8-1b9fb299a255 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:41:44.275057 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-c1810039-7d71-4ab3-9ee8-1b9fb299a255 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:41:44.275619 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-c1810039-7d71-4ab3-9ee8-1b9fb299a255 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:41:44.276037 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-c1810039-7d71-4ab3-9ee8-1b9fb299a255 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:41:44.415681 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-c1810039-7d71-4ab3-9ee8-1b9fb299a255 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b76d81ee9446cf9014a2e695ef03e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae8c589d0b84ce096451a10717fc601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:41:44.424017 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-c1810039-7d71-4ab3-9ee8-1b9fb299a255 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] 10.222.0.15 "GET /compute/v2.1/servers/66820f24-a23a-4e02-a703-7c9832ffd729" status: 200 len: 1266 microversion: 2.1 time: 0.162490 Oct 31 12:41:44.424583 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 518/1027] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:41:44 2022] GET /compute/v2.1/servers/66820f24-a23a-4e02-a703-7c9832ffd729 => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:41:45.448033 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-72d88465-c05e-427c-957b-497c2777a07f tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:41:45.449595 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-72d88465-c05e-427c-957b-497c2777a07f tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] [instance: 66820f24-a23a-4e02-a703-7c9832ffd729] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:41:45.456471 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-72d88465-c05e-427c-957b-497c2777a07f tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:41:45.456936 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-72d88465-c05e-427c-957b-497c2777a07f tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:41:45.457364 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-72d88465-c05e-427c-957b-497c2777a07f tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:41:45.458061 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-72d88465-c05e-427c-957b-497c2777a07f tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:41:45.458513 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-72d88465-c05e-427c-957b-497c2777a07f tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:41:45.458952 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-72d88465-c05e-427c-957b-497c2777a07f tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:41:45.592116 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-72d88465-c05e-427c-957b-497c2777a07f tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b76d81ee9446cf9014a2e695ef03e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae8c589d0b84ce096451a10717fc601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:41:45.599993 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-72d88465-c05e-427c-957b-497c2777a07f tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] 10.222.0.15 "GET /compute/v2.1/servers/66820f24-a23a-4e02-a703-7c9832ffd729" status: 200 len: 1266 microversion: 2.1 time: 0.156480 Oct 31 12:41:45.600553 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 510/1028] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:41:45 2022] GET /compute/v2.1/servers/66820f24-a23a-4e02-a703-7c9832ffd729 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:41:46.623520 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-29fec746-4eb3-4a2c-ac3f-e1b04d43d92b tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:41:46.624122 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-29fec746-4eb3-4a2c-ac3f-e1b04d43d92b tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] [instance: 66820f24-a23a-4e02-a703-7c9832ffd729] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:41:46.631247 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-29fec746-4eb3-4a2c-ac3f-e1b04d43d92b tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:41:46.631725 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-29fec746-4eb3-4a2c-ac3f-e1b04d43d92b tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:41:46.632170 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-29fec746-4eb3-4a2c-ac3f-e1b04d43d92b tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:41:46.632836 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-29fec746-4eb3-4a2c-ac3f-e1b04d43d92b tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:41:46.633285 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-29fec746-4eb3-4a2c-ac3f-e1b04d43d92b tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:41:46.633706 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-29fec746-4eb3-4a2c-ac3f-e1b04d43d92b tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:41:46.774340 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-29fec746-4eb3-4a2c-ac3f-e1b04d43d92b tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b76d81ee9446cf9014a2e695ef03e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae8c589d0b84ce096451a10717fc601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:41:46.777807 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG dbcounter [-] [125440] Writing DB stats nova_cell1:SELECT=100 {{(pid=125440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:41:46.783524 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-29fec746-4eb3-4a2c-ac3f-e1b04d43d92b tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] 10.222.0.15 "GET /compute/v2.1/servers/66820f24-a23a-4e02-a703-7c9832ffd729" status: 200 len: 1266 microversion: 2.1 time: 0.163860 Oct 31 12:41:46.784170 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 519/1029] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:41:46 2022] GET /compute/v2.1/servers/66820f24-a23a-4e02-a703-7c9832ffd729 => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:41:47.028273 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [req-2054cc19-bfa9-45d2-8747-979df5cdb1fd req-95dd1027-2bf7-4e54-b20c-d34b3ff4e7cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66820f24-a23a-4e02-a703-7c9832ffd729", "name": "network-vif-plugged", "status": "completed", "tag": "bf3768f3-740b-45b9-92a5-0798ffcfacc8"}]} {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 12:41:47.040794 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [req-2054cc19-bfa9-45d2-8747-979df5cdb1fd req-95dd1027-2bf7-4e54-b20c-d34b3ff4e7cb service nova] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:41:47.041265 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [req-2054cc19-bfa9-45d2-8747-979df5cdb1fd req-95dd1027-2bf7-4e54-b20c-d34b3ff4e7cb service nova] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:41:47.041697 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [req-2054cc19-bfa9-45d2-8747-979df5cdb1fd req-95dd1027-2bf7-4e54-b20c-d34b3ff4e7cb service nova] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:41:47.052884 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.compute.server_external_events [req-2054cc19-bfa9-45d2-8747-979df5cdb1fd req-95dd1027-2bf7-4e54-b20c-d34b3ff4e7cb service nova] Creating event network-vif-plugged:bf3768f3-740b-45b9-92a5-0798ffcfacc8 for instance 66820f24-a23a-4e02-a703-7c9832ffd729 on hv-cinder-79617 Oct 31 12:41:47.057843 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [req-2054cc19-bfa9-45d2-8747-979df5cdb1fd req-95dd1027-2bf7-4e54-b20c-d34b3ff4e7cb service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033642 Oct 31 12:41:47.058441 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 511/1030] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Oct 31 12:41:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 12:41:47.807999 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-1eaddee3-642f-4842-a038-0e0fbfe3cc6d tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:41:47.808669 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-1eaddee3-642f-4842-a038-0e0fbfe3cc6d tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] [instance: 66820f24-a23a-4e02-a703-7c9832ffd729] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:41:47.815678 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-1eaddee3-642f-4842-a038-0e0fbfe3cc6d tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:41:47.816447 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-1eaddee3-642f-4842-a038-0e0fbfe3cc6d tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:41:47.816881 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-1eaddee3-642f-4842-a038-0e0fbfe3cc6d tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:41:47.817739 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-1eaddee3-642f-4842-a038-0e0fbfe3cc6d tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:41:47.818181 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-1eaddee3-642f-4842-a038-0e0fbfe3cc6d tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:41:47.818597 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-1eaddee3-642f-4842-a038-0e0fbfe3cc6d tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:41:47.962780 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-1eaddee3-642f-4842-a038-0e0fbfe3cc6d tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b76d81ee9446cf9014a2e695ef03e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae8c589d0b84ce096451a10717fc601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:41:47.972384 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-1eaddee3-642f-4842-a038-0e0fbfe3cc6d tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] 10.222.0.15 "GET /compute/v2.1/servers/66820f24-a23a-4e02-a703-7c9832ffd729" status: 200 len: 1266 microversion: 2.1 time: 0.168622 Oct 31 12:41:47.973075 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 520/1031] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:41:47 2022] GET /compute/v2.1/servers/66820f24-a23a-4e02-a703-7c9832ffd729 => generated 1266 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:41:48.998023 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-d87ff757-3451-49e1-a969-f6b8c7a11eed tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:41:48.998934 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-d87ff757-3451-49e1-a969-f6b8c7a11eed tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] [instance: 66820f24-a23a-4e02-a703-7c9832ffd729] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:41:49.005391 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-d87ff757-3451-49e1-a969-f6b8c7a11eed tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:41:49.005876 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-d87ff757-3451-49e1-a969-f6b8c7a11eed tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:41:49.006306 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-d87ff757-3451-49e1-a969-f6b8c7a11eed tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:41:49.007003 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-d87ff757-3451-49e1-a969-f6b8c7a11eed tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:41:49.007510 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-d87ff757-3451-49e1-a969-f6b8c7a11eed tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:41:49.007932 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-d87ff757-3451-49e1-a969-f6b8c7a11eed tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:41:49.389188 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-d87ff757-3451-49e1-a969-f6b8c7a11eed tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b76d81ee9446cf9014a2e695ef03e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae8c589d0b84ce096451a10717fc601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:41:49.398854 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-d87ff757-3451-49e1-a969-f6b8c7a11eed tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] 10.222.0.15 "GET /compute/v2.1/servers/66820f24-a23a-4e02-a703-7c9832ffd729" status: 200 len: 1452 microversion: 2.1 time: 0.406135 Oct 31 12:41:49.404545 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 512/1032] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:41:48 2022] GET /compute/v2.1/servers/66820f24-a23a-4e02-a703-7c9832ffd729 => generated 1452 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:41:49.420788 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-15d593ba-a0d4-4ed5-96d0-b0a202c12898 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:41:49.421397 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-15d593ba-a0d4-4ed5-96d0-b0a202c12898 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] [instance: 66820f24-a23a-4e02-a703-7c9832ffd729] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:41:49.427879 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-15d593ba-a0d4-4ed5-96d0-b0a202c12898 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:41:49.428354 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-15d593ba-a0d4-4ed5-96d0-b0a202c12898 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:41:49.428806 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-15d593ba-a0d4-4ed5-96d0-b0a202c12898 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:41:49.429508 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-15d593ba-a0d4-4ed5-96d0-b0a202c12898 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:41:49.430161 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-15d593ba-a0d4-4ed5-96d0-b0a202c12898 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:41:49.430575 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-15d593ba-a0d4-4ed5-96d0-b0a202c12898 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:41:49.572294 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-15d593ba-a0d4-4ed5-96d0-b0a202c12898 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b76d81ee9446cf9014a2e695ef03e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae8c589d0b84ce096451a10717fc601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:41:49.582139 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-15d593ba-a0d4-4ed5-96d0-b0a202c12898 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] 10.222.0.15 "GET /compute/v2.1/servers/66820f24-a23a-4e02-a703-7c9832ffd729" status: 200 len: 1452 microversion: 2.1 time: 0.165045 Oct 31 12:41:49.583014 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 521/1033] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:41:49 2022] GET /compute/v2.1/servers/66820f24-a23a-4e02-a703-7c9832ffd729 => generated 1452 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:41:51.784621 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [req-a2c5ecd8-bf45-4813-85da-6db8171f2db4 req-58797dbf-d2cd-4c7c-b835-8ad198a292af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "66820f24-a23a-4e02-a703-7c9832ffd729", "tag": "bf3768f3-740b-45b9-92a5-0798ffcfacc8"}]} {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 12:41:51.791396 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG dbcounter [-] [125441] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=6 {{(pid=125441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:41:51.799108 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [req-a2c5ecd8-bf45-4813-85da-6db8171f2db4 req-58797dbf-d2cd-4c7c-b835-8ad198a292af service nova] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:41:51.799633 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [req-a2c5ecd8-bf45-4813-85da-6db8171f2db4 req-58797dbf-d2cd-4c7c-b835-8ad198a292af service nova] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:41:51.800234 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [req-a2c5ecd8-bf45-4813-85da-6db8171f2db4 req-58797dbf-d2cd-4c7c-b835-8ad198a292af service nova] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:41:51.817156 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.compute.server_external_events [req-a2c5ecd8-bf45-4813-85da-6db8171f2db4 req-58797dbf-d2cd-4c7c-b835-8ad198a292af service nova] Creating event network-changed:bf3768f3-740b-45b9-92a5-0798ffcfacc8 for instance 66820f24-a23a-4e02-a703-7c9832ffd729 on hv-cinder-79617 Oct 31 12:41:51.822644 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [req-a2c5ecd8-bf45-4813-85da-6db8171f2db4 req-58797dbf-d2cd-4c7c-b835-8ad198a292af service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042273 Oct 31 12:41:51.823609 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 513/1034] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Oct 31 12:41:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 12:41:58.924671 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-7e059251-0ef5-4e4c-992b-0a8f0f57d6da tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5b764a59-2d8c-4b16-97e5-b70658a43a5d", "device": "/dev/sdb"}} {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 12:41:58.928068 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-7e059251-0ef5-4e4c-992b-0a8f0f57d6da tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] [instance: 2e4b0eaa-4452-4b28-bb3d-3ff8ef63d973] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:41:58.930318 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG dbcounter [-] [125440] Writing DB stats nova_api:SELECT=53 {{(pid=125440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:41:58.936358 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-7e059251-0ef5-4e4c-992b-0a8f0f57d6da tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:41:58.936876 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-7e059251-0ef5-4e4c-992b-0a8f0f57d6da tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:41:58.937340 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-7e059251-0ef5-4e4c-992b-0a8f0f57d6da tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:41:58.938041 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-7e059251-0ef5-4e4c-992b-0a8f0f57d6da tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:41:58.938678 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-7e059251-0ef5-4e4c-992b-0a8f0f57d6da tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:41:58.939296 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-7e059251-0ef5-4e4c-992b-0a8f0f57d6da tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:41:59.257687 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-7e059251-0ef5-4e4c-992b-0a8f0f57d6da tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] 10.222.0.15 "POST /compute/v2.1/servers/2e4b0eaa-4452-4b28-bb3d-3ff8ef63d973/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.337514 Oct 31 12:41:59.269118 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 522/1035] 10.222.0.15 () {60 vars in 1323 bytes} [Mon Oct 31 12:41:58 2022] POST /compute/v2.1/servers/2e4b0eaa-4452-4b28-bb3d-3ff8ef63d973/os-volume_attachments => generated 194 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 12:42:11.822813 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG dbcounter [-] [125441] Writing DB stats nova_api:SELECT=1 {{(pid=125441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:42:11.823588 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG dbcounter [-] [125441] Writing DB stats nova_cell1:SELECT=24 {{(pid=125441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:42:11.827697 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-e7b2b6b1-020f-42dc-9bc5-a73fe325aa18 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Action: 'create', calling method: .version_select at 0x7f2aa508d5e0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-900841478", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJQizo9cPet8vRaBbh93ZhMPtlzO+v9g0zm4/SaAO2cOFJ2lb4fxOBrhe1VKB7fUyy7+zUnz+PfWgn+3EHpXwtczpZ5xOnv7XCVuX7rt6xldKb0DBMQEhDPeuGo4pF+Jpg=="}} {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 12:42:11.843919 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.quota [None req-e7b2b6b1-020f-42dc-9bc5-a73fe325aa18 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Getting quotas for project 0637756aceaf4644bf263b5b5d72d9ac. Resources: {'key_pairs'} {{(pid=125441) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 12:42:11.848819 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.quota [None req-e7b2b6b1-020f-42dc-9bc5-a73fe325aa18 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Getting quotas for user 5ddf1d02fa2644d280d9dee5b3101366 and project 0637756aceaf4644bf263b5b5d72d9ac. Resources: {'key_pairs'} {{(pid=125441) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 12:42:11.871593 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-e7b2b6b1-020f-42dc-9bc5-a73fe325aa18 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.050287 Oct 31 12:42:11.872190 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 514/1036] 10.222.0.15 () {60 vars in 1159 bytes} [Mon Oct 31 12:42:11 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 12:42:11.923776 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG dbcounter [-] [125440] Writing DB stats nova_api:SELECT=1 {{(pid=125440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:42:11.925147 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG dbcounter [-] [125440] Writing DB stats nova_cell1:SELECT=23,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:42:11.929824 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-841c9c79-2b7e-4cbc-8e25-a2f4604da0c8 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-375989459", "imageRef": "083006e0-065a-4ef7-a9fa-c2e476407b53", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-900841478", "networks": [{"uuid": "bf88a9e5-c149-46bf-b319-2087f5cca550"}]}} {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 12:42:11.985241 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.network.neutron [None req-841c9c79-2b7e-4cbc-8e25-a2f4604da0c8 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] validate_networks() for [('bf88a9e5-c149-46bf-b319-2087f5cca550', None, None, None, None, None)] {{(pid=125440) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 12:42:12.355204 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.virt.hardware [None req-841c9c79-2b7e-4cbc-8e25-a2f4604da0c8 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Flavor limits 0:0:0 {{(pid=125440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 12:42:12.355625 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.virt.hardware [None req-841c9c79-2b7e-4cbc-8e25-a2f4604da0c8 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Image limits 0:0:0 {{(pid=125440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 12:42:12.356094 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.virt.hardware [None req-841c9c79-2b7e-4cbc-8e25-a2f4604da0c8 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Flavor pref 0:0:0 {{(pid=125440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 12:42:12.356529 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.virt.hardware [None req-841c9c79-2b7e-4cbc-8e25-a2f4604da0c8 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Image pref 0:0:0 {{(pid=125440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 12:42:12.356932 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.virt.hardware [None req-841c9c79-2b7e-4cbc-8e25-a2f4604da0c8 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 12:42:12.365683 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-841c9c79-2b7e-4cbc-8e25-a2f4604da0c8 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:42:12.366158 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-841c9c79-2b7e-4cbc-8e25-a2f4604da0c8 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:42:12.366586 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-841c9c79-2b7e-4cbc-8e25-a2f4604da0c8 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:42:12.367344 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-841c9c79-2b7e-4cbc-8e25-a2f4604da0c8 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:42:12.367819 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-841c9c79-2b7e-4cbc-8e25-a2f4604da0c8 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:42:12.368234 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-841c9c79-2b7e-4cbc-8e25-a2f4604da0c8 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:42:12.385410 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.quota [None req-841c9c79-2b7e-4cbc-8e25-a2f4604da0c8 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Getting quotas for project 0637756aceaf4644bf263b5b5d72d9ac. Resources: {'instances', 'cores', 'ram'} {{(pid=125440) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 12:42:12.389259 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.quota [None req-841c9c79-2b7e-4cbc-8e25-a2f4604da0c8 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Getting quotas for user 5ddf1d02fa2644d280d9dee5b3101366 and project 0637756aceaf4644bf263b5b5d72d9ac. Resources: {'instances', 'cores', 'ram'} {{(pid=125440) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 12:42:12.400963 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-841c9c79-2b7e-4cbc-8e25-a2f4604da0c8 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Going to run 1 instances... {{(pid=125440) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 12:42:12.403285 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-841c9c79-2b7e-4cbc-8e25-a2f4604da0c8 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] [instance: b4f99a06-df16-4bff-b028-70add159b4ee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='083006e0-065a-4ef7-a9fa-c2e476407b53',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125440) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 12:42:12.448364 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-841c9c79-2b7e-4cbc-8e25-a2f4604da0c8 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.526060 Oct 31 12:42:12.449014 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 523/1037] 10.222.0.15 () {60 vars in 1147 bytes} [Mon Oct 31 12:42:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 528 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 31 12:42:12.460606 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-2d11837e-96a8-4ac5-afa3-68a61449f489 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:42:12.461474 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-2d11837e-96a8-4ac5-afa3-68a61449f489 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] [instance: b4f99a06-df16-4bff-b028-70add159b4ee] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:42:12.515367 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-2d11837e-96a8-4ac5-afa3-68a61449f489 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ddf1d02fa2644d280d9dee5b3101366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0637756aceaf4644bf263b5b5d72d9ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:42:12.523765 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-2d11837e-96a8-4ac5-afa3-68a61449f489 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] 10.222.0.15 "GET /compute/v2.1/servers/b4f99a06-df16-4bff-b028-70add159b4ee" status: 200 len: 1257 microversion: 2.1 time: 0.067665 Oct 31 12:42:12.524323 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 515/1038] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:42:12 2022] GET /compute/v2.1/servers/b4f99a06-df16-4bff-b028-70add159b4ee => generated 1257 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:42:13.547125 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-b18339d7-35ba-41a8-a7be-989f85463d71 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:42:13.547764 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-b18339d7-35ba-41a8-a7be-989f85463d71 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] [instance: b4f99a06-df16-4bff-b028-70add159b4ee] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:42:13.554084 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-b18339d7-35ba-41a8-a7be-989f85463d71 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:42:13.554559 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-b18339d7-35ba-41a8-a7be-989f85463d71 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:42:13.554982 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-b18339d7-35ba-41a8-a7be-989f85463d71 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:42:13.555707 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-b18339d7-35ba-41a8-a7be-989f85463d71 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:42:13.556156 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-b18339d7-35ba-41a8-a7be-989f85463d71 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:42:13.556574 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-b18339d7-35ba-41a8-a7be-989f85463d71 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:42:13.616345 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-b18339d7-35ba-41a8-a7be-989f85463d71 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ddf1d02fa2644d280d9dee5b3101366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0637756aceaf4644bf263b5b5d72d9ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:42:13.623942 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-b18339d7-35ba-41a8-a7be-989f85463d71 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] 10.222.0.15 "GET /compute/v2.1/servers/b4f99a06-df16-4bff-b028-70add159b4ee" status: 200 len: 1261 microversion: 2.1 time: 0.081217 Oct 31 12:42:13.624509 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 524/1039] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:42:13 2022] GET /compute/v2.1/servers/b4f99a06-df16-4bff-b028-70add159b4ee => generated 1261 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:42:14.646777 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-5be767e0-20f0-4afa-9ee2-4d4d774d4113 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:42:14.647436 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-5be767e0-20f0-4afa-9ee2-4d4d774d4113 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] [instance: b4f99a06-df16-4bff-b028-70add159b4ee] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:42:14.654053 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-5be767e0-20f0-4afa-9ee2-4d4d774d4113 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:42:14.654533 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-5be767e0-20f0-4afa-9ee2-4d4d774d4113 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:42:14.654996 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-5be767e0-20f0-4afa-9ee2-4d4d774d4113 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:42:14.655717 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-5be767e0-20f0-4afa-9ee2-4d4d774d4113 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:42:14.656170 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-5be767e0-20f0-4afa-9ee2-4d4d774d4113 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:42:14.656605 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-5be767e0-20f0-4afa-9ee2-4d4d774d4113 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:42:14.720981 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-5be767e0-20f0-4afa-9ee2-4d4d774d4113 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ddf1d02fa2644d280d9dee5b3101366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0637756aceaf4644bf263b5b5d72d9ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:42:14.727320 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-5be767e0-20f0-4afa-9ee2-4d4d774d4113 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] 10.222.0.15 "GET /compute/v2.1/servers/b4f99a06-df16-4bff-b028-70add159b4ee" status: 200 len: 1253 microversion: 2.1 time: 0.085278 Oct 31 12:42:14.728072 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 516/1040] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:42:14 2022] GET /compute/v2.1/servers/b4f99a06-df16-4bff-b028-70add159b4ee => generated 1253 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:42:15.752236 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-2b222532-84f7-4d9c-a129-c998c60796ed tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:42:15.754427 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-2b222532-84f7-4d9c-a129-c998c60796ed tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] [instance: b4f99a06-df16-4bff-b028-70add159b4ee] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:42:15.767889 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-2b222532-84f7-4d9c-a129-c998c60796ed tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:42:15.768406 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-2b222532-84f7-4d9c-a129-c998c60796ed tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:42:15.770073 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-2b222532-84f7-4d9c-a129-c998c60796ed tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:42:15.770862 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-2b222532-84f7-4d9c-a129-c998c60796ed tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:42:15.771371 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-2b222532-84f7-4d9c-a129-c998c60796ed tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:42:15.771787 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-2b222532-84f7-4d9c-a129-c998c60796ed tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:42:15.929124 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-2b222532-84f7-4d9c-a129-c998c60796ed tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ddf1d02fa2644d280d9dee5b3101366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0637756aceaf4644bf263b5b5d72d9ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:42:15.947601 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-2b222532-84f7-4d9c-a129-c998c60796ed tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] 10.222.0.15 "GET /compute/v2.1/servers/b4f99a06-df16-4bff-b028-70add159b4ee" status: 200 len: 1315 microversion: 2.1 time: 0.196826 Oct 31 12:42:15.951333 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 525/1041] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:42:15 2022] GET /compute/v2.1/servers/b4f99a06-df16-4bff-b028-70add159b4ee => generated 1315 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:42:16.983536 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-a7867662-b2be-4ed1-b2c4-817bc1933406 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:42:16.984117 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-a7867662-b2be-4ed1-b2c4-817bc1933406 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] [instance: b4f99a06-df16-4bff-b028-70add159b4ee] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:42:16.991495 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-a7867662-b2be-4ed1-b2c4-817bc1933406 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:42:16.992005 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-a7867662-b2be-4ed1-b2c4-817bc1933406 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:42:16.992435 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-a7867662-b2be-4ed1-b2c4-817bc1933406 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:42:16.993164 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-a7867662-b2be-4ed1-b2c4-817bc1933406 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:42:16.993615 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-a7867662-b2be-4ed1-b2c4-817bc1933406 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:42:16.994041 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-a7867662-b2be-4ed1-b2c4-817bc1933406 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:42:17.135144 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-a7867662-b2be-4ed1-b2c4-817bc1933406 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ddf1d02fa2644d280d9dee5b3101366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0637756aceaf4644bf263b5b5d72d9ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:42:17.143265 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-a7867662-b2be-4ed1-b2c4-817bc1933406 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] 10.222.0.15 "GET /compute/v2.1/servers/b4f99a06-df16-4bff-b028-70add159b4ee" status: 200 len: 1357 microversion: 2.1 time: 0.168304 Oct 31 12:42:17.143901 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 517/1042] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:42:16 2022] GET /compute/v2.1/servers/b4f99a06-df16-4bff-b028-70add159b4ee => generated 1357 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:42:18.164897 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-c34d47f6-6ea4-41da-8420-73ed68e1a5e6 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:42:18.165701 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-c34d47f6-6ea4-41da-8420-73ed68e1a5e6 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] [instance: b4f99a06-df16-4bff-b028-70add159b4ee] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:42:18.172543 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-c34d47f6-6ea4-41da-8420-73ed68e1a5e6 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:42:18.173079 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-c34d47f6-6ea4-41da-8420-73ed68e1a5e6 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:42:18.173436 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-c34d47f6-6ea4-41da-8420-73ed68e1a5e6 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:42:18.177009 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-c34d47f6-6ea4-41da-8420-73ed68e1a5e6 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:42:18.177009 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-c34d47f6-6ea4-41da-8420-73ed68e1a5e6 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:42:18.177009 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-c34d47f6-6ea4-41da-8420-73ed68e1a5e6 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:42:18.326745 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-c34d47f6-6ea4-41da-8420-73ed68e1a5e6 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ddf1d02fa2644d280d9dee5b3101366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0637756aceaf4644bf263b5b5d72d9ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:42:18.334530 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-c34d47f6-6ea4-41da-8420-73ed68e1a5e6 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] 10.222.0.15 "GET /compute/v2.1/servers/b4f99a06-df16-4bff-b028-70add159b4ee" status: 200 len: 1357 microversion: 2.1 time: 0.173618 Oct 31 12:42:18.335093 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 526/1043] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:42:18 2022] GET /compute/v2.1/servers/b4f99a06-df16-4bff-b028-70add159b4ee => generated 1357 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:42:19.356973 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-31429bb1-b066-4556-aefd-f4b219598c0c tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:42:19.357578 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-31429bb1-b066-4556-aefd-f4b219598c0c tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] [instance: b4f99a06-df16-4bff-b028-70add159b4ee] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:42:19.364246 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-31429bb1-b066-4556-aefd-f4b219598c0c tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:42:19.364733 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-31429bb1-b066-4556-aefd-f4b219598c0c tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:42:19.365741 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-31429bb1-b066-4556-aefd-f4b219598c0c tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:42:19.366449 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-31429bb1-b066-4556-aefd-f4b219598c0c tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:42:19.366903 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-31429bb1-b066-4556-aefd-f4b219598c0c tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:42:19.367353 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-31429bb1-b066-4556-aefd-f4b219598c0c tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:42:19.521921 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-31429bb1-b066-4556-aefd-f4b219598c0c tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ddf1d02fa2644d280d9dee5b3101366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0637756aceaf4644bf263b5b5d72d9ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:42:19.529484 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-31429bb1-b066-4556-aefd-f4b219598c0c tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] 10.222.0.15 "GET /compute/v2.1/servers/b4f99a06-df16-4bff-b028-70add159b4ee" status: 200 len: 1357 microversion: 2.1 time: 0.176414 Oct 31 12:42:19.530049 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 518/1044] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:42:19 2022] GET /compute/v2.1/servers/b4f99a06-df16-4bff-b028-70add159b4ee => generated 1357 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:42:20.553080 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-d19cf312-b78a-4d4a-baf1-15ed407e6f5c tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:42:20.553963 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-d19cf312-b78a-4d4a-baf1-15ed407e6f5c tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] [instance: b4f99a06-df16-4bff-b028-70add159b4ee] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:42:20.560834 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-d19cf312-b78a-4d4a-baf1-15ed407e6f5c tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:42:20.561314 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-d19cf312-b78a-4d4a-baf1-15ed407e6f5c tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:42:20.561749 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-d19cf312-b78a-4d4a-baf1-15ed407e6f5c tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:42:20.562429 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-d19cf312-b78a-4d4a-baf1-15ed407e6f5c tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:42:20.563107 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-d19cf312-b78a-4d4a-baf1-15ed407e6f5c tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:42:20.563727 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-d19cf312-b78a-4d4a-baf1-15ed407e6f5c tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:42:20.703279 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-d19cf312-b78a-4d4a-baf1-15ed407e6f5c tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ddf1d02fa2644d280d9dee5b3101366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0637756aceaf4644bf263b5b5d72d9ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:42:20.711503 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-d19cf312-b78a-4d4a-baf1-15ed407e6f5c tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] 10.222.0.15 "GET /compute/v2.1/servers/b4f99a06-df16-4bff-b028-70add159b4ee" status: 200 len: 1357 microversion: 2.1 time: 0.162628 Oct 31 12:42:20.712087 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 527/1045] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:42:20 2022] GET /compute/v2.1/servers/b4f99a06-df16-4bff-b028-70add159b4ee => generated 1357 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:42:21.735125 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-22b27410-190a-4c60-ab2b-0865526832b9 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:42:21.735743 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-22b27410-190a-4c60-ab2b-0865526832b9 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] [instance: b4f99a06-df16-4bff-b028-70add159b4ee] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:42:21.742574 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-22b27410-190a-4c60-ab2b-0865526832b9 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:42:21.743051 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-22b27410-190a-4c60-ab2b-0865526832b9 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:42:21.743510 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-22b27410-190a-4c60-ab2b-0865526832b9 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:42:21.744194 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-22b27410-190a-4c60-ab2b-0865526832b9 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:42:21.744646 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-22b27410-190a-4c60-ab2b-0865526832b9 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:42:21.745063 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-22b27410-190a-4c60-ab2b-0865526832b9 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:42:21.883403 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-22b27410-190a-4c60-ab2b-0865526832b9 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ddf1d02fa2644d280d9dee5b3101366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0637756aceaf4644bf263b5b5d72d9ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:42:21.892443 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-22b27410-190a-4c60-ab2b-0865526832b9 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] 10.222.0.15 "GET /compute/v2.1/servers/b4f99a06-df16-4bff-b028-70add159b4ee" status: 200 len: 1357 microversion: 2.1 time: 0.160983 Oct 31 12:42:21.893351 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 519/1046] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:42:21 2022] GET /compute/v2.1/servers/b4f99a06-df16-4bff-b028-70add159b4ee => generated 1357 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:42:22.929599 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-7cebcecf-a02a-4cb9-a11f-d266e3617098 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:42:22.932771 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-7cebcecf-a02a-4cb9-a11f-d266e3617098 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] [instance: b4f99a06-df16-4bff-b028-70add159b4ee] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:42:22.944962 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG dbcounter [-] [125440] Writing DB stats nova_cell0:SELECT=2 {{(pid=125440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:42:22.946213 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG dbcounter [-] [125440] Writing DB stats nova_cell0:SELECT=6 {{(pid=125440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:42:22.952199 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-7cebcecf-a02a-4cb9-a11f-d266e3617098 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:42:22.990714 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-7cebcecf-a02a-4cb9-a11f-d266e3617098 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:42:22.990714 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-7cebcecf-a02a-4cb9-a11f-d266e3617098 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:42:22.990714 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-7cebcecf-a02a-4cb9-a11f-d266e3617098 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:42:22.990714 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-7cebcecf-a02a-4cb9-a11f-d266e3617098 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:42:22.991157 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-7cebcecf-a02a-4cb9-a11f-d266e3617098 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:42:23.360590 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-7cebcecf-a02a-4cb9-a11f-d266e3617098 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ddf1d02fa2644d280d9dee5b3101366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0637756aceaf4644bf263b5b5d72d9ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:42:23.369315 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-7cebcecf-a02a-4cb9-a11f-d266e3617098 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] 10.222.0.15 "GET /compute/v2.1/servers/b4f99a06-df16-4bff-b028-70add159b4ee" status: 200 len: 1357 microversion: 2.1 time: 0.451304 Oct 31 12:42:23.369894 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 528/1047] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:42:22 2022] GET /compute/v2.1/servers/b4f99a06-df16-4bff-b028-70add159b4ee => generated 1357 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:42:24.392349 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-80944548-d2e4-4526-979a-6dec04d35576 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:42:24.392939 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-80944548-d2e4-4526-979a-6dec04d35576 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] [instance: b4f99a06-df16-4bff-b028-70add159b4ee] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:42:24.394702 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG dbcounter [-] [125441] Writing DB stats nova_cell0:SELECT=6 {{(pid=125441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:42:24.401419 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-80944548-d2e4-4526-979a-6dec04d35576 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:42:24.401912 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-80944548-d2e4-4526-979a-6dec04d35576 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:42:24.402347 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-80944548-d2e4-4526-979a-6dec04d35576 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:42:24.403051 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-80944548-d2e4-4526-979a-6dec04d35576 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:42:24.403535 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-80944548-d2e4-4526-979a-6dec04d35576 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:42:24.403962 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-80944548-d2e4-4526-979a-6dec04d35576 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:42:24.541358 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-80944548-d2e4-4526-979a-6dec04d35576 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ddf1d02fa2644d280d9dee5b3101366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0637756aceaf4644bf263b5b5d72d9ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:42:24.549147 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-80944548-d2e4-4526-979a-6dec04d35576 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] 10.222.0.15 "GET /compute/v2.1/servers/b4f99a06-df16-4bff-b028-70add159b4ee" status: 200 len: 1357 microversion: 2.1 time: 0.161166 Oct 31 12:42:24.550064 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 520/1048] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:42:24 2022] GET /compute/v2.1/servers/b4f99a06-df16-4bff-b028-70add159b4ee => generated 1357 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:42:24.662445 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-b7f70165-ae73-460b-a29e-683a5e140ebc tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:42:24.663098 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-b7f70165-ae73-460b-a29e-683a5e140ebc tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] [instance: 2e4b0eaa-4452-4b28-bb3d-3ff8ef63d973] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:42:24.669845 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-b7f70165-ae73-460b-a29e-683a5e140ebc tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:42:24.670336 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-b7f70165-ae73-460b-a29e-683a5e140ebc tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:42:24.670769 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-b7f70165-ae73-460b-a29e-683a5e140ebc tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:42:24.671492 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-b7f70165-ae73-460b-a29e-683a5e140ebc tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:42:24.671946 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-b7f70165-ae73-460b-a29e-683a5e140ebc tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:42:24.672362 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-b7f70165-ae73-460b-a29e-683a5e140ebc tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:42:24.755687 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.objects.instance [None req-b7f70165-ae73-460b-a29e-683a5e140ebc tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Lazy-loading 'services' on Instance uuid 2e4b0eaa-4452-4b28-bb3d-3ff8ef63d973 {{(pid=125440) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 12:42:24.830114 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-b7f70165-ae73-460b-a29e-683a5e140ebc tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] 10.222.0.15 "DELETE /compute/v2.1/servers/2e4b0eaa-4452-4b28-bb3d-3ff8ef63d973/os-volume_attachments/5b764a59-2d8c-4b16-97e5-b70658a43a5d" status: 202 len: 0 microversion: 2.1 time: 0.172107 Oct 31 12:42:24.830722 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 529/1049] 10.222.0.15 () {58 vars in 1416 bytes} [Mon Oct 31 12:42:24 2022] DELETE /compute/v2.1/servers/2e4b0eaa-4452-4b28-bb3d-3ff8ef63d973/os-volume_attachments/5b764a59-2d8c-4b16-97e5-b70658a43a5d => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 12:42:25.572226 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-91c8776d-467a-481d-b6a3-6363e71435f2 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:42:25.572827 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-91c8776d-467a-481d-b6a3-6363e71435f2 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] [instance: b4f99a06-df16-4bff-b028-70add159b4ee] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:42:25.579587 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-91c8776d-467a-481d-b6a3-6363e71435f2 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:42:25.580062 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-91c8776d-467a-481d-b6a3-6363e71435f2 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:42:25.580491 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-91c8776d-467a-481d-b6a3-6363e71435f2 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:42:25.581172 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-91c8776d-467a-481d-b6a3-6363e71435f2 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:42:25.581624 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-91c8776d-467a-481d-b6a3-6363e71435f2 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:42:25.582036 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-91c8776d-467a-481d-b6a3-6363e71435f2 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:42:25.713960 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-91c8776d-467a-481d-b6a3-6363e71435f2 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ddf1d02fa2644d280d9dee5b3101366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0637756aceaf4644bf263b5b5d72d9ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:42:25.721656 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-91c8776d-467a-481d-b6a3-6363e71435f2 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] 10.222.0.15 "GET /compute/v2.1/servers/b4f99a06-df16-4bff-b028-70add159b4ee" status: 200 len: 1357 microversion: 2.1 time: 0.153318 Oct 31 12:42:25.722223 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 521/1050] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:42:25 2022] GET /compute/v2.1/servers/b4f99a06-df16-4bff-b028-70add159b4ee => generated 1357 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 12:42:26.061684 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [req-90545881-2335-429c-814c-c0e3f0e78093 req-8ab11bf6-4984-4cd8-8d38-03f4b76a71db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b4f99a06-df16-4bff-b028-70add159b4ee", "tag": "16976c96-0697-482f-bcc1-98d0bc00538f"}]} {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 12:42:26.075216 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [req-90545881-2335-429c-814c-c0e3f0e78093 req-8ab11bf6-4984-4cd8-8d38-03f4b76a71db service nova] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:42:26.075697 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [req-90545881-2335-429c-814c-c0e3f0e78093 req-8ab11bf6-4984-4cd8-8d38-03f4b76a71db service nova] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:42:26.076123 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [req-90545881-2335-429c-814c-c0e3f0e78093 req-8ab11bf6-4984-4cd8-8d38-03f4b76a71db service nova] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:42:26.088404 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.compute.server_external_events [req-90545881-2335-429c-814c-c0e3f0e78093 req-8ab11bf6-4984-4cd8-8d38-03f4b76a71db service nova] Creating event network-changed:16976c96-0697-482f-bcc1-98d0bc00538f for instance b4f99a06-df16-4bff-b028-70add159b4ee on hv-cinder-79617 Oct 31 12:42:26.093072 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [req-90545881-2335-429c-814c-c0e3f0e78093 req-8ab11bf6-4984-4cd8-8d38-03f4b76a71db service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036625 Oct 31 12:42:26.093809 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 530/1051] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Oct 31 12:42:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 12:42:26.745301 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-74a0d779-5391-4415-8961-9d6e8394b47e tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:42:26.745841 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-74a0d779-5391-4415-8961-9d6e8394b47e tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] [instance: b4f99a06-df16-4bff-b028-70add159b4ee] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:42:26.752215 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-74a0d779-5391-4415-8961-9d6e8394b47e tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:42:26.752696 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-74a0d779-5391-4415-8961-9d6e8394b47e tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:42:26.753158 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-74a0d779-5391-4415-8961-9d6e8394b47e tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:42:26.753849 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-74a0d779-5391-4415-8961-9d6e8394b47e tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:42:26.754306 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-74a0d779-5391-4415-8961-9d6e8394b47e tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:42:26.754730 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-74a0d779-5391-4415-8961-9d6e8394b47e tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:42:26.884884 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-74a0d779-5391-4415-8961-9d6e8394b47e tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ddf1d02fa2644d280d9dee5b3101366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0637756aceaf4644bf263b5b5d72d9ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:42:26.892713 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-74a0d779-5391-4415-8961-9d6e8394b47e tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] 10.222.0.15 "GET /compute/v2.1/servers/b4f99a06-df16-4bff-b028-70add159b4ee" status: 200 len: 1357 microversion: 2.1 time: 0.151455 Oct 31 12:42:26.893279 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 522/1052] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:42:26 2022] GET /compute/v2.1/servers/b4f99a06-df16-4bff-b028-70add159b4ee => generated 1357 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:42:27.028887 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-38574782-0b23-4dba-b7f4-0a14137586f2 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:42:27.029456 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-38574782-0b23-4dba-b7f4-0a14137586f2 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] [instance: 2e4b0eaa-4452-4b28-bb3d-3ff8ef63d973] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:42:27.035578 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-38574782-0b23-4dba-b7f4-0a14137586f2 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:42:27.036048 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-38574782-0b23-4dba-b7f4-0a14137586f2 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:42:27.036586 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-38574782-0b23-4dba-b7f4-0a14137586f2 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:42:27.038481 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-38574782-0b23-4dba-b7f4-0a14137586f2 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:42:27.038962 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-38574782-0b23-4dba-b7f4-0a14137586f2 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:42:27.039425 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-38574782-0b23-4dba-b7f4-0a14137586f2 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:42:27.064517 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-38574782-0b23-4dba-b7f4-0a14137586f2 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] [instance: 2e4b0eaa-4452-4b28-bb3d-3ff8ef63d973] Going to try to terminate instance {{(pid=125440) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 12:42:27.138707 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-38574782-0b23-4dba-b7f4-0a14137586f2 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] 10.222.0.15 "DELETE /compute/v2.1/servers/2e4b0eaa-4452-4b28-bb3d-3ff8ef63d973" status: 204 len: 0 microversion: 2.1 time: 0.113720 Oct 31 12:42:27.139307 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 531/1053] 10.222.0.15 () {58 vars in 1239 bytes} [Mon Oct 31 12:42:27 2022] DELETE /compute/v2.1/servers/2e4b0eaa-4452-4b28-bb3d-3ff8ef63d973 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 12:42:27.148255 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-d4ab57ab-5903-4791-bc09-d8ed07effdf4 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:42:27.148864 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-d4ab57ab-5903-4791-bc09-d8ed07effdf4 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] [instance: 2e4b0eaa-4452-4b28-bb3d-3ff8ef63d973] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:42:27.155100 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-d4ab57ab-5903-4791-bc09-d8ed07effdf4 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:42:27.155696 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-d4ab57ab-5903-4791-bc09-d8ed07effdf4 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:42:27.156110 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-d4ab57ab-5903-4791-bc09-d8ed07effdf4 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:42:27.156803 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-d4ab57ab-5903-4791-bc09-d8ed07effdf4 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:42:27.157257 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-d4ab57ab-5903-4791-bc09-d8ed07effdf4 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:42:27.157678 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-d4ab57ab-5903-4791-bc09-d8ed07effdf4 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:42:27.286061 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-d4ab57ab-5903-4791-bc09-d8ed07effdf4 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77385d8c61994d5da4083775d202a93d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd49947a82d974a55a8cc7a6ad7b9c56e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:42:27.294515 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-d4ab57ab-5903-4791-bc09-d8ed07effdf4 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] 10.222.0.15 "GET /compute/v2.1/servers/2e4b0eaa-4452-4b28-bb3d-3ff8ef63d973" status: 200 len: 1513 microversion: 2.1 time: 0.150711 Oct 31 12:42:27.295079 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 523/1054] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:42:27 2022] GET /compute/v2.1/servers/2e4b0eaa-4452-4b28-bb3d-3ff8ef63d973 => generated 1513 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:42:27.916599 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-c327f190-a239-4467-b7df-ea959c5910f3 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:42:27.917204 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-c327f190-a239-4467-b7df-ea959c5910f3 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] [instance: b4f99a06-df16-4bff-b028-70add159b4ee] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:42:27.922986 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-c327f190-a239-4467-b7df-ea959c5910f3 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:42:27.923493 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-c327f190-a239-4467-b7df-ea959c5910f3 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:42:27.923913 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-c327f190-a239-4467-b7df-ea959c5910f3 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:42:27.924584 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-c327f190-a239-4467-b7df-ea959c5910f3 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:42:27.925026 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-c327f190-a239-4467-b7df-ea959c5910f3 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:42:27.925436 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-c327f190-a239-4467-b7df-ea959c5910f3 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:42:28.058523 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-c327f190-a239-4467-b7df-ea959c5910f3 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ddf1d02fa2644d280d9dee5b3101366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0637756aceaf4644bf263b5b5d72d9ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:42:28.066110 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-c327f190-a239-4467-b7df-ea959c5910f3 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] 10.222.0.15 "GET /compute/v2.1/servers/b4f99a06-df16-4bff-b028-70add159b4ee" status: 200 len: 1357 microversion: 2.1 time: 0.154447 Oct 31 12:42:28.066732 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 532/1055] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:42:27 2022] GET /compute/v2.1/servers/b4f99a06-df16-4bff-b028-70add159b4ee => generated 1357 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:42:28.319389 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-b22c9319-c98c-40c7-814b-498ca8d79435 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:42:28.320019 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-b22c9319-c98c-40c7-814b-498ca8d79435 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] [instance: 2e4b0eaa-4452-4b28-bb3d-3ff8ef63d973] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:42:28.326370 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-b22c9319-c98c-40c7-814b-498ca8d79435 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:42:28.326842 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-b22c9319-c98c-40c7-814b-498ca8d79435 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:42:28.327300 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-b22c9319-c98c-40c7-814b-498ca8d79435 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:42:28.327974 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-b22c9319-c98c-40c7-814b-498ca8d79435 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:42:28.328427 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-b22c9319-c98c-40c7-814b-498ca8d79435 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:42:28.328837 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-b22c9319-c98c-40c7-814b-498ca8d79435 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:42:28.459064 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-b22c9319-c98c-40c7-814b-498ca8d79435 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77385d8c61994d5da4083775d202a93d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd49947a82d974a55a8cc7a6ad7b9c56e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:42:28.466923 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-b22c9319-c98c-40c7-814b-498ca8d79435 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] 10.222.0.15 "GET /compute/v2.1/servers/2e4b0eaa-4452-4b28-bb3d-3ff8ef63d973" status: 200 len: 1513 microversion: 2.1 time: 0.152108 Oct 31 12:42:28.467516 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 524/1056] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:42:28 2022] GET /compute/v2.1/servers/2e4b0eaa-4452-4b28-bb3d-3ff8ef63d973 => generated 1513 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:42:29.089569 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-97296b7d-fa51-4a99-8669-cadde1895453 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:42:29.090278 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-97296b7d-fa51-4a99-8669-cadde1895453 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] [instance: b4f99a06-df16-4bff-b028-70add159b4ee] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:42:29.096687 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-97296b7d-fa51-4a99-8669-cadde1895453 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:42:29.097158 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-97296b7d-fa51-4a99-8669-cadde1895453 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:42:29.097578 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-97296b7d-fa51-4a99-8669-cadde1895453 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:42:29.098453 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-97296b7d-fa51-4a99-8669-cadde1895453 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:42:29.098902 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-97296b7d-fa51-4a99-8669-cadde1895453 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:42:29.099429 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-97296b7d-fa51-4a99-8669-cadde1895453 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:42:29.356947 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-97296b7d-fa51-4a99-8669-cadde1895453 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ddf1d02fa2644d280d9dee5b3101366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0637756aceaf4644bf263b5b5d72d9ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:42:29.366251 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-97296b7d-fa51-4a99-8669-cadde1895453 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] 10.222.0.15 "GET /compute/v2.1/servers/b4f99a06-df16-4bff-b028-70add159b4ee" status: 200 len: 1357 microversion: 2.1 time: 0.280177 Oct 31 12:42:29.366843 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 533/1057] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:42:29 2022] GET /compute/v2.1/servers/b4f99a06-df16-4bff-b028-70add159b4ee => generated 1357 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:42:29.491096 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-90cc319d-13c7-49a9-ac8f-9f898536599f tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:42:29.491735 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-90cc319d-13c7-49a9-ac8f-9f898536599f tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] [instance: 2e4b0eaa-4452-4b28-bb3d-3ff8ef63d973] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:42:29.500393 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-90cc319d-13c7-49a9-ac8f-9f898536599f tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:42:29.500876 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-90cc319d-13c7-49a9-ac8f-9f898536599f tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:42:29.501300 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-90cc319d-13c7-49a9-ac8f-9f898536599f tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:42:29.501993 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-90cc319d-13c7-49a9-ac8f-9f898536599f tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:42:29.502438 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-90cc319d-13c7-49a9-ac8f-9f898536599f tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:42:29.503096 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-90cc319d-13c7-49a9-ac8f-9f898536599f tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:42:29.647334 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-90cc319d-13c7-49a9-ac8f-9f898536599f tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77385d8c61994d5da4083775d202a93d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd49947a82d974a55a8cc7a6ad7b9c56e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:42:29.656971 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-90cc319d-13c7-49a9-ac8f-9f898536599f tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] 10.222.0.15 "GET /compute/v2.1/servers/2e4b0eaa-4452-4b28-bb3d-3ff8ef63d973" status: 200 len: 1513 microversion: 2.1 time: 0.170838 Oct 31 12:42:29.658036 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 525/1058] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:42:29 2022] GET /compute/v2.1/servers/2e4b0eaa-4452-4b28-bb3d-3ff8ef63d973 => generated 1513 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:42:29.854316 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [req-131778f7-99da-4100-99fa-f0c4d984106a req-f088ee5b-77f3-4f0d-a718-0705c4dfcc3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e4b0eaa-4452-4b28-bb3d-3ff8ef63d973", "name": "network-vif-deleted", "tag": "fd19230e-a933-459a-a46a-ee58aa368072"}]} {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 12:42:29.871264 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [req-131778f7-99da-4100-99fa-f0c4d984106a req-f088ee5b-77f3-4f0d-a718-0705c4dfcc3e service nova] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:42:29.871264 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [req-131778f7-99da-4100-99fa-f0c4d984106a req-f088ee5b-77f3-4f0d-a718-0705c4dfcc3e service nova] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:42:29.871264 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [req-131778f7-99da-4100-99fa-f0c4d984106a req-f088ee5b-77f3-4f0d-a718-0705c4dfcc3e service nova] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:42:29.879945 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.compute.server_external_events [req-131778f7-99da-4100-99fa-f0c4d984106a req-f088ee5b-77f3-4f0d-a718-0705c4dfcc3e service nova] Creating event network-vif-deleted:fd19230e-a933-459a-a46a-ee58aa368072 for instance 2e4b0eaa-4452-4b28-bb3d-3ff8ef63d973 on hv-cinder-79617 Oct 31 12:42:29.885203 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [req-131778f7-99da-4100-99fa-f0c4d984106a req-f088ee5b-77f3-4f0d-a718-0705c4dfcc3e service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034535 Oct 31 12:42:29.885824 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 534/1059] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Oct 31 12:42:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 12:42:30.390048 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-8985f647-815f-4298-9e7f-19c0c1fbc79b tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:42:30.390586 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-8985f647-815f-4298-9e7f-19c0c1fbc79b tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] [instance: b4f99a06-df16-4bff-b028-70add159b4ee] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:42:30.396845 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-8985f647-815f-4298-9e7f-19c0c1fbc79b tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:42:30.397323 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-8985f647-815f-4298-9e7f-19c0c1fbc79b tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:42:30.397757 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-8985f647-815f-4298-9e7f-19c0c1fbc79b tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:42:30.398443 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-8985f647-815f-4298-9e7f-19c0c1fbc79b tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:42:30.399590 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-8985f647-815f-4298-9e7f-19c0c1fbc79b tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:42:30.400038 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-8985f647-815f-4298-9e7f-19c0c1fbc79b tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:42:30.532972 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-8985f647-815f-4298-9e7f-19c0c1fbc79b tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ddf1d02fa2644d280d9dee5b3101366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0637756aceaf4644bf263b5b5d72d9ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:42:30.541842 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-8985f647-815f-4298-9e7f-19c0c1fbc79b tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] 10.222.0.15 "GET /compute/v2.1/servers/b4f99a06-df16-4bff-b028-70add159b4ee" status: 200 len: 1357 microversion: 2.1 time: 0.155887 Oct 31 12:42:30.542413 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 526/1060] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:42:30 2022] GET /compute/v2.1/servers/b4f99a06-df16-4bff-b028-70add159b4ee => generated 1357 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:42:30.681676 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-0503ae62-1adb-4612-9af2-b27c00ec8807 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:42:30.682314 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-0503ae62-1adb-4612-9af2-b27c00ec8807 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] [instance: 2e4b0eaa-4452-4b28-bb3d-3ff8ef63d973] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:42:30.688366 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-0503ae62-1adb-4612-9af2-b27c00ec8807 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:42:30.688845 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-0503ae62-1adb-4612-9af2-b27c00ec8807 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:42:30.689273 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-0503ae62-1adb-4612-9af2-b27c00ec8807 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:42:30.689948 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-0503ae62-1adb-4612-9af2-b27c00ec8807 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:42:30.690396 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-0503ae62-1adb-4612-9af2-b27c00ec8807 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:42:30.690812 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-0503ae62-1adb-4612-9af2-b27c00ec8807 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:42:30.703754 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.wsgi [None req-0503ae62-1adb-4612-9af2-b27c00ec8807 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] HTTP exception thrown: Instance 2e4b0eaa-4452-4b28-bb3d-3ff8ef63d973 could not be found. Oct 31 12:42:30.705337 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-0503ae62-1adb-4612-9af2-b27c00ec8807 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Request method failure captured: Oct 31 12:42:30.705337 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: request: GET /compute/v2.1/servers/2e4b0eaa-4452-4b28-bb3d-3ff8ef63d973 HTTP/1.1 Oct 31 12:42:30.705337 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: Accept: application/json Oct 31 12:42:30.705337 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: Accept-Encoding: identity Oct 31 12:42:30.705337 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: Connection: close Oct 31 12:42:30.705337 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: Content-Length: 0 Oct 31 12:42:30.705337 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: Content-Type: application/json Oct 31 12:42:30.705337 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: Host: 10.222.0.15 Oct 31 12:42:30.705337 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: Openstack-System-Scope: None Oct 31 12:42:30.705337 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: User-Agent: python-urllib3/1.26.12 Oct 31 12:42:30.705337 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Auth-Token: gAAAAABjX8JzarmqaejybMW2ECbwJH6U93ijuIQR9prfErO9Xe10M_9Cg2j2vvTtZPe0TGNB9xQjWSRSjw1XDjpuQovp07QglEaSt7K6C52GcVI5ewfRVRNsjRbKumiGzkoGrENoqGBvUxAkbfGvM8g1wo9_iwvNni5HqsB-jWLIKBLjS0wlfkc Oct 31 12:42:30.705337 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Domain-Id: None Oct 31 12:42:30.705337 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Domain-Name: None Oct 31 12:42:30.705337 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Identity-Status: Confirmed Oct 31 12:42:30.705337 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Is-Admin-Project: True Oct 31 12:42:30.705337 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Project-Domain-Id: default Oct 31 12:42:30.705337 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Project-Domain-Name: Default Oct 31 12:42:30.705337 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Project-Id: d49947a82d974a55a8cc7a6ad7b9c56e Oct 31 12:42:30.705337 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1449259902 Oct 31 12:42:30.705337 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Role: reader,member Oct 31 12:42:30.705337 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Roles: reader,member Oct 31 12:42:30.707004 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/d49947a82d974a55a8cc7a6ad7b9c56e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_d49947a82d974a55a8cc7a6ad7b9c56e", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/d49947a82d974a55a8cc7a6ad7b9c56e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/d49947a82d974a55a8cc7a6ad7b9c56e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Oct 31 12:42:30.707004 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Tenant: tempest-VolumesSnapshotTestJSON-1449259902 Oct 31 12:42:30.707004 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Tenant-Id: d49947a82d974a55a8cc7a6ad7b9c56e Oct 31 12:42:30.707004 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1449259902 Oct 31 12:42:30.707004 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-User: tempest-VolumesSnapshotTestJSON-1449259902-project Oct 31 12:42:30.707004 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-User-Domain-Id: default Oct 31 12:42:30.707004 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-User-Domain-Name: Default Oct 31 12:42:30.707004 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-User-Id: 77385d8c61994d5da4083775d202a93d Oct 31 12:42:30.707004 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-User-Name: tempest-VolumesSnapshotTestJSON-1449259902-project Oct 31 12:42:30.707004 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: method: > Oct 31 12:42:30.707004 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: exception: Instance 2e4b0eaa-4452-4b28-bb3d-3ff8ef63d973 could not be found. Oct 31 12:42:30.707004 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: action_args: {'id': '2e4b0eaa-4452-4b28-bb3d-3ff8ef63d973'} Oct 31 12:42:30.708026 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 12:42:30.708026 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 12:42:30.708026 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 12:42:30.708026 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 12:42:30.708026 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 12:42:30.708026 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 12:42:30.708026 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 12:42:30.708026 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 12:42:30.708026 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 12:42:30.708026 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 12:42:30.708026 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e4b0eaa-4452-4b28-bb3d-3ff8ef63d973 could not be found. Oct 31 12:42:30.708026 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Oct 31 12:42:30.708026 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 12:42:30.708026 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Oct 31 12:42:30.708026 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 12:42:30.708026 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 12:42:30.708026 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 12:42:30.708026 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 12:42:30.708026 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 12:42:30.708026 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 12:42:30.710590 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 12:42:30.710590 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 12:42:30.710590 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 12:42:30.710590 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 12:42:30.710590 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 12:42:30.710590 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 12:42:30.710590 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 12:42:30.710590 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e4b0eaa-4452-4b28-bb3d-3ff8ef63d973 could not be found. Oct 31 12:42:30.710590 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Oct 31 12:42:30.710590 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 12:42:30.710590 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Oct 31 12:42:30.710590 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 12:42:30.710590 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 12:42:30.710590 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 12:42:30.710590 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 12:42:30.710590 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 12:42:30.710590 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e4b0eaa-4452-4b28-bb3d-3ff8ef63d973 could not be found. Oct 31 12:42:30.710590 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Oct 31 12:42:30.712033 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-0503ae62-1adb-4612-9af2-b27c00ec8807 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Returning 404 to user: Instance 2e4b0eaa-4452-4b28-bb3d-3ff8ef63d973 could not be found. {{(pid=125440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 12:42:30.712033 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-0503ae62-1adb-4612-9af2-b27c00ec8807 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] 10.222.0.15 "GET /compute/v2.1/servers/2e4b0eaa-4452-4b28-bb3d-3ff8ef63d973" status: 404 len: 111 microversion: 2.1 time: 0.029877 Oct 31 12:42:30.712033 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 535/1061] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:42:30 2022] GET /compute/v2.1/servers/2e4b0eaa-4452-4b28-bb3d-3ff8ef63d973 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 12:42:31.326532 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [req-fa290d63-99f7-4b22-bd6e-bc6fe5f8ad8e req-129c00c1-95a3-4a5b-837f-e429b360cead service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4f99a06-df16-4bff-b028-70add159b4ee", "name": "network-vif-plugged", "status": "completed", "tag": "16976c96-0697-482f-bcc1-98d0bc00538f"}]} {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 12:42:31.336653 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [req-fa290d63-99f7-4b22-bd6e-bc6fe5f8ad8e req-129c00c1-95a3-4a5b-837f-e429b360cead service nova] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:42:31.337139 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [req-fa290d63-99f7-4b22-bd6e-bc6fe5f8ad8e req-129c00c1-95a3-4a5b-837f-e429b360cead service nova] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:42:31.337566 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [req-fa290d63-99f7-4b22-bd6e-bc6fe5f8ad8e req-129c00c1-95a3-4a5b-837f-e429b360cead service nova] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:42:31.349593 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.compute.server_external_events [req-fa290d63-99f7-4b22-bd6e-bc6fe5f8ad8e req-129c00c1-95a3-4a5b-837f-e429b360cead service nova] Creating event network-vif-plugged:16976c96-0697-482f-bcc1-98d0bc00538f for instance b4f99a06-df16-4bff-b028-70add159b4ee on hv-cinder-79617 Oct 31 12:42:31.354870 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [req-fa290d63-99f7-4b22-bd6e-bc6fe5f8ad8e req-129c00c1-95a3-4a5b-837f-e429b360cead service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031975 Oct 31 12:42:31.355518 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 527/1062] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Oct 31 12:42:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 12:42:31.565147 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-883c74c7-abf4-4320-8e4d-03bb052740b4 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:42:31.565676 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-883c74c7-abf4-4320-8e4d-03bb052740b4 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] [instance: b4f99a06-df16-4bff-b028-70add159b4ee] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:42:31.571782 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-883c74c7-abf4-4320-8e4d-03bb052740b4 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:42:31.572247 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-883c74c7-abf4-4320-8e4d-03bb052740b4 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:42:31.572666 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-883c74c7-abf4-4320-8e4d-03bb052740b4 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:42:31.573334 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-883c74c7-abf4-4320-8e4d-03bb052740b4 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:42:31.573776 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-883c74c7-abf4-4320-8e4d-03bb052740b4 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:42:31.574186 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-883c74c7-abf4-4320-8e4d-03bb052740b4 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:42:31.701907 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-883c74c7-abf4-4320-8e4d-03bb052740b4 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ddf1d02fa2644d280d9dee5b3101366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0637756aceaf4644bf263b5b5d72d9ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:42:31.710451 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-883c74c7-abf4-4320-8e4d-03bb052740b4 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] 10.222.0.15 "GET /compute/v2.1/servers/b4f99a06-df16-4bff-b028-70add159b4ee" status: 200 len: 1357 microversion: 2.1 time: 0.149184 Oct 31 12:42:31.711012 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 536/1063] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:42:31 2022] GET /compute/v2.1/servers/b4f99a06-df16-4bff-b028-70add159b4ee => generated 1357 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:42:32.734575 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-477a949f-1f42-480e-a506-9ebf4c9e4e6d tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:42:32.735304 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-477a949f-1f42-480e-a506-9ebf4c9e4e6d tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] [instance: b4f99a06-df16-4bff-b028-70add159b4ee] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:42:32.742168 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-477a949f-1f42-480e-a506-9ebf4c9e4e6d tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:42:32.742647 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-477a949f-1f42-480e-a506-9ebf4c9e4e6d tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:42:32.743078 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-477a949f-1f42-480e-a506-9ebf4c9e4e6d tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:42:32.743789 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-477a949f-1f42-480e-a506-9ebf4c9e4e6d tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:42:32.744239 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-477a949f-1f42-480e-a506-9ebf4c9e4e6d tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:42:32.744662 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-477a949f-1f42-480e-a506-9ebf4c9e4e6d tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:42:32.877592 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-477a949f-1f42-480e-a506-9ebf4c9e4e6d tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ddf1d02fa2644d280d9dee5b3101366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0637756aceaf4644bf263b5b5d72d9ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:42:32.885543 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-477a949f-1f42-480e-a506-9ebf4c9e4e6d tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] 10.222.0.15 "GET /compute/v2.1/servers/b4f99a06-df16-4bff-b028-70add159b4ee" status: 200 len: 1357 microversion: 2.1 time: 0.155752 Oct 31 12:42:32.886100 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 528/1064] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:42:32 2022] GET /compute/v2.1/servers/b4f99a06-df16-4bff-b028-70add159b4ee => generated 1357 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:42:33.908323 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-60010980-0e60-44c2-914e-b9f562ec42a6 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:42:33.908868 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-60010980-0e60-44c2-914e-b9f562ec42a6 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] [instance: b4f99a06-df16-4bff-b028-70add159b4ee] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:42:33.916027 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-60010980-0e60-44c2-914e-b9f562ec42a6 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:42:33.916499 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-60010980-0e60-44c2-914e-b9f562ec42a6 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:42:33.916920 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-60010980-0e60-44c2-914e-b9f562ec42a6 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:42:33.917593 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-60010980-0e60-44c2-914e-b9f562ec42a6 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:42:33.918036 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-60010980-0e60-44c2-914e-b9f562ec42a6 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:42:33.918447 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-60010980-0e60-44c2-914e-b9f562ec42a6 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:42:34.054432 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-60010980-0e60-44c2-914e-b9f562ec42a6 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ddf1d02fa2644d280d9dee5b3101366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0637756aceaf4644bf263b5b5d72d9ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:42:34.062298 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-60010980-0e60-44c2-914e-b9f562ec42a6 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] 10.222.0.15 "GET /compute/v2.1/servers/b4f99a06-df16-4bff-b028-70add159b4ee" status: 200 len: 1357 microversion: 2.1 time: 0.157806 Oct 31 12:42:34.062884 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 537/1065] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:42:33 2022] GET /compute/v2.1/servers/b4f99a06-df16-4bff-b028-70add159b4ee => generated 1357 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:42:35.085438 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-3d0d61e9-2adf-485a-8d71-31d74d350056 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:42:35.086114 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-3d0d61e9-2adf-485a-8d71-31d74d350056 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] [instance: b4f99a06-df16-4bff-b028-70add159b4ee] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:42:35.092985 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-3d0d61e9-2adf-485a-8d71-31d74d350056 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:42:35.093473 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-3d0d61e9-2adf-485a-8d71-31d74d350056 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:42:35.093903 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-3d0d61e9-2adf-485a-8d71-31d74d350056 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:42:35.094598 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-3d0d61e9-2adf-485a-8d71-31d74d350056 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:42:35.095053 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-3d0d61e9-2adf-485a-8d71-31d74d350056 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:42:35.095502 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-3d0d61e9-2adf-485a-8d71-31d74d350056 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:42:35.245389 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-3d0d61e9-2adf-485a-8d71-31d74d350056 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ddf1d02fa2644d280d9dee5b3101366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0637756aceaf4644bf263b5b5d72d9ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:42:35.252834 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-3d0d61e9-2adf-485a-8d71-31d74d350056 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] 10.222.0.15 "GET /compute/v2.1/servers/b4f99a06-df16-4bff-b028-70add159b4ee" status: 200 len: 1357 microversion: 2.1 time: 0.171263 Oct 31 12:42:35.253391 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 529/1066] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:42:35 2022] GET /compute/v2.1/servers/b4f99a06-df16-4bff-b028-70add159b4ee => generated 1357 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:42:36.276266 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-76917c43-12cf-4bed-8f59-08786a3beecc tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:42:36.276918 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-76917c43-12cf-4bed-8f59-08786a3beecc tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] [instance: b4f99a06-df16-4bff-b028-70add159b4ee] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:42:36.283278 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-76917c43-12cf-4bed-8f59-08786a3beecc tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:42:36.283698 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-76917c43-12cf-4bed-8f59-08786a3beecc tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:42:36.284128 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-76917c43-12cf-4bed-8f59-08786a3beecc tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:42:36.284816 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-76917c43-12cf-4bed-8f59-08786a3beecc tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:42:36.285271 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-76917c43-12cf-4bed-8f59-08786a3beecc tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:42:36.285693 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-76917c43-12cf-4bed-8f59-08786a3beecc tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:42:36.422566 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-76917c43-12cf-4bed-8f59-08786a3beecc tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ddf1d02fa2644d280d9dee5b3101366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0637756aceaf4644bf263b5b5d72d9ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:42:36.430677 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-76917c43-12cf-4bed-8f59-08786a3beecc tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] 10.222.0.15 "GET /compute/v2.1/servers/b4f99a06-df16-4bff-b028-70add159b4ee" status: 200 len: 1546 microversion: 2.1 time: 0.158259 Oct 31 12:42:36.431287 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 538/1067] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:42:36 2022] GET /compute/v2.1/servers/b4f99a06-df16-4bff-b028-70add159b4ee => generated 1546 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:42:36.453492 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-208669c5-d906-4fe3-af9c-f6c9e152bba3 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:42:36.454105 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-208669c5-d906-4fe3-af9c-f6c9e152bba3 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] [instance: b4f99a06-df16-4bff-b028-70add159b4ee] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:42:36.461245 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-208669c5-d906-4fe3-af9c-f6c9e152bba3 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:42:36.461761 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-208669c5-d906-4fe3-af9c-f6c9e152bba3 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:42:36.462213 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-208669c5-d906-4fe3-af9c-f6c9e152bba3 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:42:36.462902 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-208669c5-d906-4fe3-af9c-f6c9e152bba3 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:42:36.463410 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-208669c5-d906-4fe3-af9c-f6c9e152bba3 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:42:36.463834 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-208669c5-d906-4fe3-af9c-f6c9e152bba3 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:42:36.594053 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-208669c5-d906-4fe3-af9c-f6c9e152bba3 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ddf1d02fa2644d280d9dee5b3101366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0637756aceaf4644bf263b5b5d72d9ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:42:36.601629 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-208669c5-d906-4fe3-af9c-f6c9e152bba3 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] 10.222.0.15 "GET /compute/v2.1/servers/b4f99a06-df16-4bff-b028-70add159b4ee" status: 200 len: 1546 microversion: 2.1 time: 0.152325 Oct 31 12:42:36.602190 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 530/1068] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:42:36 2022] GET /compute/v2.1/servers/b4f99a06-df16-4bff-b028-70add159b4ee => generated 1546 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:42:36.623314 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-6519149e-bf3b-4a53-98cc-6ae99d2e5193 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:42:36.628188 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-6519149e-bf3b-4a53-98cc-6ae99d2e5193 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5ddf1d02fa2644d280d9dee5b3101366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0637756aceaf4644bf263b5b5d72d9ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:42:36.628945 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-6519149e-bf3b-4a53-98cc-6ae99d2e5193 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Searching by: {'deleted': False, 'project_id': '0637756aceaf4644bf263b5b5d72d9ac'} {{(pid=125440) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 31 12:42:36.636205 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-6519149e-bf3b-4a53-98cc-6ae99d2e5193 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:42:36.636678 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-6519149e-bf3b-4a53-98cc-6ae99d2e5193 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:42:36.637104 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-6519149e-bf3b-4a53-98cc-6ae99d2e5193 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:42:36.637813 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-6519149e-bf3b-4a53-98cc-6ae99d2e5193 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:42:36.638260 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-6519149e-bf3b-4a53-98cc-6ae99d2e5193 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:42:36.638675 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-6519149e-bf3b-4a53-98cc-6ae99d2e5193 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:42:36.726727 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.multi_cell_list [None req-6519149e-bf3b-4a53-98cc-6ae99d2e5193 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=125440) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 31 12:42:36.775681 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG dbcounter [-] [125440] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=125440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:42:36.823012 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-6519149e-bf3b-4a53-98cc-6ae99d2e5193 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] 10.222.0.15 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.203513 Oct 31 12:42:36.823548 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 539/1069] 10.222.0.15 () {58 vars in 1125 bytes} [Mon Oct 31 12:42:36 2022] GET /compute/v2.1/servers => generated 342 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 12:42:36.835205 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-166bb6f0-e36d-40ce-b806-311c9b69fe2d tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:42:36.835845 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-166bb6f0-e36d-40ce-b806-311c9b69fe2d tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] [instance: b4f99a06-df16-4bff-b028-70add159b4ee] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:42:36.841752 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-166bb6f0-e36d-40ce-b806-311c9b69fe2d tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:42:36.842211 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-166bb6f0-e36d-40ce-b806-311c9b69fe2d tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:42:36.842665 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-166bb6f0-e36d-40ce-b806-311c9b69fe2d tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:42:36.843384 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-166bb6f0-e36d-40ce-b806-311c9b69fe2d tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:42:36.843830 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-166bb6f0-e36d-40ce-b806-311c9b69fe2d tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:42:36.844243 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-166bb6f0-e36d-40ce-b806-311c9b69fe2d tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:42:36.970330 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-166bb6f0-e36d-40ce-b806-311c9b69fe2d tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ddf1d02fa2644d280d9dee5b3101366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0637756aceaf4644bf263b5b5d72d9ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:42:36.978377 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-166bb6f0-e36d-40ce-b806-311c9b69fe2d tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] 10.222.0.15 "GET /compute/v2.1/servers/b4f99a06-df16-4bff-b028-70add159b4ee" status: 200 len: 1546 microversion: 2.1 time: 0.147199 Oct 31 12:42:36.978945 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 531/1070] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:42:36 2022] GET /compute/v2.1/servers/b4f99a06-df16-4bff-b028-70add159b4ee => generated 1546 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:42:40.627587 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-094a237f-48d7-4642-9baf-1317c933f293 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1358256735", "imageRef": "fbbea321-8f0d-4092-b070-b67a6931d610", "flavorRef": "452", "networks": [{"uuid": "b1c54bb5-5772-44f7-b3d3-caf7e007e1d6"}]}} {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 12:42:40.629302 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-a72a8084-37bc-4619-9b46-04c153b67eaa tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "81c92ff7-cde7-4eb1-8b0f-630af5f8dddf"}} {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 12:42:40.631773 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-a72a8084-37bc-4619-9b46-04c153b67eaa tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] [instance: b4f99a06-df16-4bff-b028-70add159b4ee] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:42:40.638416 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-a72a8084-37bc-4619-9b46-04c153b67eaa tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:42:40.639040 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-a72a8084-37bc-4619-9b46-04c153b67eaa tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:42:40.639507 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-a72a8084-37bc-4619-9b46-04c153b67eaa tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:42:40.640199 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-a72a8084-37bc-4619-9b46-04c153b67eaa tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:42:40.640656 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-a72a8084-37bc-4619-9b46-04c153b67eaa tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:42:40.641075 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-a72a8084-37bc-4619-9b46-04c153b67eaa tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:42:40.684241 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.network.neutron [None req-094a237f-48d7-4642-9baf-1317c933f293 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] validate_networks() for [('b1c54bb5-5772-44f7-b3d3-caf7e007e1d6', None, None, None, None, None)] {{(pid=125440) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 12:42:40.775610 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG dbcounter [-] [125441] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=125441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:42:40.897044 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-a72a8084-37bc-4619-9b46-04c153b67eaa tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] 10.222.0.15 "POST /compute/v2.1/servers/b4f99a06-df16-4bff-b028-70add159b4ee/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.271429 Oct 31 12:42:40.898098 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 532/1071] 10.222.0.15 () {60 vars in 1323 bytes} [Mon Oct 31 12:42:40 2022] POST /compute/v2.1/servers/b4f99a06-df16-4bff-b028-70add159b4ee/os-volume_attachments => generated 194 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 12:42:41.057720 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.virt.hardware [None req-094a237f-48d7-4642-9baf-1317c933f293 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Flavor limits 0:0:0 {{(pid=125440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 12:42:41.058171 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.virt.hardware [None req-094a237f-48d7-4642-9baf-1317c933f293 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Image limits 0:0:0 {{(pid=125440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 12:42:41.058668 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.virt.hardware [None req-094a237f-48d7-4642-9baf-1317c933f293 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Flavor pref 0:0:0 {{(pid=125440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 12:42:41.059068 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.virt.hardware [None req-094a237f-48d7-4642-9baf-1317c933f293 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Image pref 0:0:0 {{(pid=125440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 12:42:41.059515 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.virt.hardware [None req-094a237f-48d7-4642-9baf-1317c933f293 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 12:42:41.068761 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-094a237f-48d7-4642-9baf-1317c933f293 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:42:41.069249 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-094a237f-48d7-4642-9baf-1317c933f293 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:42:41.069671 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-094a237f-48d7-4642-9baf-1317c933f293 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:42:41.070397 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-094a237f-48d7-4642-9baf-1317c933f293 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:42:41.070836 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-094a237f-48d7-4642-9baf-1317c933f293 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:42:41.071274 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-094a237f-48d7-4642-9baf-1317c933f293 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:42:41.087389 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.quota [None req-094a237f-48d7-4642-9baf-1317c933f293 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Getting quotas for project d49947a82d974a55a8cc7a6ad7b9c56e. Resources: {'instances', 'cores', 'ram'} {{(pid=125440) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 12:42:41.091257 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.quota [None req-094a237f-48d7-4642-9baf-1317c933f293 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Getting quotas for user 77385d8c61994d5da4083775d202a93d and project d49947a82d974a55a8cc7a6ad7b9c56e. Resources: {'instances', 'cores', 'ram'} {{(pid=125440) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 12:42:41.102372 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-094a237f-48d7-4642-9baf-1317c933f293 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Going to run 1 instances... {{(pid=125440) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 12:42:41.104697 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-094a237f-48d7-4642-9baf-1317c933f293 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] [instance: b34eac76-0bed-4ae9-b5f1-c6553f831af1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fbbea321-8f0d-4092-b070-b67a6931d610',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125440) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 12:42:41.148855 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-094a237f-48d7-4642-9baf-1317c933f293 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.525508 Oct 31 12:42:41.149681 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 540/1072] 10.222.0.15 () {60 vars in 1147 bytes} [Mon Oct 31 12:42:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 527 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 12:42:41.161733 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-0f0cddd7-48b0-4e9b-8f78-1ac8ace602e8 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:42:41.162736 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-0f0cddd7-48b0-4e9b-8f78-1ac8ace602e8 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] [instance: b34eac76-0bed-4ae9-b5f1-c6553f831af1] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:42:41.218832 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-0f0cddd7-48b0-4e9b-8f78-1ac8ace602e8 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77385d8c61994d5da4083775d202a93d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd49947a82d974a55a8cc7a6ad7b9c56e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:42:41.226518 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-0f0cddd7-48b0-4e9b-8f78-1ac8ace602e8 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] 10.222.0.15 "GET /compute/v2.1/servers/b34eac76-0bed-4ae9-b5f1-c6553f831af1" status: 200 len: 1219 microversion: 2.1 time: 0.069642 Oct 31 12:42:41.227097 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 533/1073] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:42:41 2022] GET /compute/v2.1/servers/b34eac76-0bed-4ae9-b5f1-c6553f831af1 => generated 1219 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:42:42.249397 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-9a152870-98b9-4798-94f5-4d94288cfc7c tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:42:42.250081 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-9a152870-98b9-4798-94f5-4d94288cfc7c tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] [instance: b34eac76-0bed-4ae9-b5f1-c6553f831af1] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:42:42.252259 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG dbcounter [-] [125440] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=125440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:42:42.259091 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-9a152870-98b9-4798-94f5-4d94288cfc7c tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:42:42.259689 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-9a152870-98b9-4798-94f5-4d94288cfc7c tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:42:42.260222 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-9a152870-98b9-4798-94f5-4d94288cfc7c tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:42:42.261023 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-9a152870-98b9-4798-94f5-4d94288cfc7c tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:42:42.261580 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-9a152870-98b9-4798-94f5-4d94288cfc7c tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:42:42.262121 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-9a152870-98b9-4798-94f5-4d94288cfc7c tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:42:42.334165 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-9a152870-98b9-4798-94f5-4d94288cfc7c tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77385d8c61994d5da4083775d202a93d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd49947a82d974a55a8cc7a6ad7b9c56e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:42:42.342377 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-9a152870-98b9-4798-94f5-4d94288cfc7c tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] 10.222.0.15 "GET /compute/v2.1/servers/b34eac76-0bed-4ae9-b5f1-c6553f831af1" status: 200 len: 1279 microversion: 2.1 time: 0.097563 Oct 31 12:42:42.346727 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 541/1074] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:42:42 2022] GET /compute/v2.1/servers/b34eac76-0bed-4ae9-b5f1-c6553f831af1 => generated 1279 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:42:43.366693 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-e148353e-6a22-4d4b-bcdb-6ba94c4a91bd tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:42:43.367455 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-e148353e-6a22-4d4b-bcdb-6ba94c4a91bd tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] [instance: b34eac76-0bed-4ae9-b5f1-c6553f831af1] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:42:43.369981 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG dbcounter [-] [125441] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=1 {{(pid=125441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:42:43.377466 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-e148353e-6a22-4d4b-bcdb-6ba94c4a91bd tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:42:43.377958 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-e148353e-6a22-4d4b-bcdb-6ba94c4a91bd tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:42:43.378391 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-e148353e-6a22-4d4b-bcdb-6ba94c4a91bd tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:42:43.379093 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-e148353e-6a22-4d4b-bcdb-6ba94c4a91bd tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:42:43.380191 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-e148353e-6a22-4d4b-bcdb-6ba94c4a91bd tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:42:43.380637 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-e148353e-6a22-4d4b-bcdb-6ba94c4a91bd tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:42:43.515465 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-e148353e-6a22-4d4b-bcdb-6ba94c4a91bd tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77385d8c61994d5da4083775d202a93d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd49947a82d974a55a8cc7a6ad7b9c56e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:42:43.523557 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-e148353e-6a22-4d4b-bcdb-6ba94c4a91bd tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] 10.222.0.15 "GET /compute/v2.1/servers/b34eac76-0bed-4ae9-b5f1-c6553f831af1" status: 200 len: 1319 microversion: 2.1 time: 0.161552 Oct 31 12:42:43.524133 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 534/1075] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:42:43 2022] GET /compute/v2.1/servers/b34eac76-0bed-4ae9-b5f1-c6553f831af1 => generated 1319 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:42:43.556986 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [req-3f344e37-1358-4dbd-9feb-ca89f25ec539 req-ecb4fc56-28f8-465f-a013-58693db6519f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b34eac76-0bed-4ae9-b5f1-c6553f831af1", "tag": "d5796cf1-d539-4378-86a3-39853a7c58f2"}]} {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 12:42:43.568556 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [req-3f344e37-1358-4dbd-9feb-ca89f25ec539 req-ecb4fc56-28f8-465f-a013-58693db6519f service nova] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:42:43.569008 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [req-3f344e37-1358-4dbd-9feb-ca89f25ec539 req-ecb4fc56-28f8-465f-a013-58693db6519f service nova] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:42:43.569415 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [req-3f344e37-1358-4dbd-9feb-ca89f25ec539 req-ecb4fc56-28f8-465f-a013-58693db6519f service nova] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:42:43.580773 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.compute.server_external_events [req-3f344e37-1358-4dbd-9feb-ca89f25ec539 req-ecb4fc56-28f8-465f-a013-58693db6519f service nova] Creating event network-changed:d5796cf1-d539-4378-86a3-39853a7c58f2 for instance b34eac76-0bed-4ae9-b5f1-c6553f831af1 on hv-cinder-79617 Oct 31 12:42:43.585589 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [req-3f344e37-1358-4dbd-9feb-ca89f25ec539 req-ecb4fc56-28f8-465f-a013-58693db6519f service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032149 Oct 31 12:42:43.586255 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 542/1076] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Oct 31 12:42:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 12:42:44.548043 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-54085fd9-d442-4145-857e-32f9bca9678a tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:42:44.548661 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-54085fd9-d442-4145-857e-32f9bca9678a tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] [instance: b34eac76-0bed-4ae9-b5f1-c6553f831af1] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:42:44.555343 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-54085fd9-d442-4145-857e-32f9bca9678a tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:42:44.555826 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-54085fd9-d442-4145-857e-32f9bca9678a tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:42:44.556290 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-54085fd9-d442-4145-857e-32f9bca9678a tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:42:44.556975 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-54085fd9-d442-4145-857e-32f9bca9678a tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:42:44.557428 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-54085fd9-d442-4145-857e-32f9bca9678a tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:42:44.557850 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-54085fd9-d442-4145-857e-32f9bca9678a tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:42:44.685197 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-54085fd9-d442-4145-857e-32f9bca9678a tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77385d8c61994d5da4083775d202a93d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd49947a82d974a55a8cc7a6ad7b9c56e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:42:44.692967 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-54085fd9-d442-4145-857e-32f9bca9678a tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] 10.222.0.15 "GET /compute/v2.1/servers/b34eac76-0bed-4ae9-b5f1-c6553f831af1" status: 200 len: 1319 microversion: 2.1 time: 0.148793 Oct 31 12:42:44.693550 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 535/1077] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:42:44 2022] GET /compute/v2.1/servers/b34eac76-0bed-4ae9-b5f1-c6553f831af1 => generated 1319 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:42:45.717237 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-2fd63b5c-2282-4939-b4cc-1b2db68adeea tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:42:45.717925 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-2fd63b5c-2282-4939-b4cc-1b2db68adeea tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] [instance: b34eac76-0bed-4ae9-b5f1-c6553f831af1] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:42:45.724014 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-2fd63b5c-2282-4939-b4cc-1b2db68adeea tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:42:45.724978 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-2fd63b5c-2282-4939-b4cc-1b2db68adeea tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:42:45.725491 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-2fd63b5c-2282-4939-b4cc-1b2db68adeea tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:42:45.726076 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-2fd63b5c-2282-4939-b4cc-1b2db68adeea tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:42:45.726519 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-2fd63b5c-2282-4939-b4cc-1b2db68adeea tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:42:45.726960 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-2fd63b5c-2282-4939-b4cc-1b2db68adeea tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:42:46.027138 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-2fd63b5c-2282-4939-b4cc-1b2db68adeea tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77385d8c61994d5da4083775d202a93d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd49947a82d974a55a8cc7a6ad7b9c56e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:42:46.034850 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-2fd63b5c-2282-4939-b4cc-1b2db68adeea tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] 10.222.0.15 "GET /compute/v2.1/servers/b34eac76-0bed-4ae9-b5f1-c6553f831af1" status: 200 len: 1319 microversion: 2.1 time: 0.322622 Oct 31 12:42:46.035470 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 543/1078] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:42:45 2022] GET /compute/v2.1/servers/b34eac76-0bed-4ae9-b5f1-c6553f831af1 => generated 1319 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:42:47.059217 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-92df6cb3-4abd-431c-acfe-c4bf8205f831 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:42:47.059826 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-92df6cb3-4abd-431c-acfe-c4bf8205f831 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] [instance: b34eac76-0bed-4ae9-b5f1-c6553f831af1] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:42:47.066233 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-92df6cb3-4abd-431c-acfe-c4bf8205f831 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:42:47.066702 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-92df6cb3-4abd-431c-acfe-c4bf8205f831 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:42:47.067121 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-92df6cb3-4abd-431c-acfe-c4bf8205f831 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:42:47.067826 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-92df6cb3-4abd-431c-acfe-c4bf8205f831 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:42:47.068331 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-92df6cb3-4abd-431c-acfe-c4bf8205f831 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:42:47.068756 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-92df6cb3-4abd-431c-acfe-c4bf8205f831 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:42:47.264854 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-92df6cb3-4abd-431c-acfe-c4bf8205f831 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77385d8c61994d5da4083775d202a93d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd49947a82d974a55a8cc7a6ad7b9c56e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:42:47.283648 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-92df6cb3-4abd-431c-acfe-c4bf8205f831 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] 10.222.0.15 "GET /compute/v2.1/servers/b34eac76-0bed-4ae9-b5f1-c6553f831af1" status: 200 len: 1319 microversion: 2.1 time: 0.228237 Oct 31 12:42:47.304787 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 536/1079] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:42:47 2022] GET /compute/v2.1/servers/b34eac76-0bed-4ae9-b5f1-c6553f831af1 => generated 1319 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:42:48.312694 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-3dbc1607-3356-4f82-a5c2-ccc5fa081940 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:42:48.313253 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-3dbc1607-3356-4f82-a5c2-ccc5fa081940 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] [instance: b34eac76-0bed-4ae9-b5f1-c6553f831af1] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:42:48.320334 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-3dbc1607-3356-4f82-a5c2-ccc5fa081940 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:42:48.320809 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-3dbc1607-3356-4f82-a5c2-ccc5fa081940 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:42:48.321237 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-3dbc1607-3356-4f82-a5c2-ccc5fa081940 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:42:48.321916 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-3dbc1607-3356-4f82-a5c2-ccc5fa081940 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:42:48.322360 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-3dbc1607-3356-4f82-a5c2-ccc5fa081940 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:42:48.322775 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-3dbc1607-3356-4f82-a5c2-ccc5fa081940 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:42:48.451618 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-3dbc1607-3356-4f82-a5c2-ccc5fa081940 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77385d8c61994d5da4083775d202a93d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd49947a82d974a55a8cc7a6ad7b9c56e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:42:48.459493 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-3dbc1607-3356-4f82-a5c2-ccc5fa081940 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] 10.222.0.15 "GET /compute/v2.1/servers/b34eac76-0bed-4ae9-b5f1-c6553f831af1" status: 200 len: 1319 microversion: 2.1 time: 0.150604 Oct 31 12:42:48.460053 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 544/1080] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:42:48 2022] GET /compute/v2.1/servers/b34eac76-0bed-4ae9-b5f1-c6553f831af1 => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:42:48.529129 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-061ad15f-32b4-4c14-8a72-36066e523ba9 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:42:48.529773 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-061ad15f-32b4-4c14-8a72-36066e523ba9 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] [instance: b4f99a06-df16-4bff-b028-70add159b4ee] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:42:48.536055 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-061ad15f-32b4-4c14-8a72-36066e523ba9 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:42:48.536534 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-061ad15f-32b4-4c14-8a72-36066e523ba9 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:42:48.537580 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-061ad15f-32b4-4c14-8a72-36066e523ba9 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:42:48.538261 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-061ad15f-32b4-4c14-8a72-36066e523ba9 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:42:48.538712 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-061ad15f-32b4-4c14-8a72-36066e523ba9 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:42:48.539132 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-061ad15f-32b4-4c14-8a72-36066e523ba9 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:42:48.664694 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-061ad15f-32b4-4c14-8a72-36066e523ba9 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ddf1d02fa2644d280d9dee5b3101366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0637756aceaf4644bf263b5b5d72d9ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:42:48.672949 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-061ad15f-32b4-4c14-8a72-36066e523ba9 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] 10.222.0.15 "GET /compute/v2.1/servers/b4f99a06-df16-4bff-b028-70add159b4ee" status: 200 len: 1592 microversion: 2.1 time: 0.147579 Oct 31 12:42:48.673517 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 537/1081] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:42:48 2022] GET /compute/v2.1/servers/b4f99a06-df16-4bff-b028-70add159b4ee => generated 1592 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:42:49.280458 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [req-81b105d1-50a1-4343-b17b-680d5231ff7c req-9f3bf9fb-d0fa-42c2-a7d4-04b321a5566b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b34eac76-0bed-4ae9-b5f1-c6553f831af1", "name": "network-vif-plugged", "status": "completed", "tag": "d5796cf1-d539-4378-86a3-39853a7c58f2"}]} {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 12:42:49.290010 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [req-81b105d1-50a1-4343-b17b-680d5231ff7c req-9f3bf9fb-d0fa-42c2-a7d4-04b321a5566b service nova] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:42:49.290699 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [req-81b105d1-50a1-4343-b17b-680d5231ff7c req-9f3bf9fb-d0fa-42c2-a7d4-04b321a5566b service nova] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:42:49.291123 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [req-81b105d1-50a1-4343-b17b-680d5231ff7c req-9f3bf9fb-d0fa-42c2-a7d4-04b321a5566b service nova] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:42:49.305775 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.compute.server_external_events [req-81b105d1-50a1-4343-b17b-680d5231ff7c req-9f3bf9fb-d0fa-42c2-a7d4-04b321a5566b service nova] Creating event network-vif-plugged:d5796cf1-d539-4378-86a3-39853a7c58f2 for instance b34eac76-0bed-4ae9-b5f1-c6553f831af1 on hv-cinder-79617 Oct 31 12:42:49.310892 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [req-81b105d1-50a1-4343-b17b-680d5231ff7c req-9f3bf9fb-d0fa-42c2-a7d4-04b321a5566b service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034084 Oct 31 12:42:49.311567 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 545/1082] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Oct 31 12:42:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 12:42:49.483144 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-f002119b-5b1d-43c5-a693-3f7f39fb042b tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:42:49.484046 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-f002119b-5b1d-43c5-a693-3f7f39fb042b tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] [instance: b34eac76-0bed-4ae9-b5f1-c6553f831af1] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:42:49.490450 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-f002119b-5b1d-43c5-a693-3f7f39fb042b tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:42:49.490944 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-f002119b-5b1d-43c5-a693-3f7f39fb042b tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:42:49.492460 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-f002119b-5b1d-43c5-a693-3f7f39fb042b tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:42:49.493012 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-f002119b-5b1d-43c5-a693-3f7f39fb042b tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:42:49.493661 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-f002119b-5b1d-43c5-a693-3f7f39fb042b tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:42:49.494272 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-f002119b-5b1d-43c5-a693-3f7f39fb042b tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:42:49.729181 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-f002119b-5b1d-43c5-a693-3f7f39fb042b tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77385d8c61994d5da4083775d202a93d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd49947a82d974a55a8cc7a6ad7b9c56e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:42:49.737579 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-f002119b-5b1d-43c5-a693-3f7f39fb042b tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] 10.222.0.15 "GET /compute/v2.1/servers/b34eac76-0bed-4ae9-b5f1-c6553f831af1" status: 200 len: 1319 microversion: 2.1 time: 0.258690 Oct 31 12:42:49.749346 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 538/1083] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:42:49 2022] GET /compute/v2.1/servers/b34eac76-0bed-4ae9-b5f1-c6553f831af1 => generated 1319 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:42:50.423332 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [req-9f404a55-c5eb-41d7-a45d-4c416828a4ed req-4ccb4ac0-08fc-43f1-bcab-5d5d866025c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b4f99a06-df16-4bff-b028-70add159b4ee", "tag": "16976c96-0697-482f-bcc1-98d0bc00538f"}]} {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 12:42:50.435343 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [req-9f404a55-c5eb-41d7-a45d-4c416828a4ed req-4ccb4ac0-08fc-43f1-bcab-5d5d866025c7 service nova] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:42:50.435824 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [req-9f404a55-c5eb-41d7-a45d-4c416828a4ed req-4ccb4ac0-08fc-43f1-bcab-5d5d866025c7 service nova] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:42:50.436274 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [req-9f404a55-c5eb-41d7-a45d-4c416828a4ed req-4ccb4ac0-08fc-43f1-bcab-5d5d866025c7 service nova] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:42:50.449346 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.compute.server_external_events [req-9f404a55-c5eb-41d7-a45d-4c416828a4ed req-4ccb4ac0-08fc-43f1-bcab-5d5d866025c7 service nova] Creating event network-changed:16976c96-0697-482f-bcc1-98d0bc00538f for instance b4f99a06-df16-4bff-b028-70add159b4ee on hv-cinder-79617 Oct 31 12:42:50.455056 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [req-9f404a55-c5eb-41d7-a45d-4c416828a4ed req-4ccb4ac0-08fc-43f1-bcab-5d5d866025c7 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036165 Oct 31 12:42:50.455698 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 546/1084] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Oct 31 12:42:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 12:42:50.760617 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-06258e64-1732-4714-a4a3-1c5ff151cd63 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:42:50.762067 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-06258e64-1732-4714-a4a3-1c5ff151cd63 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] [instance: b34eac76-0bed-4ae9-b5f1-c6553f831af1] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:42:50.769668 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-06258e64-1732-4714-a4a3-1c5ff151cd63 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:42:50.770412 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-06258e64-1732-4714-a4a3-1c5ff151cd63 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:42:50.771003 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-06258e64-1732-4714-a4a3-1c5ff151cd63 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:42:50.771956 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-06258e64-1732-4714-a4a3-1c5ff151cd63 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:42:50.773106 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-06258e64-1732-4714-a4a3-1c5ff151cd63 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:42:50.773960 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-06258e64-1732-4714-a4a3-1c5ff151cd63 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:42:50.969110 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-06258e64-1732-4714-a4a3-1c5ff151cd63 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77385d8c61994d5da4083775d202a93d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd49947a82d974a55a8cc7a6ad7b9c56e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:42:50.978002 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-06258e64-1732-4714-a4a3-1c5ff151cd63 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] 10.222.0.15 "GET /compute/v2.1/servers/b34eac76-0bed-4ae9-b5f1-c6553f831af1" status: 200 len: 1319 microversion: 2.1 time: 0.221679 Oct 31 12:42:50.978670 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 539/1085] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:42:50 2022] GET /compute/v2.1/servers/b34eac76-0bed-4ae9-b5f1-c6553f831af1 => generated 1319 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:42:51.590752 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-6c0cc290-622f-4c9a-9785-5d9418e4db8d tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-907239926"}} {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 12:42:51.591991 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-6c0cc290-622f-4c9a-9785-5d9418e4db8d tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] [instance: b4f99a06-df16-4bff-b028-70add159b4ee] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:42:51.597633 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG dbcounter [-] [125440] Writing DB stats nova_cell0:SELECT=4 {{(pid=125440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:42:51.598467 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG dbcounter [-] [125440] Writing DB stats nova_cell0:SELECT=6 {{(pid=125440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:42:51.601160 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-6c0cc290-622f-4c9a-9785-5d9418e4db8d tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:42:51.601803 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-6c0cc290-622f-4c9a-9785-5d9418e4db8d tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:42:51.602394 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-6c0cc290-622f-4c9a-9785-5d9418e4db8d tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:42:51.603096 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-6c0cc290-622f-4c9a-9785-5d9418e4db8d tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:42:51.603654 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-6c0cc290-622f-4c9a-9785-5d9418e4db8d tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:42:51.604073 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-6c0cc290-622f-4c9a-9785-5d9418e4db8d tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:42:51.821624 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.network.security_group_api [None req-6c0cc290-622f-4c9a-9785-5d9418e4db8d tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Adding security group 21f5174d-99b1-4752-82a7-fd9662cbe4ef to port 16976c96-0697-482f-bcc1-98d0bc00538f Oct 31 12:42:52.001297 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-4ee6d8a9-6a8c-4488-848f-eaeada69ea4f tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:42:52.002009 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-4ee6d8a9-6a8c-4488-848f-eaeada69ea4f tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] [instance: b34eac76-0bed-4ae9-b5f1-c6553f831af1] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:42:52.004967 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG dbcounter [-] [125441] Writing DB stats nova_cell0:SELECT=2 {{(pid=125441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:42:52.010002 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-4ee6d8a9-6a8c-4488-848f-eaeada69ea4f tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:42:52.010597 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-4ee6d8a9-6a8c-4488-848f-eaeada69ea4f tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:42:52.011097 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-4ee6d8a9-6a8c-4488-848f-eaeada69ea4f tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:42:52.011880 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-4ee6d8a9-6a8c-4488-848f-eaeada69ea4f tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:42:52.012399 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-4ee6d8a9-6a8c-4488-848f-eaeada69ea4f tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:42:52.012897 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-4ee6d8a9-6a8c-4488-848f-eaeada69ea4f tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:42:52.157884 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-4ee6d8a9-6a8c-4488-848f-eaeada69ea4f tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77385d8c61994d5da4083775d202a93d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd49947a82d974a55a8cc7a6ad7b9c56e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:42:52.162615 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-6c0cc290-622f-4c9a-9785-5d9418e4db8d tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] 10.222.0.15 "POST /compute/v2.1/servers/b4f99a06-df16-4bff-b028-70add159b4ee/action" status: 202 len: 0 microversion: 2.1 time: 0.576476 Oct 31 12:42:52.163246 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 547/1086] 10.222.0.15 () {60 vars in 1278 bytes} [Mon Oct 31 12:42:51 2022] POST /compute/v2.1/servers/b4f99a06-df16-4bff-b028-70add159b4ee/action => generated 0 bytes in 578 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 31 12:42:52.171543 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-27587c2f-f384-4294-8ce7-0df2d7ce2161 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:42:52.171889 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-4ee6d8a9-6a8c-4488-848f-eaeada69ea4f tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] 10.222.0.15 "GET /compute/v2.1/servers/b34eac76-0bed-4ae9-b5f1-c6553f831af1" status: 200 len: 1507 microversion: 2.1 time: 0.174458 Oct 31 12:42:52.172142 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-27587c2f-f384-4294-8ce7-0df2d7ce2161 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] [instance: b4f99a06-df16-4bff-b028-70add159b4ee] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:42:52.172656 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 540/1087] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:42:51 2022] GET /compute/v2.1/servers/b34eac76-0bed-4ae9-b5f1-c6553f831af1 => generated 1507 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 12:42:52.177510 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [req-6709c552-9084-4064-b3a6-22101a666022 req-0468a513-0c8e-4de6-a89f-3c887a6c2225 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b4f99a06-df16-4bff-b028-70add159b4ee", "tag": "16976c96-0697-482f-bcc1-98d0bc00538f"}]} {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 12:42:52.189229 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-27587c2f-f384-4294-8ce7-0df2d7ce2161 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:42:52.189679 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [req-6709c552-9084-4064-b3a6-22101a666022 req-0468a513-0c8e-4de6-a89f-3c887a6c2225 service nova] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:42:52.189799 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-27587c2f-f384-4294-8ce7-0df2d7ce2161 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:42:52.190130 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-27587c2f-f384-4294-8ce7-0df2d7ce2161 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:42:52.191016 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-27587c2f-f384-4294-8ce7-0df2d7ce2161 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:42:52.191148 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [req-6709c552-9084-4064-b3a6-22101a666022 req-0468a513-0c8e-4de6-a89f-3c887a6c2225 service nova] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:42:52.191834 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [req-6709c552-9084-4064-b3a6-22101a666022 req-0468a513-0c8e-4de6-a89f-3c887a6c2225 service nova] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:42:52.192142 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-27587c2f-f384-4294-8ce7-0df2d7ce2161 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:42:52.192629 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-27587c2f-f384-4294-8ce7-0df2d7ce2161 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:42:52.205927 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.compute.server_external_events [req-6709c552-9084-4064-b3a6-22101a666022 req-0468a513-0c8e-4de6-a89f-3c887a6c2225 service nova] Creating event network-changed:16976c96-0697-482f-bcc1-98d0bc00538f for instance b4f99a06-df16-4bff-b028-70add159b4ee on hv-cinder-79617 Oct 31 12:42:52.212099 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [req-6709c552-9084-4064-b3a6-22101a666022 req-0468a513-0c8e-4de6-a89f-3c887a6c2225 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037498 Oct 31 12:42:52.212968 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 541/1088] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Oct 31 12:42:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 12:42:52.219495 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-3602e54c-802b-418b-bcf1-9d44fc994c48 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e7932ac6-a9d5-40b6-8a02-0bdf7e5496f5", "device": "/dev/sdb"}} {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 12:42:52.224553 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-3602e54c-802b-418b-bcf1-9d44fc994c48 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] [instance: b34eac76-0bed-4ae9-b5f1-c6553f831af1] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:42:52.231590 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-3602e54c-802b-418b-bcf1-9d44fc994c48 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:42:52.232602 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-3602e54c-802b-418b-bcf1-9d44fc994c48 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:42:52.233861 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-3602e54c-802b-418b-bcf1-9d44fc994c48 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:42:52.235268 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-3602e54c-802b-418b-bcf1-9d44fc994c48 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:42:52.237567 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-3602e54c-802b-418b-bcf1-9d44fc994c48 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:42:52.238173 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-3602e54c-802b-418b-bcf1-9d44fc994c48 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:42:52.483890 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-27587c2f-f384-4294-8ce7-0df2d7ce2161 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ddf1d02fa2644d280d9dee5b3101366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0637756aceaf4644bf263b5b5d72d9ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:42:52.500155 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-27587c2f-f384-4294-8ce7-0df2d7ce2161 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] 10.222.0.15 "GET /compute/v2.1/servers/b4f99a06-df16-4bff-b028-70add159b4ee" status: 200 len: 1757 microversion: 2.1 time: 0.332257 Oct 31 12:42:52.501220 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 548/1089] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:42:52 2022] GET /compute/v2.1/servers/b4f99a06-df16-4bff-b028-70add159b4ee => generated 1757 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:42:52.569027 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-3602e54c-802b-418b-bcf1-9d44fc994c48 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] 10.222.0.15 "POST /compute/v2.1/servers/b34eac76-0bed-4ae9-b5f1-c6553f831af1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.354385 Oct 31 12:42:52.571016 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 542/1090] 10.222.0.15 () {60 vars in 1323 bytes} [Mon Oct 31 12:42:52 2022] POST /compute/v2.1/servers/b34eac76-0bed-4ae9-b5f1-c6553f831af1/os-volume_attachments => generated 194 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 12:43:11.942077 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-28a97930-4ced-492f-b11a-e6ca81d03f76 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:43:11.942626 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-28a97930-4ced-492f-b11a-e6ca81d03f76 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] [instance: b34eac76-0bed-4ae9-b5f1-c6553f831af1] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:43:11.945446 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG dbcounter [-] [125440] Writing DB stats nova_api:SELECT=15 {{(pid=125440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:43:11.946595 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 31 12:43:11.946800 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: Mon Oct 31 12:43:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b34eac76-0bed-4ae9-b5f1-c6553f831af1/os-volume_attachments/e7932ac6-a9d5-40b6-8a02-0bdf7e5496f5 (ip 10.222.0.15) !!! Oct 31 12:43:11.948553 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG dbcounter [-] [125440] Writing DB stats nova_cell1:SELECT=38 {{(pid=125440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:43:11.955767 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-28a97930-4ced-492f-b11a-e6ca81d03f76 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:43:11.956271 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-28a97930-4ced-492f-b11a-e6ca81d03f76 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:43:11.956699 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-28a97930-4ced-492f-b11a-e6ca81d03f76 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:43:11.957414 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-28a97930-4ced-492f-b11a-e6ca81d03f76 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:43:11.957860 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-28a97930-4ced-492f-b11a-e6ca81d03f76 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:43:11.958274 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-28a97930-4ced-492f-b11a-e6ca81d03f76 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:43:12.039129 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.objects.instance [None req-28a97930-4ced-492f-b11a-e6ca81d03f76 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Lazy-loading 'services' on Instance uuid b34eac76-0bed-4ae9-b5f1-c6553f831af1 {{(pid=125440) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 12:43:12.111589 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-28a97930-4ced-492f-b11a-e6ca81d03f76 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] 10.222.0.15 "DELETE /compute/v2.1/servers/b34eac76-0bed-4ae9-b5f1-c6553f831af1/os-volume_attachments/e7932ac6-a9d5-40b6-8a02-0bdf7e5496f5" status: 202 len: 0 microversion: 2.1 time: 0.173194 Oct 31 12:43:12.112322 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 549/1091] 10.222.0.15 () {58 vars in 1416 bytes} [Mon Oct 31 12:43:11 2022] DELETE /compute/v2.1/servers/b34eac76-0bed-4ae9-b5f1-c6553f831af1/os-volume_attachments/e7932ac6-a9d5-40b6-8a02-0bdf7e5496f5 => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 12:43:13.235056 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG dbcounter [-] [125441] Writing DB stats nova_api:SELECT=17 {{(pid=125441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:43:13.235842 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG dbcounter [-] [125441] Writing DB stats nova_cell1:SELECT=59,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=125441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:43:13.240333 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-9f96823e-bad9-49d8-b324-2f62f6517248 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:43:13.240904 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-9f96823e-bad9-49d8-b324-2f62f6517248 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] [instance: b34eac76-0bed-4ae9-b5f1-c6553f831af1] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:43:13.248224 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-9f96823e-bad9-49d8-b324-2f62f6517248 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:43:13.248696 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-9f96823e-bad9-49d8-b324-2f62f6517248 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:43:13.249125 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-9f96823e-bad9-49d8-b324-2f62f6517248 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:43:13.249796 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-9f96823e-bad9-49d8-b324-2f62f6517248 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:43:13.250271 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-9f96823e-bad9-49d8-b324-2f62f6517248 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:43:13.250685 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-9f96823e-bad9-49d8-b324-2f62f6517248 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:43:13.276527 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-9f96823e-bad9-49d8-b324-2f62f6517248 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] [instance: b34eac76-0bed-4ae9-b5f1-c6553f831af1] Going to try to terminate instance {{(pid=125441) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 12:43:13.349953 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-9f96823e-bad9-49d8-b324-2f62f6517248 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] 10.222.0.15 "DELETE /compute/v2.1/servers/b34eac76-0bed-4ae9-b5f1-c6553f831af1" status: 204 len: 0 microversion: 2.1 time: 0.116375 Oct 31 12:43:13.350478 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 543/1092] 10.222.0.15 () {58 vars in 1239 bytes} [Mon Oct 31 12:43:13 2022] DELETE /compute/v2.1/servers/b34eac76-0bed-4ae9-b5f1-c6553f831af1 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 12:43:13.360331 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-2ad30c20-86f6-44c1-891e-876b0220c3c6 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:43:13.361034 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-2ad30c20-86f6-44c1-891e-876b0220c3c6 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] [instance: b34eac76-0bed-4ae9-b5f1-c6553f831af1] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:43:13.367984 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-2ad30c20-86f6-44c1-891e-876b0220c3c6 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:43:13.368461 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-2ad30c20-86f6-44c1-891e-876b0220c3c6 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:43:13.368890 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-2ad30c20-86f6-44c1-891e-876b0220c3c6 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:43:13.369583 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-2ad30c20-86f6-44c1-891e-876b0220c3c6 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:43:13.370034 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-2ad30c20-86f6-44c1-891e-876b0220c3c6 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:43:13.370452 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-2ad30c20-86f6-44c1-891e-876b0220c3c6 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:43:13.515257 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-2ad30c20-86f6-44c1-891e-876b0220c3c6 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77385d8c61994d5da4083775d202a93d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd49947a82d974a55a8cc7a6ad7b9c56e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:43:13.523378 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-2ad30c20-86f6-44c1-891e-876b0220c3c6 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] 10.222.0.15 "GET /compute/v2.1/servers/b34eac76-0bed-4ae9-b5f1-c6553f831af1" status: 200 len: 1513 microversion: 2.1 time: 0.168263 Oct 31 12:43:13.523958 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 550/1093] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:43:13 2022] GET /compute/v2.1/servers/b34eac76-0bed-4ae9-b5f1-c6553f831af1 => generated 1513 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:43:14.547899 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-8a4523bb-a64b-45cd-8597-3c53a703d142 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:43:14.548592 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-8a4523bb-a64b-45cd-8597-3c53a703d142 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] [instance: b34eac76-0bed-4ae9-b5f1-c6553f831af1] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:43:14.555218 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-8a4523bb-a64b-45cd-8597-3c53a703d142 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:43:14.555693 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-8a4523bb-a64b-45cd-8597-3c53a703d142 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:43:14.556124 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-8a4523bb-a64b-45cd-8597-3c53a703d142 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:43:14.556805 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-8a4523bb-a64b-45cd-8597-3c53a703d142 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:43:14.557253 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-8a4523bb-a64b-45cd-8597-3c53a703d142 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:43:14.557670 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-8a4523bb-a64b-45cd-8597-3c53a703d142 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:43:14.685921 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-8a4523bb-a64b-45cd-8597-3c53a703d142 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77385d8c61994d5da4083775d202a93d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd49947a82d974a55a8cc7a6ad7b9c56e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:43:14.693482 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-8a4523bb-a64b-45cd-8597-3c53a703d142 tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] 10.222.0.15 "GET /compute/v2.1/servers/b34eac76-0bed-4ae9-b5f1-c6553f831af1" status: 200 len: 1513 microversion: 2.1 time: 0.149896 Oct 31 12:43:14.694082 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 544/1094] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:43:14 2022] GET /compute/v2.1/servers/b34eac76-0bed-4ae9-b5f1-c6553f831af1 => generated 1513 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:43:15.498822 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [req-e9b468e8-46ef-4386-ac6e-f5c9701658f5 req-17e0fdb6-a7bc-4c43-b4a4-f8428ace06c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b34eac76-0bed-4ae9-b5f1-c6553f831af1", "name": "network-vif-deleted", "tag": "d5796cf1-d539-4378-86a3-39853a7c58f2"}]} {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 12:43:15.510043 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [req-e9b468e8-46ef-4386-ac6e-f5c9701658f5 req-17e0fdb6-a7bc-4c43-b4a4-f8428ace06c0 service nova] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:43:15.510524 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [req-e9b468e8-46ef-4386-ac6e-f5c9701658f5 req-17e0fdb6-a7bc-4c43-b4a4-f8428ace06c0 service nova] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:43:15.510960 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [req-e9b468e8-46ef-4386-ac6e-f5c9701658f5 req-17e0fdb6-a7bc-4c43-b4a4-f8428ace06c0 service nova] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:43:15.523255 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.compute.server_external_events [req-e9b468e8-46ef-4386-ac6e-f5c9701658f5 req-17e0fdb6-a7bc-4c43-b4a4-f8428ace06c0 service nova] Creating event network-vif-deleted:d5796cf1-d539-4378-86a3-39853a7c58f2 for instance b34eac76-0bed-4ae9-b5f1-c6553f831af1 on hv-cinder-79617 Oct 31 12:43:15.528036 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [req-e9b468e8-46ef-4386-ac6e-f5c9701658f5 req-17e0fdb6-a7bc-4c43-b4a4-f8428ace06c0 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032781 Oct 31 12:43:15.528583 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 551/1095] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Oct 31 12:43:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 12:43:15.716990 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-9f34d641-a0cc-4051-aa03-1c8de52d7add tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:43:15.717602 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-9f34d641-a0cc-4051-aa03-1c8de52d7add tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] [instance: b34eac76-0bed-4ae9-b5f1-c6553f831af1] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:43:15.723995 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-9f34d641-a0cc-4051-aa03-1c8de52d7add tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:43:15.724476 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-9f34d641-a0cc-4051-aa03-1c8de52d7add tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:43:15.724933 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-9f34d641-a0cc-4051-aa03-1c8de52d7add tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:43:15.725788 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-9f34d641-a0cc-4051-aa03-1c8de52d7add tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:43:15.726220 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-9f34d641-a0cc-4051-aa03-1c8de52d7add tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:43:15.726642 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-9f34d641-a0cc-4051-aa03-1c8de52d7add tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:43:15.760066 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-9f34d641-a0cc-4051-aa03-1c8de52d7add tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:43:15.760677 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-9f34d641-a0cc-4051-aa03-1c8de52d7add tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:43:15.761130 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-9f34d641-a0cc-4051-aa03-1c8de52d7add tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:43:15.761568 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.objects.instance [None req-9f34d641-a0cc-4051-aa03-1c8de52d7add tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Lazy-loading 'fault' on Instance uuid b34eac76-0bed-4ae9-b5f1-c6553f831af1 {{(pid=125441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 12:43:15.802656 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-9f34d641-a0cc-4051-aa03-1c8de52d7add tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77385d8c61994d5da4083775d202a93d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd49947a82d974a55a8cc7a6ad7b9c56e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:43:15.810587 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-9f34d641-a0cc-4051-aa03-1c8de52d7add tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] 10.222.0.15 "GET /compute/v2.1/servers/b34eac76-0bed-4ae9-b5f1-c6553f831af1" status: 200 len: 1309 microversion: 2.1 time: 0.097546 Oct 31 12:43:15.811150 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 545/1096] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:43:15 2022] GET /compute/v2.1/servers/b34eac76-0bed-4ae9-b5f1-c6553f831af1 => generated 1309 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:43:16.835991 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-cc581c82-adca-451c-90c1-23b1a3f0caae tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:43:16.836676 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-cc581c82-adca-451c-90c1-23b1a3f0caae tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] [instance: b34eac76-0bed-4ae9-b5f1-c6553f831af1] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:43:16.842670 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-cc581c82-adca-451c-90c1-23b1a3f0caae tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:43:16.843133 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-cc581c82-adca-451c-90c1-23b1a3f0caae tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:43:16.843586 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-cc581c82-adca-451c-90c1-23b1a3f0caae tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:43:16.844255 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-cc581c82-adca-451c-90c1-23b1a3f0caae tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:43:16.844697 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-cc581c82-adca-451c-90c1-23b1a3f0caae tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:43:16.845109 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-cc581c82-adca-451c-90c1-23b1a3f0caae tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:43:16.858687 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.wsgi [None req-cc581c82-adca-451c-90c1-23b1a3f0caae tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] HTTP exception thrown: Instance b34eac76-0bed-4ae9-b5f1-c6553f831af1 could not be found. Oct 31 12:43:16.860295 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-cc581c82-adca-451c-90c1-23b1a3f0caae tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Request method failure captured: Oct 31 12:43:16.860295 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: request: GET /compute/v2.1/servers/b34eac76-0bed-4ae9-b5f1-c6553f831af1 HTTP/1.1 Oct 31 12:43:16.860295 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: Accept: application/json Oct 31 12:43:16.860295 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: Accept-Encoding: identity Oct 31 12:43:16.860295 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: Connection: close Oct 31 12:43:16.860295 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: Content-Length: 0 Oct 31 12:43:16.860295 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: Content-Type: application/json Oct 31 12:43:16.860295 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: Host: 10.222.0.15 Oct 31 12:43:16.860295 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: Openstack-System-Scope: None Oct 31 12:43:16.860295 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: User-Agent: python-urllib3/1.26.12 Oct 31 12:43:16.860295 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Auth-Token: gAAAAABjX8JzarmqaejybMW2ECbwJH6U93ijuIQR9prfErO9Xe10M_9Cg2j2vvTtZPe0TGNB9xQjWSRSjw1XDjpuQovp07QglEaSt7K6C52GcVI5ewfRVRNsjRbKumiGzkoGrENoqGBvUxAkbfGvM8g1wo9_iwvNni5HqsB-jWLIKBLjS0wlfkc Oct 31 12:43:16.860295 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Domain-Id: None Oct 31 12:43:16.860295 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Domain-Name: None Oct 31 12:43:16.860295 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Identity-Status: Confirmed Oct 31 12:43:16.860295 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Is-Admin-Project: True Oct 31 12:43:16.860295 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Project-Domain-Id: default Oct 31 12:43:16.860295 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Project-Domain-Name: Default Oct 31 12:43:16.860295 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Project-Id: d49947a82d974a55a8cc7a6ad7b9c56e Oct 31 12:43:16.860295 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1449259902 Oct 31 12:43:16.860295 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Role: reader,member Oct 31 12:43:16.860295 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Roles: reader,member Oct 31 12:43:16.861875 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/d49947a82d974a55a8cc7a6ad7b9c56e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_d49947a82d974a55a8cc7a6ad7b9c56e", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/d49947a82d974a55a8cc7a6ad7b9c56e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/d49947a82d974a55a8cc7a6ad7b9c56e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Oct 31 12:43:16.861875 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Tenant: tempest-VolumesSnapshotTestJSON-1449259902 Oct 31 12:43:16.861875 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Tenant-Id: d49947a82d974a55a8cc7a6ad7b9c56e Oct 31 12:43:16.861875 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1449259902 Oct 31 12:43:16.861875 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-User: tempest-VolumesSnapshotTestJSON-1449259902-project Oct 31 12:43:16.861875 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-User-Domain-Id: default Oct 31 12:43:16.861875 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-User-Domain-Name: Default Oct 31 12:43:16.861875 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-User-Id: 77385d8c61994d5da4083775d202a93d Oct 31 12:43:16.861875 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-User-Name: tempest-VolumesSnapshotTestJSON-1449259902-project Oct 31 12:43:16.861875 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: method: > Oct 31 12:43:16.861875 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: exception: Instance b34eac76-0bed-4ae9-b5f1-c6553f831af1 could not be found. Oct 31 12:43:16.861875 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: action_args: {'id': 'b34eac76-0bed-4ae9-b5f1-c6553f831af1'} Oct 31 12:43:16.862676 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 12:43:16.862676 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 12:43:16.862676 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 12:43:16.862676 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 12:43:16.862676 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 12:43:16.862676 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 12:43:16.862676 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 12:43:16.862676 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 12:43:16.862676 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 12:43:16.862676 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 12:43:16.862676 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b34eac76-0bed-4ae9-b5f1-c6553f831af1 could not be found. Oct 31 12:43:16.862676 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Oct 31 12:43:16.862676 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 12:43:16.862676 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Oct 31 12:43:16.862676 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 12:43:16.862676 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 12:43:16.862676 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 12:43:16.862676 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 12:43:16.862676 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 12:43:16.862676 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 12:43:16.864107 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 12:43:16.864107 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 12:43:16.864107 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 12:43:16.864107 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 12:43:16.864107 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 12:43:16.864107 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 12:43:16.864107 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 12:43:16.864107 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b34eac76-0bed-4ae9-b5f1-c6553f831af1 could not be found. Oct 31 12:43:16.864107 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Oct 31 12:43:16.864107 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 12:43:16.864107 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Oct 31 12:43:16.864107 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 12:43:16.864107 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 12:43:16.864107 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 12:43:16.864107 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 12:43:16.864107 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 12:43:16.864107 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b34eac76-0bed-4ae9-b5f1-c6553f831af1 could not be found. Oct 31 12:43:16.864107 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Oct 31 12:43:16.865299 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-cc581c82-adca-451c-90c1-23b1a3f0caae tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] Returning 404 to user: Instance b34eac76-0bed-4ae9-b5f1-c6553f831af1 could not be found. {{(pid=125440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 12:43:16.865299 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-cc581c82-adca-451c-90c1-23b1a3f0caae tempest-VolumesSnapshotTestJSON-1449259902 tempest-VolumesSnapshotTestJSON-1449259902-project] 10.222.0.15 "GET /compute/v2.1/servers/b34eac76-0bed-4ae9-b5f1-c6553f831af1" status: 404 len: 111 microversion: 2.1 time: 0.031257 Oct 31 12:43:16.865299 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 552/1097] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:43:16 2022] GET /compute/v2.1/servers/b34eac76-0bed-4ae9-b5f1-c6553f831af1 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 12:43:24.475256 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-e3df4965-d8a0-425e-9859-d73dc5392e35 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 12:43:24.477747 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-e3df4965-d8a0-425e-9859-d73dc5392e35 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] [instance: b4f99a06-df16-4bff-b028-70add159b4ee] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:43:24.484259 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-e3df4965-d8a0-425e-9859-d73dc5392e35 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:43:24.484747 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-e3df4965-d8a0-425e-9859-d73dc5392e35 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:43:24.485177 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-e3df4965-d8a0-425e-9859-d73dc5392e35 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:43:24.485872 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-e3df4965-d8a0-425e-9859-d73dc5392e35 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:43:24.486327 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-e3df4965-d8a0-425e-9859-d73dc5392e35 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:43:24.486747 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-e3df4965-d8a0-425e-9859-d73dc5392e35 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:43:24.562685 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-e3df4965-d8a0-425e-9859-d73dc5392e35 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] 10.222.0.15 "POST /compute/v2.1/servers/b4f99a06-df16-4bff-b028-70add159b4ee/action" status: 202 len: 0 microversion: 2.1 time: 0.091228 Oct 31 12:43:24.563560 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 546/1098] 10.222.0.15 () {60 vars in 1278 bytes} [Mon Oct 31 12:43:24 2022] POST /compute/v2.1/servers/b4f99a06-df16-4bff-b028-70add159b4ee/action => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 12:43:24.571422 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-43764786-0798-40cd-93b3-dcadafc55031 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:43:24.572029 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-43764786-0798-40cd-93b3-dcadafc55031 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] [instance: b4f99a06-df16-4bff-b028-70add159b4ee] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:43:24.578641 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-43764786-0798-40cd-93b3-dcadafc55031 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:43:24.579232 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-43764786-0798-40cd-93b3-dcadafc55031 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:43:24.579730 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-43764786-0798-40cd-93b3-dcadafc55031 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:43:24.580490 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-43764786-0798-40cd-93b3-dcadafc55031 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:43:24.581051 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-43764786-0798-40cd-93b3-dcadafc55031 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:43:24.581559 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-43764786-0798-40cd-93b3-dcadafc55031 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:43:24.815651 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-43764786-0798-40cd-93b3-dcadafc55031 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ddf1d02fa2644d280d9dee5b3101366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0637756aceaf4644bf263b5b5d72d9ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:43:24.823985 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-43764786-0798-40cd-93b3-dcadafc55031 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] 10.222.0.15 "GET /compute/v2.1/servers/b4f99a06-df16-4bff-b028-70add159b4ee" status: 200 len: 1749 microversion: 2.1 time: 0.256458 Oct 31 12:43:24.824649 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 553/1099] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:43:24 2022] GET /compute/v2.1/servers/b4f99a06-df16-4bff-b028-70add159b4ee => generated 1749 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:43:25.848618 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-f5bef4f5-5eb8-45b3-9cd2-7b27794ec2d9 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:43:25.849306 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-f5bef4f5-5eb8-45b3-9cd2-7b27794ec2d9 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] [instance: b4f99a06-df16-4bff-b028-70add159b4ee] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:43:25.856052 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-f5bef4f5-5eb8-45b3-9cd2-7b27794ec2d9 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:43:25.856527 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-f5bef4f5-5eb8-45b3-9cd2-7b27794ec2d9 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:43:25.856955 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-f5bef4f5-5eb8-45b3-9cd2-7b27794ec2d9 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:43:25.857632 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-f5bef4f5-5eb8-45b3-9cd2-7b27794ec2d9 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:43:25.858085 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-f5bef4f5-5eb8-45b3-9cd2-7b27794ec2d9 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:43:25.858500 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-f5bef4f5-5eb8-45b3-9cd2-7b27794ec2d9 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:43:26.001716 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-f5bef4f5-5eb8-45b3-9cd2-7b27794ec2d9 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ddf1d02fa2644d280d9dee5b3101366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0637756aceaf4644bf263b5b5d72d9ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:43:26.010115 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-f5bef4f5-5eb8-45b3-9cd2-7b27794ec2d9 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] 10.222.0.15 "GET /compute/v2.1/servers/b4f99a06-df16-4bff-b028-70add159b4ee" status: 200 len: 1754 microversion: 2.1 time: 0.166167 Oct 31 12:43:26.010674 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 547/1100] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:43:25 2022] GET /compute/v2.1/servers/b4f99a06-df16-4bff-b028-70add159b4ee => generated 1754 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:43:27.033822 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-ef7eaf7c-cf71-43ad-88b6-39cc84107bbc tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:43:27.034426 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-ef7eaf7c-cf71-43ad-88b6-39cc84107bbc tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] [instance: b4f99a06-df16-4bff-b028-70add159b4ee] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:43:27.041101 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-ef7eaf7c-cf71-43ad-88b6-39cc84107bbc tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:43:27.041579 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-ef7eaf7c-cf71-43ad-88b6-39cc84107bbc tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:43:27.042014 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-ef7eaf7c-cf71-43ad-88b6-39cc84107bbc tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:43:27.042695 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-ef7eaf7c-cf71-43ad-88b6-39cc84107bbc tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:43:27.043142 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-ef7eaf7c-cf71-43ad-88b6-39cc84107bbc tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:43:27.043596 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-ef7eaf7c-cf71-43ad-88b6-39cc84107bbc tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:43:27.186195 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-ef7eaf7c-cf71-43ad-88b6-39cc84107bbc tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ddf1d02fa2644d280d9dee5b3101366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0637756aceaf4644bf263b5b5d72d9ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:43:27.194291 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-ef7eaf7c-cf71-43ad-88b6-39cc84107bbc tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] 10.222.0.15 "GET /compute/v2.1/servers/b4f99a06-df16-4bff-b028-70add159b4ee" status: 200 len: 1754 microversion: 2.1 time: 0.164369 Oct 31 12:43:27.194855 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 554/1101] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:43:27 2022] GET /compute/v2.1/servers/b4f99a06-df16-4bff-b028-70add159b4ee => generated 1754 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:43:28.216517 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-466a0f7e-79ae-4be6-97bf-8ae9b33ff3ea tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:43:28.217126 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-466a0f7e-79ae-4be6-97bf-8ae9b33ff3ea tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] [instance: b4f99a06-df16-4bff-b028-70add159b4ee] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:43:28.223526 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-466a0f7e-79ae-4be6-97bf-8ae9b33ff3ea tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:43:28.223998 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-466a0f7e-79ae-4be6-97bf-8ae9b33ff3ea tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:43:28.224429 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-466a0f7e-79ae-4be6-97bf-8ae9b33ff3ea tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:43:28.225132 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-466a0f7e-79ae-4be6-97bf-8ae9b33ff3ea tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:43:28.225580 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-466a0f7e-79ae-4be6-97bf-8ae9b33ff3ea tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:43:28.225997 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-466a0f7e-79ae-4be6-97bf-8ae9b33ff3ea tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:43:28.364848 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-466a0f7e-79ae-4be6-97bf-8ae9b33ff3ea tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ddf1d02fa2644d280d9dee5b3101366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0637756aceaf4644bf263b5b5d72d9ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:43:28.373160 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-466a0f7e-79ae-4be6-97bf-8ae9b33ff3ea tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] 10.222.0.15 "GET /compute/v2.1/servers/b4f99a06-df16-4bff-b028-70add159b4ee" status: 200 len: 1754 microversion: 2.1 time: 0.160462 Oct 31 12:43:28.373716 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 548/1102] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:43:28 2022] GET /compute/v2.1/servers/b4f99a06-df16-4bff-b028-70add159b4ee => generated 1754 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:43:29.396450 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-22e79b0d-ddf3-453a-9474-54aadfee0a8f tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:43:29.397012 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-22e79b0d-ddf3-453a-9474-54aadfee0a8f tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] [instance: b4f99a06-df16-4bff-b028-70add159b4ee] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:43:29.404373 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-22e79b0d-ddf3-453a-9474-54aadfee0a8f tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:43:29.404854 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-22e79b0d-ddf3-453a-9474-54aadfee0a8f tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:43:29.405287 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-22e79b0d-ddf3-453a-9474-54aadfee0a8f tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:43:29.405971 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-22e79b0d-ddf3-453a-9474-54aadfee0a8f tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:43:29.406421 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-22e79b0d-ddf3-453a-9474-54aadfee0a8f tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:43:29.406840 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-22e79b0d-ddf3-453a-9474-54aadfee0a8f tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:43:29.550451 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-22e79b0d-ddf3-453a-9474-54aadfee0a8f tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ddf1d02fa2644d280d9dee5b3101366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0637756aceaf4644bf263b5b5d72d9ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:43:29.558696 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-22e79b0d-ddf3-453a-9474-54aadfee0a8f tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] 10.222.0.15 "GET /compute/v2.1/servers/b4f99a06-df16-4bff-b028-70add159b4ee" status: 200 len: 1754 microversion: 2.1 time: 0.166280 Oct 31 12:43:29.559345 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 555/1103] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:43:29 2022] GET /compute/v2.1/servers/b4f99a06-df16-4bff-b028-70add159b4ee => generated 1754 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:43:30.580982 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-4a6c6858-b87c-4d94-8914-3aedb952eefd tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:43:30.581574 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-4a6c6858-b87c-4d94-8914-3aedb952eefd tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] [instance: b4f99a06-df16-4bff-b028-70add159b4ee] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:43:30.588885 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-4a6c6858-b87c-4d94-8914-3aedb952eefd tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:43:30.589358 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-4a6c6858-b87c-4d94-8914-3aedb952eefd tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:43:30.589781 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-4a6c6858-b87c-4d94-8914-3aedb952eefd tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:43:30.590462 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-4a6c6858-b87c-4d94-8914-3aedb952eefd tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:43:30.590906 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-4a6c6858-b87c-4d94-8914-3aedb952eefd tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:43:30.591358 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-4a6c6858-b87c-4d94-8914-3aedb952eefd tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:43:30.732584 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-4a6c6858-b87c-4d94-8914-3aedb952eefd tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ddf1d02fa2644d280d9dee5b3101366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0637756aceaf4644bf263b5b5d72d9ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:43:30.740739 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-4a6c6858-b87c-4d94-8914-3aedb952eefd tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] 10.222.0.15 "GET /compute/v2.1/servers/b4f99a06-df16-4bff-b028-70add159b4ee" status: 200 len: 1754 microversion: 2.1 time: 0.163775 Oct 31 12:43:30.741308 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 549/1104] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:43:30 2022] GET /compute/v2.1/servers/b4f99a06-df16-4bff-b028-70add159b4ee => generated 1754 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:43:31.764428 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-78ce4192-d13b-47cd-a24f-a82380822a6a tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:43:31.765030 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-78ce4192-d13b-47cd-a24f-a82380822a6a tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] [instance: b4f99a06-df16-4bff-b028-70add159b4ee] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:43:31.771705 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-78ce4192-d13b-47cd-a24f-a82380822a6a tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:43:31.772170 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-78ce4192-d13b-47cd-a24f-a82380822a6a tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:43:31.772590 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-78ce4192-d13b-47cd-a24f-a82380822a6a tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:43:31.773260 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-78ce4192-d13b-47cd-a24f-a82380822a6a tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:43:31.773701 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-78ce4192-d13b-47cd-a24f-a82380822a6a tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:43:31.774112 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-78ce4192-d13b-47cd-a24f-a82380822a6a tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:43:31.912977 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-78ce4192-d13b-47cd-a24f-a82380822a6a tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ddf1d02fa2644d280d9dee5b3101366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0637756aceaf4644bf263b5b5d72d9ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:43:31.921238 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-78ce4192-d13b-47cd-a24f-a82380822a6a tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] 10.222.0.15 "GET /compute/v2.1/servers/b4f99a06-df16-4bff-b028-70add159b4ee" status: 200 len: 1754 microversion: 2.1 time: 0.160658 Oct 31 12:43:31.921803 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 556/1105] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:43:31 2022] GET /compute/v2.1/servers/b4f99a06-df16-4bff-b028-70add159b4ee => generated 1754 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:43:32.944845 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-13376e49-3972-48a5-a7cc-48258e4149cf tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:43:32.945370 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-13376e49-3972-48a5-a7cc-48258e4149cf tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] [instance: b4f99a06-df16-4bff-b028-70add159b4ee] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:43:32.952139 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-13376e49-3972-48a5-a7cc-48258e4149cf tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:43:32.952610 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-13376e49-3972-48a5-a7cc-48258e4149cf tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:43:32.953033 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-13376e49-3972-48a5-a7cc-48258e4149cf tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:43:32.953707 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-13376e49-3972-48a5-a7cc-48258e4149cf tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:43:32.954151 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-13376e49-3972-48a5-a7cc-48258e4149cf tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:43:32.954570 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-13376e49-3972-48a5-a7cc-48258e4149cf tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:43:33.093939 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-13376e49-3972-48a5-a7cc-48258e4149cf tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ddf1d02fa2644d280d9dee5b3101366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0637756aceaf4644bf263b5b5d72d9ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:43:33.102043 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-13376e49-3972-48a5-a7cc-48258e4149cf tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] 10.222.0.15 "GET /compute/v2.1/servers/b4f99a06-df16-4bff-b028-70add159b4ee" status: 200 len: 1754 microversion: 2.1 time: 0.161182 Oct 31 12:43:33.103106 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 550/1106] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:43:32 2022] GET /compute/v2.1/servers/b4f99a06-df16-4bff-b028-70add159b4ee => generated 1754 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:43:34.126145 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-fdf05b51-1c9a-4d29-9412-b8855bbeee82 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:43:34.126666 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-fdf05b51-1c9a-4d29-9412-b8855bbeee82 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] [instance: b4f99a06-df16-4bff-b028-70add159b4ee] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:43:34.133057 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-fdf05b51-1c9a-4d29-9412-b8855bbeee82 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:43:34.133534 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-fdf05b51-1c9a-4d29-9412-b8855bbeee82 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:43:34.133962 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-fdf05b51-1c9a-4d29-9412-b8855bbeee82 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:43:34.134664 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-fdf05b51-1c9a-4d29-9412-b8855bbeee82 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:43:34.135115 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-fdf05b51-1c9a-4d29-9412-b8855bbeee82 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:43:34.135587 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-fdf05b51-1c9a-4d29-9412-b8855bbeee82 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:43:34.278336 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-fdf05b51-1c9a-4d29-9412-b8855bbeee82 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ddf1d02fa2644d280d9dee5b3101366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0637756aceaf4644bf263b5b5d72d9ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:43:34.286406 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-fdf05b51-1c9a-4d29-9412-b8855bbeee82 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] 10.222.0.15 "GET /compute/v2.1/servers/b4f99a06-df16-4bff-b028-70add159b4ee" status: 200 len: 1754 microversion: 2.1 time: 0.164220 Oct 31 12:43:34.286905 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 557/1107] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:43:34 2022] GET /compute/v2.1/servers/b4f99a06-df16-4bff-b028-70add159b4ee => generated 1754 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:43:35.309875 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-7792a4f6-fbb4-4046-89a8-4687039eacf4 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:43:35.310420 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-7792a4f6-fbb4-4046-89a8-4687039eacf4 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] [instance: b4f99a06-df16-4bff-b028-70add159b4ee] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:43:35.317052 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-7792a4f6-fbb4-4046-89a8-4687039eacf4 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:43:35.317530 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-7792a4f6-fbb4-4046-89a8-4687039eacf4 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:43:35.317962 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-7792a4f6-fbb4-4046-89a8-4687039eacf4 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:43:35.318648 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-7792a4f6-fbb4-4046-89a8-4687039eacf4 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:43:35.319103 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-7792a4f6-fbb4-4046-89a8-4687039eacf4 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:43:35.319552 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-7792a4f6-fbb4-4046-89a8-4687039eacf4 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:43:35.457836 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-7792a4f6-fbb4-4046-89a8-4687039eacf4 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ddf1d02fa2644d280d9dee5b3101366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0637756aceaf4644bf263b5b5d72d9ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:43:35.466700 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-7792a4f6-fbb4-4046-89a8-4687039eacf4 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] 10.222.0.15 "GET /compute/v2.1/servers/b4f99a06-df16-4bff-b028-70add159b4ee" status: 200 len: 1754 microversion: 2.1 time: 0.161438 Oct 31 12:43:35.467278 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 551/1108] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:43:35 2022] GET /compute/v2.1/servers/b4f99a06-df16-4bff-b028-70add159b4ee => generated 1754 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:43:36.489382 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-0fa1ab17-e556-44c4-8c14-be7cbe9b754f tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:43:36.489931 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-0fa1ab17-e556-44c4-8c14-be7cbe9b754f tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] [instance: b4f99a06-df16-4bff-b028-70add159b4ee] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:43:36.497044 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-0fa1ab17-e556-44c4-8c14-be7cbe9b754f tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:43:36.497534 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-0fa1ab17-e556-44c4-8c14-be7cbe9b754f tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:43:36.497944 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-0fa1ab17-e556-44c4-8c14-be7cbe9b754f tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:43:36.498621 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-0fa1ab17-e556-44c4-8c14-be7cbe9b754f tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:43:36.499064 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-0fa1ab17-e556-44c4-8c14-be7cbe9b754f tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:43:36.499506 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-0fa1ab17-e556-44c4-8c14-be7cbe9b754f tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:43:36.638467 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-0fa1ab17-e556-44c4-8c14-be7cbe9b754f tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ddf1d02fa2644d280d9dee5b3101366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0637756aceaf4644bf263b5b5d72d9ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:43:36.646751 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-0fa1ab17-e556-44c4-8c14-be7cbe9b754f tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] 10.222.0.15 "GET /compute/v2.1/servers/b4f99a06-df16-4bff-b028-70add159b4ee" status: 200 len: 1754 microversion: 2.1 time: 0.161332 Oct 31 12:43:36.647387 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 558/1109] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:43:36 2022] GET /compute/v2.1/servers/b4f99a06-df16-4bff-b028-70add159b4ee => generated 1754 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:43:37.670574 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-4e9d1050-80b6-421e-8ee4-688420ca8bb6 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:43:37.671214 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-4e9d1050-80b6-421e-8ee4-688420ca8bb6 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] [instance: b4f99a06-df16-4bff-b028-70add159b4ee] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:43:37.677629 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-4e9d1050-80b6-421e-8ee4-688420ca8bb6 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:43:37.678113 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-4e9d1050-80b6-421e-8ee4-688420ca8bb6 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:43:37.678549 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-4e9d1050-80b6-421e-8ee4-688420ca8bb6 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:43:37.679270 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-4e9d1050-80b6-421e-8ee4-688420ca8bb6 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:43:37.679730 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-4e9d1050-80b6-421e-8ee4-688420ca8bb6 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:43:37.680155 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-4e9d1050-80b6-421e-8ee4-688420ca8bb6 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:43:37.827317 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-4e9d1050-80b6-421e-8ee4-688420ca8bb6 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ddf1d02fa2644d280d9dee5b3101366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0637756aceaf4644bf263b5b5d72d9ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:43:37.836092 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-4e9d1050-80b6-421e-8ee4-688420ca8bb6 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] 10.222.0.15 "GET /compute/v2.1/servers/b4f99a06-df16-4bff-b028-70add159b4ee" status: 200 len: 1754 microversion: 2.1 time: 0.169426 Oct 31 12:43:37.836825 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 552/1110] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:43:37 2022] GET /compute/v2.1/servers/b4f99a06-df16-4bff-b028-70add159b4ee => generated 1754 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:43:38.859653 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-21001d9f-b14f-4dd7-82c9-0978785a0c36 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:43:38.860254 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-21001d9f-b14f-4dd7-82c9-0978785a0c36 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] [instance: b4f99a06-df16-4bff-b028-70add159b4ee] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:43:38.866622 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-21001d9f-b14f-4dd7-82c9-0978785a0c36 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:43:38.867089 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-21001d9f-b14f-4dd7-82c9-0978785a0c36 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:43:38.867554 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-21001d9f-b14f-4dd7-82c9-0978785a0c36 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:43:38.868223 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-21001d9f-b14f-4dd7-82c9-0978785a0c36 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:43:38.868664 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-21001d9f-b14f-4dd7-82c9-0978785a0c36 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:43:38.869073 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-21001d9f-b14f-4dd7-82c9-0978785a0c36 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:43:39.011293 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-21001d9f-b14f-4dd7-82c9-0978785a0c36 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ddf1d02fa2644d280d9dee5b3101366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0637756aceaf4644bf263b5b5d72d9ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:43:39.019750 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-21001d9f-b14f-4dd7-82c9-0978785a0c36 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] 10.222.0.15 "GET /compute/v2.1/servers/b4f99a06-df16-4bff-b028-70add159b4ee" status: 200 len: 1754 microversion: 2.1 time: 0.164460 Oct 31 12:43:39.020314 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 559/1111] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:43:38 2022] GET /compute/v2.1/servers/b4f99a06-df16-4bff-b028-70add159b4ee => generated 1754 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:43:40.043130 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-d0033c2c-1060-49e6-a939-cb2d0d17db0c tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:43:40.043897 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-d0033c2c-1060-49e6-a939-cb2d0d17db0c tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] [instance: b4f99a06-df16-4bff-b028-70add159b4ee] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:43:40.050157 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-d0033c2c-1060-49e6-a939-cb2d0d17db0c tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:43:40.050632 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-d0033c2c-1060-49e6-a939-cb2d0d17db0c tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:43:40.051060 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-d0033c2c-1060-49e6-a939-cb2d0d17db0c tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:43:40.051766 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-d0033c2c-1060-49e6-a939-cb2d0d17db0c tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:43:40.052220 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-d0033c2c-1060-49e6-a939-cb2d0d17db0c tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:43:40.052637 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-d0033c2c-1060-49e6-a939-cb2d0d17db0c tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:43:40.191391 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-d0033c2c-1060-49e6-a939-cb2d0d17db0c tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ddf1d02fa2644d280d9dee5b3101366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0637756aceaf4644bf263b5b5d72d9ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:43:40.199556 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-d0033c2c-1060-49e6-a939-cb2d0d17db0c tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] 10.222.0.15 "GET /compute/v2.1/servers/b4f99a06-df16-4bff-b028-70add159b4ee" status: 200 len: 1754 microversion: 2.1 time: 0.160271 Oct 31 12:43:40.200156 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 553/1112] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:43:40 2022] GET /compute/v2.1/servers/b4f99a06-df16-4bff-b028-70add159b4ee => generated 1754 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:43:41.222283 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-2d8a1db5-31c5-4728-8476-1fcf47e0afe6 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:43:41.222993 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-2d8a1db5-31c5-4728-8476-1fcf47e0afe6 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] [instance: b4f99a06-df16-4bff-b028-70add159b4ee] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:43:41.229725 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-2d8a1db5-31c5-4728-8476-1fcf47e0afe6 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:43:41.230113 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-2d8a1db5-31c5-4728-8476-1fcf47e0afe6 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:43:41.231129 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-2d8a1db5-31c5-4728-8476-1fcf47e0afe6 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:43:41.231930 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-2d8a1db5-31c5-4728-8476-1fcf47e0afe6 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:43:41.232424 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-2d8a1db5-31c5-4728-8476-1fcf47e0afe6 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:43:41.232920 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-2d8a1db5-31c5-4728-8476-1fcf47e0afe6 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:43:41.691792 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-2d8a1db5-31c5-4728-8476-1fcf47e0afe6 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ddf1d02fa2644d280d9dee5b3101366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0637756aceaf4644bf263b5b5d72d9ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:43:41.700634 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-2d8a1db5-31c5-4728-8476-1fcf47e0afe6 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] 10.222.0.15 "GET /compute/v2.1/servers/b4f99a06-df16-4bff-b028-70add159b4ee" status: 200 len: 1754 microversion: 2.1 time: 0.482202 Oct 31 12:43:41.701246 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 560/1113] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:43:41 2022] GET /compute/v2.1/servers/b4f99a06-df16-4bff-b028-70add159b4ee => generated 1754 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:43:41.782962 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-59e737ce-b889-4dd4-994e-4f175eaa7fac tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:43:41.783481 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-59e737ce-b889-4dd4-994e-4f175eaa7fac tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] [instance: 66820f24-a23a-4e02-a703-7c9832ffd729] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:43:41.790713 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-59e737ce-b889-4dd4-994e-4f175eaa7fac tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:43:41.791205 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-59e737ce-b889-4dd4-994e-4f175eaa7fac tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:43:41.791832 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-59e737ce-b889-4dd4-994e-4f175eaa7fac tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:43:41.792522 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-59e737ce-b889-4dd4-994e-4f175eaa7fac tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:43:41.793310 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-59e737ce-b889-4dd4-994e-4f175eaa7fac tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:43:41.793746 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-59e737ce-b889-4dd4-994e-4f175eaa7fac tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:43:41.822276 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-59e737ce-b889-4dd4-994e-4f175eaa7fac tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] [instance: 66820f24-a23a-4e02-a703-7c9832ffd729] Going to try to terminate instance {{(pid=125441) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 12:43:41.874063 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG dbcounter [-] [125441] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=125441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:43:41.915363 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-59e737ce-b889-4dd4-994e-4f175eaa7fac tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] 10.222.0.15 "DELETE /compute/v2.1/servers/66820f24-a23a-4e02-a703-7c9832ffd729" status: 204 len: 0 microversion: 2.1 time: 0.136379 Oct 31 12:43:41.916096 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 554/1114] 10.222.0.15 () {58 vars in 1239 bytes} [Mon Oct 31 12:43:41 2022] DELETE /compute/v2.1/servers/66820f24-a23a-4e02-a703-7c9832ffd729 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 12:43:41.926728 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-d6fa7059-e8c2-4e29-bb57-071dfbf07aec tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:43:41.927460 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-d6fa7059-e8c2-4e29-bb57-071dfbf07aec tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] [instance: 66820f24-a23a-4e02-a703-7c9832ffd729] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:43:41.933209 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-d6fa7059-e8c2-4e29-bb57-071dfbf07aec tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:43:41.934249 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-d6fa7059-e8c2-4e29-bb57-071dfbf07aec tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:43:41.934984 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-d6fa7059-e8c2-4e29-bb57-071dfbf07aec tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:43:41.936284 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-d6fa7059-e8c2-4e29-bb57-071dfbf07aec tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:43:41.936749 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-d6fa7059-e8c2-4e29-bb57-071dfbf07aec tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:43:41.937203 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-d6fa7059-e8c2-4e29-bb57-071dfbf07aec tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:43:41.997037 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [req-e8a32d88-bc97-4fee-8033-c8637a3860d4 req-ec5ef8e8-3591-4446-8fba-d6cc10622626 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "66820f24-a23a-4e02-a703-7c9832ffd729", "tag": "bf3768f3-740b-45b9-92a5-0798ffcfacc8"}]} {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 12:43:42.002370 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG dbcounter [-] [125440] Writing DB stats nova_api:SELECT=25 {{(pid=125440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:43:42.008720 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [req-e8a32d88-bc97-4fee-8033-c8637a3860d4 req-ec5ef8e8-3591-4446-8fba-d6cc10622626 service nova] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:43:42.009266 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [req-e8a32d88-bc97-4fee-8033-c8637a3860d4 req-ec5ef8e8-3591-4446-8fba-d6cc10622626 service nova] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:43:42.009757 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [req-e8a32d88-bc97-4fee-8033-c8637a3860d4 req-ec5ef8e8-3591-4446-8fba-d6cc10622626 service nova] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:43:42.014040 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG dbcounter [-] [125440] Writing DB stats nova_cell1:SELECT=68,nova_cell1:INSERT=1 {{(pid=125440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:43:42.033932 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.compute.server_external_events [req-e8a32d88-bc97-4fee-8033-c8637a3860d4 req-ec5ef8e8-3591-4446-8fba-d6cc10622626 service nova] Creating event network-changed:bf3768f3-740b-45b9-92a5-0798ffcfacc8 for instance 66820f24-a23a-4e02-a703-7c9832ffd729 on hv-cinder-79617 Oct 31 12:43:42.039257 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [req-e8a32d88-bc97-4fee-8033-c8637a3860d4 req-ec5ef8e8-3591-4446-8fba-d6cc10622626 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.257973 Oct 31 12:43:42.040107 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 561/1115] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Oct 31 12:43:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 12:43:42.083789 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-d6fa7059-e8c2-4e29-bb57-071dfbf07aec tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b76d81ee9446cf9014a2e695ef03e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae8c589d0b84ce096451a10717fc601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:43:42.091634 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-d6fa7059-e8c2-4e29-bb57-071dfbf07aec tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] 10.222.0.15 "GET /compute/v2.1/servers/66820f24-a23a-4e02-a703-7c9832ffd729" status: 200 len: 1576 microversion: 2.1 time: 0.169034 Oct 31 12:43:42.092215 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 555/1116] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:43:41 2022] GET /compute/v2.1/servers/66820f24-a23a-4e02-a703-7c9832ffd729 => generated 1576 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 12:43:42.725314 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-20a22fb4-cc76-4018-a215-d3b977df24e8 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:43:42.726004 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-20a22fb4-cc76-4018-a215-d3b977df24e8 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] [instance: b4f99a06-df16-4bff-b028-70add159b4ee] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:43:42.733041 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-20a22fb4-cc76-4018-a215-d3b977df24e8 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:43:42.733518 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-20a22fb4-cc76-4018-a215-d3b977df24e8 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:43:42.733942 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-20a22fb4-cc76-4018-a215-d3b977df24e8 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:43:42.734647 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-20a22fb4-cc76-4018-a215-d3b977df24e8 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:43:42.735113 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-20a22fb4-cc76-4018-a215-d3b977df24e8 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:43:42.735548 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-20a22fb4-cc76-4018-a215-d3b977df24e8 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:43:42.883026 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-20a22fb4-cc76-4018-a215-d3b977df24e8 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ddf1d02fa2644d280d9dee5b3101366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0637756aceaf4644bf263b5b5d72d9ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:43:42.892314 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-20a22fb4-cc76-4018-a215-d3b977df24e8 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] 10.222.0.15 "GET /compute/v2.1/servers/b4f99a06-df16-4bff-b028-70add159b4ee" status: 200 len: 1757 microversion: 2.1 time: 0.171668 Oct 31 12:43:42.892888 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 562/1117] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:43:42 2022] GET /compute/v2.1/servers/b4f99a06-df16-4bff-b028-70add159b4ee => generated 1757 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:43:43.114702 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-f4e679ff-71bc-44b3-8ee5-979095eecddf tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:43:43.115331 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-f4e679ff-71bc-44b3-8ee5-979095eecddf tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] [instance: 66820f24-a23a-4e02-a703-7c9832ffd729] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:43:43.122178 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-f4e679ff-71bc-44b3-8ee5-979095eecddf tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:43:43.122336 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-f4e679ff-71bc-44b3-8ee5-979095eecddf tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:43:43.122690 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-f4e679ff-71bc-44b3-8ee5-979095eecddf tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:43:43.123394 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-f4e679ff-71bc-44b3-8ee5-979095eecddf tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:43:43.123841 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-f4e679ff-71bc-44b3-8ee5-979095eecddf tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:43:43.124257 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-f4e679ff-71bc-44b3-8ee5-979095eecddf tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:43:43.260179 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-f4e679ff-71bc-44b3-8ee5-979095eecddf tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b76d81ee9446cf9014a2e695ef03e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae8c589d0b84ce096451a10717fc601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:43:43.268680 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-f4e679ff-71bc-44b3-8ee5-979095eecddf tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] 10.222.0.15 "GET /compute/v2.1/servers/66820f24-a23a-4e02-a703-7c9832ffd729" status: 200 len: 1576 microversion: 2.1 time: 0.157640 Oct 31 12:43:43.269252 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 556/1118] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:43:43 2022] GET /compute/v2.1/servers/66820f24-a23a-4e02-a703-7c9832ffd729 => generated 1576 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:43:44.293458 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-0e3850cc-eed1-4906-b917-a613263a2b50 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:43:44.294208 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-0e3850cc-eed1-4906-b917-a613263a2b50 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] [instance: 66820f24-a23a-4e02-a703-7c9832ffd729] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:43:44.301862 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-0e3850cc-eed1-4906-b917-a613263a2b50 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:43:44.302355 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-0e3850cc-eed1-4906-b917-a613263a2b50 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:43:44.302978 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-0e3850cc-eed1-4906-b917-a613263a2b50 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:43:44.303706 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-0e3850cc-eed1-4906-b917-a613263a2b50 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:43:44.304252 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-0e3850cc-eed1-4906-b917-a613263a2b50 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:43:44.304682 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-0e3850cc-eed1-4906-b917-a613263a2b50 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:43:44.306743 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [req-747d0969-8d76-4f11-9428-d57b40cedbfc req-efdebf0a-7b07-4d6b-9d92-abc924e523e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66820f24-a23a-4e02-a703-7c9832ffd729", "name": "network-vif-deleted", "tag": "bf3768f3-740b-45b9-92a5-0798ffcfacc8"}]} {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 12:43:44.313941 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG dbcounter [-] [125441] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=2 {{(pid=125441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:43:44.319965 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [req-747d0969-8d76-4f11-9428-d57b40cedbfc req-efdebf0a-7b07-4d6b-9d92-abc924e523e1 service nova] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:43:44.320419 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [req-747d0969-8d76-4f11-9428-d57b40cedbfc req-efdebf0a-7b07-4d6b-9d92-abc924e523e1 service nova] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:43:44.320853 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [req-747d0969-8d76-4f11-9428-d57b40cedbfc req-efdebf0a-7b07-4d6b-9d92-abc924e523e1 service nova] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:43:44.333562 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.compute.server_external_events [req-747d0969-8d76-4f11-9428-d57b40cedbfc req-efdebf0a-7b07-4d6b-9d92-abc924e523e1 service nova] Creating event network-vif-deleted:bf3768f3-740b-45b9-92a5-0798ffcfacc8 for instance 66820f24-a23a-4e02-a703-7c9832ffd729 on hv-cinder-79617 Oct 31 12:43:44.338648 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [req-747d0969-8d76-4f11-9428-d57b40cedbfc req-efdebf0a-7b07-4d6b-9d92-abc924e523e1 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035561 Oct 31 12:43:44.339258 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 557/1119] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Oct 31 12:43:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 12:43:44.374754 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-0e3850cc-eed1-4906-b917-a613263a2b50 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b76d81ee9446cf9014a2e695ef03e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae8c589d0b84ce096451a10717fc601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:43:44.382960 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-0e3850cc-eed1-4906-b917-a613263a2b50 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] 10.222.0.15 "GET /compute/v2.1/servers/66820f24-a23a-4e02-a703-7c9832ffd729" status: 200 len: 1390 microversion: 2.1 time: 0.094364 Oct 31 12:43:44.383592 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 563/1120] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:43:44 2022] GET /compute/v2.1/servers/66820f24-a23a-4e02-a703-7c9832ffd729 => generated 1390 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:43:45.408733 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-04a0a482-1367-44bf-a596-8b9e50aa16c0 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:43:45.409345 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-04a0a482-1367-44bf-a596-8b9e50aa16c0 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] [instance: 66820f24-a23a-4e02-a703-7c9832ffd729] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:43:45.415466 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-04a0a482-1367-44bf-a596-8b9e50aa16c0 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:43:45.415945 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-04a0a482-1367-44bf-a596-8b9e50aa16c0 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:43:45.416380 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-04a0a482-1367-44bf-a596-8b9e50aa16c0 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:43:45.417060 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-04a0a482-1367-44bf-a596-8b9e50aa16c0 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:43:45.417511 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-04a0a482-1367-44bf-a596-8b9e50aa16c0 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:43:45.417956 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-04a0a482-1367-44bf-a596-8b9e50aa16c0 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:43:45.432641 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.wsgi [None req-04a0a482-1367-44bf-a596-8b9e50aa16c0 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] HTTP exception thrown: Instance 66820f24-a23a-4e02-a703-7c9832ffd729 could not be found. Oct 31 12:43:45.434244 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-04a0a482-1367-44bf-a596-8b9e50aa16c0 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Request method failure captured: Oct 31 12:43:45.434244 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: request: GET /compute/v2.1/servers/66820f24-a23a-4e02-a703-7c9832ffd729 HTTP/1.1 Oct 31 12:43:45.434244 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: Accept: application/json Oct 31 12:43:45.434244 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: Accept-Encoding: identity Oct 31 12:43:45.434244 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: Connection: close Oct 31 12:43:45.434244 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: Content-Length: 0 Oct 31 12:43:45.434244 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: Content-Type: application/json Oct 31 12:43:45.434244 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: Host: 10.222.0.15 Oct 31 12:43:45.434244 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: Openstack-System-Scope: None Oct 31 12:43:45.434244 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: User-Agent: python-urllib3/1.26.12 Oct 31 12:43:45.434244 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Auth-Token: gAAAAABjX8ElwiFia2OI6O2RwJPy13K8nl1mdQGDt5jidBRDNGeqwFGcRjHqSs1tV4YxvMZwm4l_cN5yDtW5rP-Ot8FzzhasSqmv9N_z3tYT2ENYznM5T_zZzKCsfaeDRYhOtFgoGAe6dzPXmQXXZPqOFj5aUjRHbuKqJUx252eFjU7wD3PCLR0 Oct 31 12:43:45.434244 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Domain-Id: None Oct 31 12:43:45.434244 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Domain-Name: None Oct 31 12:43:45.434244 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Identity-Status: Confirmed Oct 31 12:43:45.434244 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Is-Admin-Project: True Oct 31 12:43:45.434244 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Project-Domain-Id: default Oct 31 12:43:45.434244 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Project-Domain-Name: Default Oct 31 12:43:45.434244 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Project-Id: 8ae8c589d0b84ce096451a10717fc601 Oct 31 12:43:45.434244 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Project-Name: tempest-TestVolumeBootPattern-1228930348 Oct 31 12:43:45.434244 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Role: reader,member Oct 31 12:43:45.434244 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Roles: reader,member Oct 31 12:43:45.436156 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/8ae8c589d0b84ce096451a10717fc601"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_8ae8c589d0b84ce096451a10717fc601", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/8ae8c589d0b84ce096451a10717fc601"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/8ae8c589d0b84ce096451a10717fc601"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Oct 31 12:43:45.436156 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Tenant: tempest-TestVolumeBootPattern-1228930348 Oct 31 12:43:45.436156 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Tenant-Id: 8ae8c589d0b84ce096451a10717fc601 Oct 31 12:43:45.436156 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Tenant-Name: tempest-TestVolumeBootPattern-1228930348 Oct 31 12:43:45.436156 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-User: tempest-TestVolumeBootPattern-1228930348-project Oct 31 12:43:45.436156 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-User-Domain-Id: default Oct 31 12:43:45.436156 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-User-Domain-Name: Default Oct 31 12:43:45.436156 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-User-Id: 49b76d81ee9446cf9014a2e695ef03e7 Oct 31 12:43:45.436156 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-User-Name: tempest-TestVolumeBootPattern-1228930348-project Oct 31 12:43:45.436156 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: method: > Oct 31 12:43:45.436156 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: exception: Instance 66820f24-a23a-4e02-a703-7c9832ffd729 could not be found. Oct 31 12:43:45.436156 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: action_args: {'id': '66820f24-a23a-4e02-a703-7c9832ffd729'} Oct 31 12:43:45.437122 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 12:43:45.437122 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 12:43:45.437122 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 12:43:45.437122 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 12:43:45.437122 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 12:43:45.437122 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 12:43:45.437122 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 12:43:45.437122 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 12:43:45.437122 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 12:43:45.437122 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 12:43:45.437122 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 66820f24-a23a-4e02-a703-7c9832ffd729 could not be found. Oct 31 12:43:45.437122 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Oct 31 12:43:45.437122 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 12:43:45.437122 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Oct 31 12:43:45.437122 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 12:43:45.437122 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 12:43:45.437122 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 12:43:45.437122 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 12:43:45.437122 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 12:43:45.437122 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 12:43:45.438738 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 12:43:45.438738 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 12:43:45.438738 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 12:43:45.438738 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 12:43:45.438738 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 12:43:45.438738 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 12:43:45.438738 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 12:43:45.438738 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 66820f24-a23a-4e02-a703-7c9832ffd729 could not be found. Oct 31 12:43:45.438738 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Oct 31 12:43:45.438738 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 12:43:45.438738 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Oct 31 12:43:45.438738 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 12:43:45.438738 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 12:43:45.438738 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 12:43:45.438738 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 12:43:45.438738 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 12:43:45.438738 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 66820f24-a23a-4e02-a703-7c9832ffd729 could not be found. Oct 31 12:43:45.438738 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Oct 31 12:43:45.440191 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-04a0a482-1367-44bf-a596-8b9e50aa16c0 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Returning 404 to user: Instance 66820f24-a23a-4e02-a703-7c9832ffd729 could not be found. {{(pid=125441) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 12:43:45.440191 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-04a0a482-1367-44bf-a596-8b9e50aa16c0 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] 10.222.0.15 "GET /compute/v2.1/servers/66820f24-a23a-4e02-a703-7c9832ffd729" status: 404 len: 111 microversion: 2.1 time: 0.032672 Oct 31 12:43:45.440191 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 558/1121] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:43:45 2022] GET /compute/v2.1/servers/66820f24-a23a-4e02-a703-7c9832ffd729 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 12:43:48.511686 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-d247440a-8e16-42cc-892d-6d8fa720186a tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:43:48.512233 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-d247440a-8e16-42cc-892d-6d8fa720186a tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] [instance: 4400e455-f03f-48be-a78e-c4886ef878c6] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:43:48.514325 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [req-595f7557-041e-426c-aafe-94fd332f4167 req-712d7ec0-54ca-4a4d-8fe7-663786c07b7b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4400e455-f03f-48be-a78e-c4886ef878c6", "tag": "a1f478e3-0037-482b-9f12-361410fca1f5"}]} {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 12:43:48.519448 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-d247440a-8e16-42cc-892d-6d8fa720186a tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:43:48.519992 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-d247440a-8e16-42cc-892d-6d8fa720186a tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:43:48.520483 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-d247440a-8e16-42cc-892d-6d8fa720186a tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:43:48.521381 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-d247440a-8e16-42cc-892d-6d8fa720186a tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:43:48.521826 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-d247440a-8e16-42cc-892d-6d8fa720186a tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:43:48.522237 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-d247440a-8e16-42cc-892d-6d8fa720186a tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:43:48.524892 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [req-595f7557-041e-426c-aafe-94fd332f4167 req-712d7ec0-54ca-4a4d-8fe7-663786c07b7b service nova] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:43:48.525469 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [req-595f7557-041e-426c-aafe-94fd332f4167 req-712d7ec0-54ca-4a4d-8fe7-663786c07b7b service nova] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:43:48.525992 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [req-595f7557-041e-426c-aafe-94fd332f4167 req-712d7ec0-54ca-4a4d-8fe7-663786c07b7b service nova] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:43:48.538697 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.compute.server_external_events [req-595f7557-041e-426c-aafe-94fd332f4167 req-712d7ec0-54ca-4a4d-8fe7-663786c07b7b service nova] Creating event network-changed:a1f478e3-0037-482b-9f12-361410fca1f5 for instance 4400e455-f03f-48be-a78e-c4886ef878c6 on hv-cinder-79617 Oct 31 12:43:48.543904 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [req-595f7557-041e-426c-aafe-94fd332f4167 req-712d7ec0-54ca-4a4d-8fe7-663786c07b7b service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033606 Oct 31 12:43:48.545336 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 559/1122] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Oct 31 12:43:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 12:43:48.550246 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-d247440a-8e16-42cc-892d-6d8fa720186a tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] [instance: 4400e455-f03f-48be-a78e-c4886ef878c6] Going to try to terminate instance {{(pid=125440) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 12:43:48.635908 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-d247440a-8e16-42cc-892d-6d8fa720186a tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] 10.222.0.15 "DELETE /compute/v2.1/servers/4400e455-f03f-48be-a78e-c4886ef878c6" status: 204 len: 0 microversion: 2.1 time: 0.127776 Oct 31 12:43:48.639875 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 564/1123] 10.222.0.15 () {58 vars in 1239 bytes} [Mon Oct 31 12:43:48 2022] DELETE /compute/v2.1/servers/4400e455-f03f-48be-a78e-c4886ef878c6 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 12:43:48.646054 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-c8163685-4d0b-4f08-89c7-f830a17638c9 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:43:48.646985 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-c8163685-4d0b-4f08-89c7-f830a17638c9 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] [instance: 4400e455-f03f-48be-a78e-c4886ef878c6] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:43:48.653590 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-c8163685-4d0b-4f08-89c7-f830a17638c9 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:43:48.654452 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-c8163685-4d0b-4f08-89c7-f830a17638c9 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:43:48.654867 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-c8163685-4d0b-4f08-89c7-f830a17638c9 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:43:48.655672 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-c8163685-4d0b-4f08-89c7-f830a17638c9 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:43:48.656663 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-c8163685-4d0b-4f08-89c7-f830a17638c9 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:43:48.656663 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-c8163685-4d0b-4f08-89c7-f830a17638c9 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:43:48.800804 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-c8163685-4d0b-4f08-89c7-f830a17638c9 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b76d81ee9446cf9014a2e695ef03e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae8c589d0b84ce096451a10717fc601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:43:48.809011 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-c8163685-4d0b-4f08-89c7-f830a17638c9 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] 10.222.0.15 "GET /compute/v2.1/servers/4400e455-f03f-48be-a78e-c4886ef878c6" status: 200 len: 1578 microversion: 2.1 time: 0.167310 Oct 31 12:43:48.809501 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 560/1124] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:43:48 2022] GET /compute/v2.1/servers/4400e455-f03f-48be-a78e-c4886ef878c6 => generated 1578 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:43:49.832449 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-2c48c41c-ae73-4989-afb4-7a5a3fdbb23d tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:43:49.833174 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-2c48c41c-ae73-4989-afb4-7a5a3fdbb23d tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] [instance: 4400e455-f03f-48be-a78e-c4886ef878c6] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:43:49.839498 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-2c48c41c-ae73-4989-afb4-7a5a3fdbb23d tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:43:49.839978 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-2c48c41c-ae73-4989-afb4-7a5a3fdbb23d tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:43:49.840407 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-2c48c41c-ae73-4989-afb4-7a5a3fdbb23d tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:43:49.841648 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-2c48c41c-ae73-4989-afb4-7a5a3fdbb23d tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:43:49.842362 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-2c48c41c-ae73-4989-afb4-7a5a3fdbb23d tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:43:49.842648 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-2c48c41c-ae73-4989-afb4-7a5a3fdbb23d tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:43:49.984659 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-2c48c41c-ae73-4989-afb4-7a5a3fdbb23d tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b76d81ee9446cf9014a2e695ef03e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae8c589d0b84ce096451a10717fc601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:43:49.992376 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-2c48c41c-ae73-4989-afb4-7a5a3fdbb23d tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] 10.222.0.15 "GET /compute/v2.1/servers/4400e455-f03f-48be-a78e-c4886ef878c6" status: 200 len: 1578 microversion: 2.1 time: 0.164173 Oct 31 12:43:49.992952 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 565/1125] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:43:49 2022] GET /compute/v2.1/servers/4400e455-f03f-48be-a78e-c4886ef878c6 => generated 1578 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:43:50.725891 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [req-7968db6f-8926-4402-9e83-9497452e2821 req-4d9abfd2-fbbd-4889-8770-5525861ab9a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4400e455-f03f-48be-a78e-c4886ef878c6", "name": "network-vif-deleted", "tag": "a1f478e3-0037-482b-9f12-361410fca1f5"}]} {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 12:43:50.738575 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [req-7968db6f-8926-4402-9e83-9497452e2821 req-4d9abfd2-fbbd-4889-8770-5525861ab9a2 service nova] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:43:50.739053 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [req-7968db6f-8926-4402-9e83-9497452e2821 req-4d9abfd2-fbbd-4889-8770-5525861ab9a2 service nova] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:43:50.739576 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [req-7968db6f-8926-4402-9e83-9497452e2821 req-4d9abfd2-fbbd-4889-8770-5525861ab9a2 service nova] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:43:50.752266 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.compute.server_external_events [req-7968db6f-8926-4402-9e83-9497452e2821 req-4d9abfd2-fbbd-4889-8770-5525861ab9a2 service nova] Creating event network-vif-deleted:a1f478e3-0037-482b-9f12-361410fca1f5 for instance 4400e455-f03f-48be-a78e-c4886ef878c6 on hv-cinder-79617 Oct 31 12:43:50.757523 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [req-7968db6f-8926-4402-9e83-9497452e2821 req-4d9abfd2-fbbd-4889-8770-5525861ab9a2 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035480 Oct 31 12:43:50.758123 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 561/1126] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Oct 31 12:43:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 12:43:51.018096 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-49315535-a4c2-4da0-9497-912b39589a3f tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:43:51.018700 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-49315535-a4c2-4da0-9497-912b39589a3f tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] [instance: 4400e455-f03f-48be-a78e-c4886ef878c6] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:43:51.026434 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-49315535-a4c2-4da0-9497-912b39589a3f tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:43:51.027408 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-49315535-a4c2-4da0-9497-912b39589a3f tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:43:51.028068 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-49315535-a4c2-4da0-9497-912b39589a3f tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:43:51.028949 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-49315535-a4c2-4da0-9497-912b39589a3f tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:43:51.032955 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-49315535-a4c2-4da0-9497-912b39589a3f tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:43:51.033503 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-49315535-a4c2-4da0-9497-912b39589a3f tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:43:51.068389 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-49315535-a4c2-4da0-9497-912b39589a3f tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:43:51.068946 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-49315535-a4c2-4da0-9497-912b39589a3f tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:43:51.069442 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-49315535-a4c2-4da0-9497-912b39589a3f tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:43:51.069949 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.objects.instance [None req-49315535-a4c2-4da0-9497-912b39589a3f tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lazy-loading 'fault' on Instance uuid 4400e455-f03f-48be-a78e-c4886ef878c6 {{(pid=125440) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 12:43:51.113142 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-49315535-a4c2-4da0-9497-912b39589a3f tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b76d81ee9446cf9014a2e695ef03e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae8c589d0b84ce096451a10717fc601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:43:51.121304 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-49315535-a4c2-4da0-9497-912b39589a3f tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] 10.222.0.15 "GET /compute/v2.1/servers/4400e455-f03f-48be-a78e-c4886ef878c6" status: 200 len: 1230 microversion: 2.1 time: 0.107991 Oct 31 12:43:51.122180 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 566/1127] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:43:51 2022] GET /compute/v2.1/servers/4400e455-f03f-48be-a78e-c4886ef878c6 => generated 1230 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:43:52.145801 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-f053899c-8e1a-4f72-b73e-03f30222b61a tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:43:52.146491 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-f053899c-8e1a-4f72-b73e-03f30222b61a tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] [instance: 4400e455-f03f-48be-a78e-c4886ef878c6] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:43:52.153161 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-f053899c-8e1a-4f72-b73e-03f30222b61a tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:43:52.154268 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-f053899c-8e1a-4f72-b73e-03f30222b61a tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:43:52.154736 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-f053899c-8e1a-4f72-b73e-03f30222b61a tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:43:52.155436 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-f053899c-8e1a-4f72-b73e-03f30222b61a tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:43:52.155890 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-f053899c-8e1a-4f72-b73e-03f30222b61a tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:43:52.156310 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-f053899c-8e1a-4f72-b73e-03f30222b61a tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:43:52.169344 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.wsgi [None req-f053899c-8e1a-4f72-b73e-03f30222b61a tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] HTTP exception thrown: Instance 4400e455-f03f-48be-a78e-c4886ef878c6 could not be found. Oct 31 12:43:52.170945 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-f053899c-8e1a-4f72-b73e-03f30222b61a tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Request method failure captured: Oct 31 12:43:52.170945 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: request: GET /compute/v2.1/servers/4400e455-f03f-48be-a78e-c4886ef878c6 HTTP/1.1 Oct 31 12:43:52.170945 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: Accept: application/json Oct 31 12:43:52.170945 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: Accept-Encoding: identity Oct 31 12:43:52.170945 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: Connection: close Oct 31 12:43:52.170945 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: Content-Length: 0 Oct 31 12:43:52.170945 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: Content-Type: application/json Oct 31 12:43:52.170945 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: Host: 10.222.0.15 Oct 31 12:43:52.170945 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: Openstack-System-Scope: None Oct 31 12:43:52.170945 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: User-Agent: python-urllib3/1.26.12 Oct 31 12:43:52.170945 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Auth-Token: gAAAAABjX8ElwiFia2OI6O2RwJPy13K8nl1mdQGDt5jidBRDNGeqwFGcRjHqSs1tV4YxvMZwm4l_cN5yDtW5rP-Ot8FzzhasSqmv9N_z3tYT2ENYznM5T_zZzKCsfaeDRYhOtFgoGAe6dzPXmQXXZPqOFj5aUjRHbuKqJUx252eFjU7wD3PCLR0 Oct 31 12:43:52.170945 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Domain-Id: None Oct 31 12:43:52.170945 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Domain-Name: None Oct 31 12:43:52.170945 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Identity-Status: Confirmed Oct 31 12:43:52.170945 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Is-Admin-Project: True Oct 31 12:43:52.170945 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Project-Domain-Id: default Oct 31 12:43:52.170945 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Project-Domain-Name: Default Oct 31 12:43:52.170945 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Project-Id: 8ae8c589d0b84ce096451a10717fc601 Oct 31 12:43:52.170945 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Project-Name: tempest-TestVolumeBootPattern-1228930348 Oct 31 12:43:52.170945 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Role: reader,member Oct 31 12:43:52.170945 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Roles: reader,member Oct 31 12:43:52.172622 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/8ae8c589d0b84ce096451a10717fc601"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_8ae8c589d0b84ce096451a10717fc601", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/8ae8c589d0b84ce096451a10717fc601"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/8ae8c589d0b84ce096451a10717fc601"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Oct 31 12:43:52.172622 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Tenant: tempest-TestVolumeBootPattern-1228930348 Oct 31 12:43:52.172622 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Tenant-Id: 8ae8c589d0b84ce096451a10717fc601 Oct 31 12:43:52.172622 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Tenant-Name: tempest-TestVolumeBootPattern-1228930348 Oct 31 12:43:52.172622 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-User: tempest-TestVolumeBootPattern-1228930348-project Oct 31 12:43:52.172622 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-User-Domain-Id: default Oct 31 12:43:52.172622 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-User-Domain-Name: Default Oct 31 12:43:52.172622 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-User-Id: 49b76d81ee9446cf9014a2e695ef03e7 Oct 31 12:43:52.172622 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-User-Name: tempest-TestVolumeBootPattern-1228930348-project Oct 31 12:43:52.172622 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: method: > Oct 31 12:43:52.172622 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: exception: Instance 4400e455-f03f-48be-a78e-c4886ef878c6 could not be found. Oct 31 12:43:52.172622 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: action_args: {'id': '4400e455-f03f-48be-a78e-c4886ef878c6'} Oct 31 12:43:52.173635 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 12:43:52.173635 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 12:43:52.173635 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 12:43:52.173635 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 12:43:52.173635 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 12:43:52.173635 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 12:43:52.173635 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 12:43:52.173635 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 12:43:52.173635 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 12:43:52.173635 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 12:43:52.173635 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4400e455-f03f-48be-a78e-c4886ef878c6 could not be found. Oct 31 12:43:52.173635 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Oct 31 12:43:52.173635 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 12:43:52.173635 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Oct 31 12:43:52.173635 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 12:43:52.173635 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 12:43:52.173635 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 12:43:52.173635 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 12:43:52.173635 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 12:43:52.173635 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 12:43:52.175187 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 12:43:52.175187 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 12:43:52.175187 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 12:43:52.175187 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 12:43:52.175187 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 12:43:52.175187 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 12:43:52.175187 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 12:43:52.175187 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4400e455-f03f-48be-a78e-c4886ef878c6 could not be found. Oct 31 12:43:52.175187 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Oct 31 12:43:52.175187 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 12:43:52.175187 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Oct 31 12:43:52.175187 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 12:43:52.175187 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 12:43:52.175187 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 12:43:52.175187 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 12:43:52.175187 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 12:43:52.175187 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4400e455-f03f-48be-a78e-c4886ef878c6 could not be found. Oct 31 12:43:52.175187 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Oct 31 12:43:52.176663 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-f053899c-8e1a-4f72-b73e-03f30222b61a tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Returning 404 to user: Instance 4400e455-f03f-48be-a78e-c4886ef878c6 could not be found. {{(pid=125441) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 12:43:52.176663 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-f053899c-8e1a-4f72-b73e-03f30222b61a tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] 10.222.0.15 "GET /compute/v2.1/servers/4400e455-f03f-48be-a78e-c4886ef878c6" status: 404 len: 111 microversion: 2.1 time: 0.030790 Oct 31 12:43:52.176663 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 562/1128] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:43:52 2022] GET /compute/v2.1/servers/4400e455-f03f-48be-a78e-c4886ef878c6 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 12:43:52.608970 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-8c249631-b264-4456-a966-df65d4224e37 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:43:52.609458 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-8c249631-b264-4456-a966-df65d4224e37 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] [instance: d7643c7c-0218-427f-876a-cf89c932dd11] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:43:52.615752 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-8c249631-b264-4456-a966-df65d4224e37 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:43:52.616227 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-8c249631-b264-4456-a966-df65d4224e37 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:43:52.616656 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-8c249631-b264-4456-a966-df65d4224e37 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:43:52.617338 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-8c249631-b264-4456-a966-df65d4224e37 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:43:52.617784 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-8c249631-b264-4456-a966-df65d4224e37 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:43:52.618203 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-8c249631-b264-4456-a966-df65d4224e37 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:43:52.631945 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.wsgi [None req-8c249631-b264-4456-a966-df65d4224e37 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] HTTP exception thrown: Instance d7643c7c-0218-427f-876a-cf89c932dd11 could not be found. Oct 31 12:43:52.633589 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-8c249631-b264-4456-a966-df65d4224e37 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Request method failure captured: Oct 31 12:43:52.633589 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: request: DELETE /compute/v2.1/servers/d7643c7c-0218-427f-876a-cf89c932dd11 HTTP/1.1 Oct 31 12:43:52.633589 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: Accept: application/json Oct 31 12:43:52.633589 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: Accept-Encoding: identity Oct 31 12:43:52.633589 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: Connection: close Oct 31 12:43:52.633589 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: Content-Length: 0 Oct 31 12:43:52.633589 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: Content-Type: application/json Oct 31 12:43:52.633589 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: Host: 10.222.0.15 Oct 31 12:43:52.633589 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: Openstack-System-Scope: None Oct 31 12:43:52.633589 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: User-Agent: python-urllib3/1.26.12 Oct 31 12:43:52.633589 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Auth-Token: gAAAAABjX8ElwiFia2OI6O2RwJPy13K8nl1mdQGDt5jidBRDNGeqwFGcRjHqSs1tV4YxvMZwm4l_cN5yDtW5rP-Ot8FzzhasSqmv9N_z3tYT2ENYznM5T_zZzKCsfaeDRYhOtFgoGAe6dzPXmQXXZPqOFj5aUjRHbuKqJUx252eFjU7wD3PCLR0 Oct 31 12:43:52.633589 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Domain-Id: None Oct 31 12:43:52.633589 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Domain-Name: None Oct 31 12:43:52.633589 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Identity-Status: Confirmed Oct 31 12:43:52.633589 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Is-Admin-Project: True Oct 31 12:43:52.633589 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Project-Domain-Id: default Oct 31 12:43:52.633589 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Project-Domain-Name: Default Oct 31 12:43:52.633589 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Project-Id: 8ae8c589d0b84ce096451a10717fc601 Oct 31 12:43:52.633589 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Project-Name: tempest-TestVolumeBootPattern-1228930348 Oct 31 12:43:52.633589 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Role: reader,member Oct 31 12:43:52.633589 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Roles: reader,member Oct 31 12:43:52.635285 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/8ae8c589d0b84ce096451a10717fc601"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_8ae8c589d0b84ce096451a10717fc601", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/8ae8c589d0b84ce096451a10717fc601"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/8ae8c589d0b84ce096451a10717fc601"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Oct 31 12:43:52.635285 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Tenant: tempest-TestVolumeBootPattern-1228930348 Oct 31 12:43:52.635285 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Tenant-Id: 8ae8c589d0b84ce096451a10717fc601 Oct 31 12:43:52.635285 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Tenant-Name: tempest-TestVolumeBootPattern-1228930348 Oct 31 12:43:52.635285 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-User: tempest-TestVolumeBootPattern-1228930348-project Oct 31 12:43:52.635285 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-User-Domain-Id: default Oct 31 12:43:52.635285 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-User-Domain-Name: Default Oct 31 12:43:52.635285 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-User-Id: 49b76d81ee9446cf9014a2e695ef03e7 Oct 31 12:43:52.635285 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-User-Name: tempest-TestVolumeBootPattern-1228930348-project Oct 31 12:43:52.635285 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: method: > Oct 31 12:43:52.635285 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: exception: Instance d7643c7c-0218-427f-876a-cf89c932dd11 could not be found. Oct 31 12:43:52.635285 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: action_args: {'id': 'd7643c7c-0218-427f-876a-cf89c932dd11'} Oct 31 12:43:52.636233 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 12:43:52.636233 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 12:43:52.636233 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 12:43:52.636233 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 12:43:52.636233 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 12:43:52.636233 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 12:43:52.636233 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 12:43:52.636233 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 12:43:52.636233 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 12:43:52.636233 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 12:43:52.636233 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d7643c7c-0218-427f-876a-cf89c932dd11 could not be found. Oct 31 12:43:52.636233 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Oct 31 12:43:52.636233 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 12:43:52.636233 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Oct 31 12:43:52.636233 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 12:43:52.636233 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 12:43:52.636233 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 12:43:52.636233 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 12:43:52.636233 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 12:43:52.636233 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 12:43:52.637792 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 12:43:52.637792 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 31 12:43:52.637792 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 31 12:43:52.637792 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 31 12:43:52.637792 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 31 12:43:52.637792 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 12:43:52.637792 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 12:43:52.637792 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 12:43:52.637792 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 12:43:52.637792 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d7643c7c-0218-427f-876a-cf89c932dd11 could not be found. Oct 31 12:43:52.637792 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Oct 31 12:43:52.637792 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 12:43:52.637792 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Oct 31 12:43:52.637792 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 12:43:52.637792 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 12:43:52.637792 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 12:43:52.637792 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 12:43:52.637792 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 12:43:52.637792 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d7643c7c-0218-427f-876a-cf89c932dd11 could not be found. Oct 31 12:43:52.637792 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Oct 31 12:43:52.639478 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-8c249631-b264-4456-a966-df65d4224e37 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Returning 404 to user: Instance d7643c7c-0218-427f-876a-cf89c932dd11 could not be found. {{(pid=125440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 12:43:52.639478 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-8c249631-b264-4456-a966-df65d4224e37 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] 10.222.0.15 "DELETE /compute/v2.1/servers/d7643c7c-0218-427f-876a-cf89c932dd11" status: 404 len: 111 microversion: 2.1 time: 0.030170 Oct 31 12:43:52.639478 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 567/1129] 10.222.0.15 () {58 vars in 1239 bytes} [Mon Oct 31 12:43:52 2022] DELETE /compute/v2.1/servers/d7643c7c-0218-427f-876a-cf89c932dd11 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 12:43:52.644155 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-355bebce-1ea4-447f-9cd6-5eeede0f569f tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:43:52.644766 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-355bebce-1ea4-447f-9cd6-5eeede0f569f tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] [instance: d7643c7c-0218-427f-876a-cf89c932dd11] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:43:52.650683 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-355bebce-1ea4-447f-9cd6-5eeede0f569f tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:43:52.651180 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-355bebce-1ea4-447f-9cd6-5eeede0f569f tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:43:52.651619 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-355bebce-1ea4-447f-9cd6-5eeede0f569f tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:43:52.652301 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-355bebce-1ea4-447f-9cd6-5eeede0f569f tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:43:52.652752 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-355bebce-1ea4-447f-9cd6-5eeede0f569f tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:43:52.653173 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-355bebce-1ea4-447f-9cd6-5eeede0f569f tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:43:52.666992 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.wsgi [None req-355bebce-1ea4-447f-9cd6-5eeede0f569f tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] HTTP exception thrown: Instance d7643c7c-0218-427f-876a-cf89c932dd11 could not be found. Oct 31 12:43:52.668533 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-355bebce-1ea4-447f-9cd6-5eeede0f569f tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Request method failure captured: Oct 31 12:43:52.668533 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: request: GET /compute/v2.1/servers/d7643c7c-0218-427f-876a-cf89c932dd11 HTTP/1.1 Oct 31 12:43:52.668533 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: Accept: application/json Oct 31 12:43:52.668533 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: Accept-Encoding: identity Oct 31 12:43:52.668533 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: Connection: close Oct 31 12:43:52.668533 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: Content-Length: 0 Oct 31 12:43:52.668533 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: Content-Type: application/json Oct 31 12:43:52.668533 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: Host: 10.222.0.15 Oct 31 12:43:52.668533 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: Openstack-System-Scope: None Oct 31 12:43:52.668533 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: User-Agent: python-urllib3/1.26.12 Oct 31 12:43:52.668533 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Auth-Token: gAAAAABjX8ElwiFia2OI6O2RwJPy13K8nl1mdQGDt5jidBRDNGeqwFGcRjHqSs1tV4YxvMZwm4l_cN5yDtW5rP-Ot8FzzhasSqmv9N_z3tYT2ENYznM5T_zZzKCsfaeDRYhOtFgoGAe6dzPXmQXXZPqOFj5aUjRHbuKqJUx252eFjU7wD3PCLR0 Oct 31 12:43:52.668533 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Domain-Id: None Oct 31 12:43:52.668533 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Domain-Name: None Oct 31 12:43:52.668533 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Identity-Status: Confirmed Oct 31 12:43:52.668533 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Is-Admin-Project: True Oct 31 12:43:52.668533 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Project-Domain-Id: default Oct 31 12:43:52.668533 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Project-Domain-Name: Default Oct 31 12:43:52.668533 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Project-Id: 8ae8c589d0b84ce096451a10717fc601 Oct 31 12:43:52.668533 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Project-Name: tempest-TestVolumeBootPattern-1228930348 Oct 31 12:43:52.668533 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Role: reader,member Oct 31 12:43:52.668533 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Roles: reader,member Oct 31 12:43:52.671012 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/8ae8c589d0b84ce096451a10717fc601"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_8ae8c589d0b84ce096451a10717fc601", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/8ae8c589d0b84ce096451a10717fc601"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/8ae8c589d0b84ce096451a10717fc601"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Oct 31 12:43:52.671012 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Tenant: tempest-TestVolumeBootPattern-1228930348 Oct 31 12:43:52.671012 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Tenant-Id: 8ae8c589d0b84ce096451a10717fc601 Oct 31 12:43:52.671012 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-Tenant-Name: tempest-TestVolumeBootPattern-1228930348 Oct 31 12:43:52.671012 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-User: tempest-TestVolumeBootPattern-1228930348-project Oct 31 12:43:52.671012 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-User-Domain-Id: default Oct 31 12:43:52.671012 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-User-Domain-Name: Default Oct 31 12:43:52.671012 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-User-Id: 49b76d81ee9446cf9014a2e695ef03e7 Oct 31 12:43:52.671012 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: X-User-Name: tempest-TestVolumeBootPattern-1228930348-project Oct 31 12:43:52.671012 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: method: > Oct 31 12:43:52.671012 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: exception: Instance d7643c7c-0218-427f-876a-cf89c932dd11 could not be found. Oct 31 12:43:52.671012 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: action_args: {'id': 'd7643c7c-0218-427f-876a-cf89c932dd11'} Oct 31 12:43:52.672082 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 12:43:52.672082 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 12:43:52.672082 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 12:43:52.672082 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 12:43:52.672082 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 12:43:52.672082 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 12:43:52.672082 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 12:43:52.672082 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 12:43:52.672082 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 12:43:52.672082 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 12:43:52.672082 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d7643c7c-0218-427f-876a-cf89c932dd11 could not be found. Oct 31 12:43:52.672082 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Oct 31 12:43:52.672082 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 12:43:52.672082 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Oct 31 12:43:52.672082 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 12:43:52.672082 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 12:43:52.672082 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 12:43:52.672082 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 12:43:52.672082 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 12:43:52.672082 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 12:43:52.673552 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 12:43:52.673552 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 12:43:52.673552 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 12:43:52.673552 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 12:43:52.673552 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 12:43:52.673552 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 12:43:52.673552 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 12:43:52.673552 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d7643c7c-0218-427f-876a-cf89c932dd11 could not be found. Oct 31 12:43:52.673552 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Oct 31 12:43:52.673552 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 12:43:52.673552 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Oct 31 12:43:52.673552 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 12:43:52.673552 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 12:43:52.673552 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 12:43:52.673552 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 12:43:52.673552 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 12:43:52.673552 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d7643c7c-0218-427f-876a-cf89c932dd11 could not be found. Oct 31 12:43:52.673552 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: ERROR nova.api.openstack.wsgi Oct 31 12:43:52.674893 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-355bebce-1ea4-447f-9cd6-5eeede0f569f tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Returning 404 to user: Instance d7643c7c-0218-427f-876a-cf89c932dd11 could not be found. {{(pid=125441) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 12:43:52.674893 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-355bebce-1ea4-447f-9cd6-5eeede0f569f tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] 10.222.0.15 "GET /compute/v2.1/servers/d7643c7c-0218-427f-876a-cf89c932dd11" status: 404 len: 111 microversion: 2.1 time: 0.030513 Oct 31 12:43:52.674893 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 563/1130] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:43:52 2022] GET /compute/v2.1/servers/d7643c7c-0218-427f-876a-cf89c932dd11 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 12:43:53.974557 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-f0c61781-b93b-4b33-a86c-51f3d6017216 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] Calling method '.version_select at 0x7f2aa5198ca0>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:43:54.002296 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-f0c61781-b93b-4b33-a86c-51f3d6017216 tempest-TestVolumeBootPattern-1228930348 tempest-TestVolumeBootPattern-1228930348-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-899997443" status: 202 len: 0 microversion: 2.1 time: 0.031332 Oct 31 12:43:54.003095 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 568/1131] 10.222.0.15 () {58 vars in 1260 bytes} [Mon Oct 31 12:43:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-899997443 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 12:44:15.399376 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-1a098586-2281-4fe8-b51c-bd9eef607cea tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-907239926"}} {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 12:44:15.399942 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-1a098586-2281-4fe8-b51c-bd9eef607cea tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] [instance: b4f99a06-df16-4bff-b028-70add159b4ee] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:44:15.402505 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG dbcounter [-] [125441] Writing DB stats nova_api:SELECT=13 {{(pid=125441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:44:15.403182 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG dbcounter [-] [125441] Writing DB stats nova_cell1:SELECT=30 {{(pid=125441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:44:15.409528 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-1a098586-2281-4fe8-b51c-bd9eef607cea tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:44:15.409999 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-1a098586-2281-4fe8-b51c-bd9eef607cea tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:44:15.410426 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-1a098586-2281-4fe8-b51c-bd9eef607cea tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:44:15.411099 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-1a098586-2281-4fe8-b51c-bd9eef607cea tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:44:15.411646 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-1a098586-2281-4fe8-b51c-bd9eef607cea tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:44:15.412058 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-1a098586-2281-4fe8-b51c-bd9eef607cea tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:44:15.541619 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.network.security_group_api [None req-1a098586-2281-4fe8-b51c-bd9eef607cea tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Removing security group 21f5174d-99b1-4752-82a7-fd9662cbe4ef from port 16976c96-0697-482f-bcc1-98d0bc00538f Oct 31 12:44:15.874758 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-1a098586-2281-4fe8-b51c-bd9eef607cea tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] 10.222.0.15 "POST /compute/v2.1/servers/b4f99a06-df16-4bff-b028-70add159b4ee/action" status: 202 len: 0 microversion: 2.1 time: 0.479343 Oct 31 12:44:15.875718 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 564/1132] 10.222.0.15 () {60 vars in 1278 bytes} [Mon Oct 31 12:44:15 2022] POST /compute/v2.1/servers/b4f99a06-df16-4bff-b028-70add159b4ee/action => generated 0 bytes in 481 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 12:44:15.882928 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG dbcounter [-] [125440] Writing DB stats nova_cell1:SELECT=43,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:44:15.882928 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG dbcounter [-] [125440] Writing DB stats nova_api:SELECT=23,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=125440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:44:16.131951 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [req-a7e270a1-1eb0-4c81-82b4-35bcfcb7442e req-25663648-b9b9-43e9-8e50-ea20510718df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b4f99a06-df16-4bff-b028-70add159b4ee", "tag": "16976c96-0697-482f-bcc1-98d0bc00538f"}]} {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 12:44:16.144272 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [req-a7e270a1-1eb0-4c81-82b4-35bcfcb7442e req-25663648-b9b9-43e9-8e50-ea20510718df service nova] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:44:16.144752 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [req-a7e270a1-1eb0-4c81-82b4-35bcfcb7442e req-25663648-b9b9-43e9-8e50-ea20510718df service nova] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:44:16.145180 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [req-a7e270a1-1eb0-4c81-82b4-35bcfcb7442e req-25663648-b9b9-43e9-8e50-ea20510718df service nova] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:44:16.156780 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.compute.server_external_events [req-a7e270a1-1eb0-4c81-82b4-35bcfcb7442e req-25663648-b9b9-43e9-8e50-ea20510718df service nova] Creating event network-changed:16976c96-0697-482f-bcc1-98d0bc00538f for instance b4f99a06-df16-4bff-b028-70add159b4ee on hv-cinder-79617 Oct 31 12:44:16.162157 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [req-a7e270a1-1eb0-4c81-82b4-35bcfcb7442e req-25663648-b9b9-43e9-8e50-ea20510718df service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.282991 Oct 31 12:44:16.163459 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 569/1133] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Oct 31 12:44:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 12:44:16.941850 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-1d24abb8-8ade-43db-a694-927c3d6d7f7d tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:44:16.942396 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-1d24abb8-8ade-43db-a694-927c3d6d7f7d tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] [instance: b4f99a06-df16-4bff-b028-70add159b4ee] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:44:16.948298 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-1d24abb8-8ade-43db-a694-927c3d6d7f7d tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:44:16.948775 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-1d24abb8-8ade-43db-a694-927c3d6d7f7d tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:44:16.949205 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-1d24abb8-8ade-43db-a694-927c3d6d7f7d tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:44:16.949889 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-1d24abb8-8ade-43db-a694-927c3d6d7f7d tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:44:16.950372 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-1d24abb8-8ade-43db-a694-927c3d6d7f7d tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:44:16.950790 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-1d24abb8-8ade-43db-a694-927c3d6d7f7d tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:44:17.037209 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.objects.instance [None req-1d24abb8-8ade-43db-a694-927c3d6d7f7d tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Lazy-loading 'services' on Instance uuid b4f99a06-df16-4bff-b028-70add159b4ee {{(pid=125441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 12:44:17.111703 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-1d24abb8-8ade-43db-a694-927c3d6d7f7d tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] 10.222.0.15 "DELETE /compute/v2.1/servers/b4f99a06-df16-4bff-b028-70add159b4ee/os-volume_attachments/81c92ff7-cde7-4eb1-8b0f-630af5f8dddf" status: 202 len: 0 microversion: 2.1 time: 0.173979 Oct 31 12:44:17.112680 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 565/1134] 10.222.0.15 () {58 vars in 1416 bytes} [Mon Oct 31 12:44:16 2022] DELETE /compute/v2.1/servers/b4f99a06-df16-4bff-b028-70add159b4ee/os-volume_attachments/81c92ff7-cde7-4eb1-8b0f-630af5f8dddf => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 12:44:17.122941 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-88c12d6d-269c-4d8d-bc65-62b7f0c5d455 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:44:17.125360 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-88c12d6d-269c-4d8d-bc65-62b7f0c5d455 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] [instance: b4f99a06-df16-4bff-b028-70add159b4ee] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:44:17.131549 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-88c12d6d-269c-4d8d-bc65-62b7f0c5d455 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:44:17.132030 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-88c12d6d-269c-4d8d-bc65-62b7f0c5d455 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:44:17.132523 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-88c12d6d-269c-4d8d-bc65-62b7f0c5d455 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:44:17.133218 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-88c12d6d-269c-4d8d-bc65-62b7f0c5d455 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:44:17.133853 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-88c12d6d-269c-4d8d-bc65-62b7f0c5d455 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:44:17.134438 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-88c12d6d-269c-4d8d-bc65-62b7f0c5d455 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:44:17.167191 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-88c12d6d-269c-4d8d-bc65-62b7f0c5d455 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] 10.222.0.15 "GET /compute/v2.1/servers/b4f99a06-df16-4bff-b028-70add159b4ee/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049909 Oct 31 12:44:17.167750 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 570/1135] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Oct 31 12:44:17 2022] GET /compute/v2.1/servers/b4f99a06-df16-4bff-b028-70add159b4ee/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 12:44:18.181709 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-4c328432-7198-4c07-94dc-51b625008b93 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:44:18.184032 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-4c328432-7198-4c07-94dc-51b625008b93 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] [instance: b4f99a06-df16-4bff-b028-70add159b4ee] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:44:18.190926 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-4c328432-7198-4c07-94dc-51b625008b93 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:44:18.191445 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-4c328432-7198-4c07-94dc-51b625008b93 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:44:18.191881 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-4c328432-7198-4c07-94dc-51b625008b93 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:44:18.192007 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [req-3ab5913a-04bf-4b0c-a7f4-c5259247e892 req-68eb4739-8024-470f-9bc5-648300bcfd5e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b4f99a06-df16-4bff-b028-70add159b4ee", "tag": "16976c96-0697-482f-bcc1-98d0bc00538f"}]} {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 12:44:18.192578 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-4c328432-7198-4c07-94dc-51b625008b93 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:44:18.193037 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-4c328432-7198-4c07-94dc-51b625008b93 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:44:18.193466 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-4c328432-7198-4c07-94dc-51b625008b93 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:44:18.202135 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [req-3ab5913a-04bf-4b0c-a7f4-c5259247e892 req-68eb4739-8024-470f-9bc5-648300bcfd5e service nova] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:44:18.202605 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [req-3ab5913a-04bf-4b0c-a7f4-c5259247e892 req-68eb4739-8024-470f-9bc5-648300bcfd5e service nova] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:44:18.203025 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [req-3ab5913a-04bf-4b0c-a7f4-c5259247e892 req-68eb4739-8024-470f-9bc5-648300bcfd5e service nova] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:44:18.213927 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.compute.server_external_events [req-3ab5913a-04bf-4b0c-a7f4-c5259247e892 req-68eb4739-8024-470f-9bc5-648300bcfd5e service nova] Creating event network-changed:16976c96-0697-482f-bcc1-98d0bc00538f for instance b4f99a06-df16-4bff-b028-70add159b4ee on hv-cinder-79617 Oct 31 12:44:18.219425 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [req-3ab5913a-04bf-4b0c-a7f4-c5259247e892 req-68eb4739-8024-470f-9bc5-648300bcfd5e service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031218 Oct 31 12:44:18.220263 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 571/1136] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Oct 31 12:44:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 12:44:18.223054 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-4c328432-7198-4c07-94dc-51b625008b93 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] 10.222.0.15 "GET /compute/v2.1/servers/b4f99a06-df16-4bff-b028-70add159b4ee/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046150 Oct 31 12:44:18.223582 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 566/1137] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Oct 31 12:44:18 2022] GET /compute/v2.1/servers/b4f99a06-df16-4bff-b028-70add159b4ee/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 12:44:18.234532 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-1da8a9b5-7c5c-4cff-a86d-a75d2f283e0f tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:44:18.235105 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-1da8a9b5-7c5c-4cff-a86d-a75d2f283e0f tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] [instance: b4f99a06-df16-4bff-b028-70add159b4ee] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:44:18.241159 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-1da8a9b5-7c5c-4cff-a86d-a75d2f283e0f tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:44:18.241633 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-1da8a9b5-7c5c-4cff-a86d-a75d2f283e0f tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:44:18.242061 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-1da8a9b5-7c5c-4cff-a86d-a75d2f283e0f tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:44:18.242741 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-1da8a9b5-7c5c-4cff-a86d-a75d2f283e0f tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:44:18.243206 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-1da8a9b5-7c5c-4cff-a86d-a75d2f283e0f tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:44:18.243622 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-1da8a9b5-7c5c-4cff-a86d-a75d2f283e0f tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:44:18.319010 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.wsgi [None req-1da8a9b5-7c5c-4cff-a86d-a75d2f283e0f tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] HTTP exception thrown: Instance b4f99a06-df16-4bff-b028-70add159b4ee is not attached to volume 81c92ff7-cde7-4eb1-8b0f-630af5f8dddf Oct 31 12:44:18.321461 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-1da8a9b5-7c5c-4cff-a86d-a75d2f283e0f tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Request method failure captured: Oct 31 12:44:18.321461 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: request: DELETE /compute/v2.1/servers/b4f99a06-df16-4bff-b028-70add159b4ee/os-volume_attachments/81c92ff7-cde7-4eb1-8b0f-630af5f8dddf HTTP/1.1 Oct 31 12:44:18.321461 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: Accept: application/json Oct 31 12:44:18.321461 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: Accept-Encoding: identity Oct 31 12:44:18.321461 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: Connection: close Oct 31 12:44:18.321461 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: Content-Length: 0 Oct 31 12:44:18.321461 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: Content-Type: application/json Oct 31 12:44:18.321461 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: Host: 10.222.0.15 Oct 31 12:44:18.321461 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: Openstack-System-Scope: None Oct 31 12:44:18.321461 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: User-Agent: python-urllib3/1.26.12 Oct 31 12:44:18.321461 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Auth-Token: gAAAAABjX8KUbPVE2I2umBefymCCVj6qtfIJV6k9WQinKqbHH_i664TNHABi9H7X2LGZkT8RsnLp1gPBPsnKncORBrZoE7duNSWM_7c2OuFkXctkYLVnyM7m54hCq0lQ7rcUlf-aEGOoObQFw-Jf1FZ_NG5y7h0PZXXJivngFbRzoTnm0woVAbc Oct 31 12:44:18.321461 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Domain-Id: None Oct 31 12:44:18.321461 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Domain-Name: None Oct 31 12:44:18.321461 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Identity-Status: Confirmed Oct 31 12:44:18.321461 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Is-Admin-Project: True Oct 31 12:44:18.321461 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Project-Domain-Id: default Oct 31 12:44:18.321461 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Project-Domain-Name: Default Oct 31 12:44:18.321461 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Project-Id: 0637756aceaf4644bf263b5b5d72d9ac Oct 31 12:44:18.321461 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Project-Name: tempest-TestMinimumBasicScenario-686953212 Oct 31 12:44:18.321461 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Role: reader,member Oct 31 12:44:18.321461 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Roles: reader,member Oct 31 12:44:18.323052 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/0637756aceaf4644bf263b5b5d72d9ac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_0637756aceaf4644bf263b5b5d72d9ac", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/0637756aceaf4644bf263b5b5d72d9ac"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/0637756aceaf4644bf263b5b5d72d9ac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Oct 31 12:44:18.323052 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Tenant: tempest-TestMinimumBasicScenario-686953212 Oct 31 12:44:18.323052 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Tenant-Id: 0637756aceaf4644bf263b5b5d72d9ac Oct 31 12:44:18.323052 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Tenant-Name: tempest-TestMinimumBasicScenario-686953212 Oct 31 12:44:18.323052 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-User: tempest-TestMinimumBasicScenario-686953212-project Oct 31 12:44:18.323052 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-User-Domain-Id: default Oct 31 12:44:18.323052 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-User-Domain-Name: Default Oct 31 12:44:18.323052 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-User-Id: 5ddf1d02fa2644d280d9dee5b3101366 Oct 31 12:44:18.323052 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-User-Name: tempest-TestMinimumBasicScenario-686953212-project Oct 31 12:44:18.323052 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: method: > Oct 31 12:44:18.323052 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: exception: Instance b4f99a06-df16-4bff-b028-70add159b4ee is not attached to volume 81c92ff7-cde7-4eb1-8b0f-630af5f8dddf Oct 31 12:44:18.323984 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: action_args: {'server_id': 'b4f99a06-df16-4bff-b028-70add159b4ee', 'id': '81c92ff7-cde7-4eb1-8b0f-630af5f8dddf'} Oct 31 12:44:18.323984 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 12:44:18.323984 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 12:44:18.323984 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 31 12:44:18.323984 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 31 12:44:18.323984 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 31 12:44:18.323984 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 31 12:44:18.323984 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 31 12:44:18.323984 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 31 12:44:18.323984 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 81c92ff7-cde7-4eb1-8b0f-630af5f8dddf. Oct 31 12:44:18.323984 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Oct 31 12:44:18.323984 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 12:44:18.323984 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Oct 31 12:44:18.323984 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 12:44:18.323984 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 12:44:18.323984 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 12:44:18.323984 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 12:44:18.323984 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 12:44:18.323984 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 12:44:18.325423 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 12:44:18.325423 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 31 12:44:18.325423 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 31 12:44:18.325423 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b4f99a06-df16-4bff-b028-70add159b4ee is not attached to volume 81c92ff7-cde7-4eb1-8b0f-630af5f8dddf Oct 31 12:44:18.325423 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Oct 31 12:44:18.325423 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 12:44:18.325423 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Oct 31 12:44:18.325423 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 12:44:18.325423 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 12:44:18.325423 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 12:44:18.325423 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 12:44:18.325423 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 12:44:18.325423 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b4f99a06-df16-4bff-b028-70add159b4ee is not attached to volume 81c92ff7-cde7-4eb1-8b0f-630af5f8dddf Oct 31 12:44:18.325423 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Oct 31 12:44:18.325423 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-1da8a9b5-7c5c-4cff-a86d-a75d2f283e0f tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Returning 404 to user: Instance b4f99a06-df16-4bff-b028-70add159b4ee is not attached to volume 81c92ff7-cde7-4eb1-8b0f-630af5f8dddf {{(pid=125440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 12:44:18.327003 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-1da8a9b5-7c5c-4cff-a86d-a75d2f283e0f tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] 10.222.0.15 "DELETE /compute/v2.1/servers/b4f99a06-df16-4bff-b028-70add159b4ee/os-volume_attachments/81c92ff7-cde7-4eb1-8b0f-630af5f8dddf" status: 404 len: 154 microversion: 2.1 time: 0.092745 Oct 31 12:44:18.327003 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 572/1138] 10.222.0.15 () {58 vars in 1416 bytes} [Mon Oct 31 12:44:18 2022] DELETE /compute/v2.1/servers/b4f99a06-df16-4bff-b028-70add159b4ee/os-volume_attachments/81c92ff7-cde7-4eb1-8b0f-630af5f8dddf => generated 154 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 31 12:44:19.466308 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-86291bdf-a8ac-4471-abf8-59998335a38a tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:44:19.466799 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-86291bdf-a8ac-4471-abf8-59998335a38a tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] [instance: b4f99a06-df16-4bff-b028-70add159b4ee] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:44:19.473117 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-86291bdf-a8ac-4471-abf8-59998335a38a tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:44:19.473598 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-86291bdf-a8ac-4471-abf8-59998335a38a tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:44:19.474023 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-86291bdf-a8ac-4471-abf8-59998335a38a tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:44:19.474698 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-86291bdf-a8ac-4471-abf8-59998335a38a tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:44:19.475147 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-86291bdf-a8ac-4471-abf8-59998335a38a tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:44:19.475660 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-86291bdf-a8ac-4471-abf8-59998335a38a tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:44:19.500454 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-86291bdf-a8ac-4471-abf8-59998335a38a tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] [instance: b4f99a06-df16-4bff-b028-70add159b4ee] Going to try to terminate instance {{(pid=125441) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 12:44:19.575000 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-86291bdf-a8ac-4471-abf8-59998335a38a tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] 10.222.0.15 "DELETE /compute/v2.1/servers/b4f99a06-df16-4bff-b028-70add159b4ee" status: 204 len: 0 microversion: 2.1 time: 0.112184 Oct 31 12:44:19.575610 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 567/1139] 10.222.0.15 () {58 vars in 1239 bytes} [Mon Oct 31 12:44:19 2022] DELETE /compute/v2.1/servers/b4f99a06-df16-4bff-b028-70add159b4ee => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 12:44:19.584839 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-c3a59fb0-0603-46eb-8c45-ef70e2ffbce4 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:44:19.585539 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-c3a59fb0-0603-46eb-8c45-ef70e2ffbce4 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] [instance: b4f99a06-df16-4bff-b028-70add159b4ee] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:44:19.592172 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-c3a59fb0-0603-46eb-8c45-ef70e2ffbce4 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:44:19.592538 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-c3a59fb0-0603-46eb-8c45-ef70e2ffbce4 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:44:19.592966 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-c3a59fb0-0603-46eb-8c45-ef70e2ffbce4 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:44:19.593642 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-c3a59fb0-0603-46eb-8c45-ef70e2ffbce4 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:44:19.594087 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-c3a59fb0-0603-46eb-8c45-ef70e2ffbce4 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:44:19.594498 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-c3a59fb0-0603-46eb-8c45-ef70e2ffbce4 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:44:19.729641 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-c3a59fb0-0603-46eb-8c45-ef70e2ffbce4 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ddf1d02fa2644d280d9dee5b3101366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0637756aceaf4644bf263b5b5d72d9ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:44:19.737670 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-c3a59fb0-0603-46eb-8c45-ef70e2ffbce4 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] 10.222.0.15 "GET /compute/v2.1/servers/b4f99a06-df16-4bff-b028-70add159b4ee" status: 200 len: 1552 microversion: 2.1 time: 0.157083 Oct 31 12:44:19.738253 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 573/1140] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:44:19 2022] GET /compute/v2.1/servers/b4f99a06-df16-4bff-b028-70add159b4ee => generated 1552 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 12:44:20.764695 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-ad5a56fb-7c2e-42ab-a345-d1526e984581 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Calling method '>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:44:20.765676 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.compute.api [None req-ad5a56fb-7c2e-42ab-a345-d1526e984581 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] [instance: b4f99a06-df16-4bff-b028-70add159b4ee] Fetching instance by UUID {{(pid=125441) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:44:20.771766 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-ad5a56fb-7c2e-42ab-a345-d1526e984581 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:44:20.772243 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-ad5a56fb-7c2e-42ab-a345-d1526e984581 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:44:20.772675 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-ad5a56fb-7c2e-42ab-a345-d1526e984581 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:44:20.773362 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-ad5a56fb-7c2e-42ab-a345-d1526e984581 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:44:20.773814 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-ad5a56fb-7c2e-42ab-a345-d1526e984581 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:44:20.774340 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [None req-ad5a56fb-7c2e-42ab-a345-d1526e984581 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:44:20.905591 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.policy [None req-ad5a56fb-7c2e-42ab-a345-d1526e984581 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ddf1d02fa2644d280d9dee5b3101366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0637756aceaf4644bf263b5b5d72d9ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125441) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:44:20.913218 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-ad5a56fb-7c2e-42ab-a345-d1526e984581 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] 10.222.0.15 "GET /compute/v2.1/servers/b4f99a06-df16-4bff-b028-70add159b4ee" status: 200 len: 1552 microversion: 2.1 time: 0.153108 Oct 31 12:44:20.913814 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 568/1141] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:44:20 2022] GET /compute/v2.1/servers/b4f99a06-df16-4bff-b028-70add159b4ee => generated 1552 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:44:21.938106 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-167045bf-7a2b-4700-82dd-b446499a7cc7 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:44:21.939343 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-167045bf-7a2b-4700-82dd-b446499a7cc7 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] [instance: b4f99a06-df16-4bff-b028-70add159b4ee] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:44:21.946601 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-167045bf-7a2b-4700-82dd-b446499a7cc7 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:44:21.947071 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-167045bf-7a2b-4700-82dd-b446499a7cc7 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:44:21.947551 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-167045bf-7a2b-4700-82dd-b446499a7cc7 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:44:21.948251 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-167045bf-7a2b-4700-82dd-b446499a7cc7 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:44:21.948697 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-167045bf-7a2b-4700-82dd-b446499a7cc7 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:44:21.949111 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-167045bf-7a2b-4700-82dd-b446499a7cc7 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:44:22.019227 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [req-ff65a11f-99cd-4c7f-b883-a29f243abb66 req-9427fcf9-b0b8-46ed-8acd-a1cad4aa0803 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4f99a06-df16-4bff-b028-70add159b4ee", "name": "network-vif-deleted", "tag": "16976c96-0697-482f-bcc1-98d0bc00538f"}]} {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 12:44:22.037690 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.policy [None req-167045bf-7a2b-4700-82dd-b446499a7cc7 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ddf1d02fa2644d280d9dee5b3101366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0637756aceaf4644bf263b5b5d72d9ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125440) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 12:44:22.042923 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [req-ff65a11f-99cd-4c7f-b883-a29f243abb66 req-9427fcf9-b0b8-46ed-8acd-a1cad4aa0803 service nova] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:44:22.043682 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [req-ff65a11f-99cd-4c7f-b883-a29f243abb66 req-9427fcf9-b0b8-46ed-8acd-a1cad4aa0803 service nova] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:44:22.044403 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG oslo_concurrency.lockutils [req-ff65a11f-99cd-4c7f-b883-a29f243abb66 req-9427fcf9-b0b8-46ed-8acd-a1cad4aa0803 service nova] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:44:22.049055 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-167045bf-7a2b-4700-82dd-b446499a7cc7 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] 10.222.0.15 "GET /compute/v2.1/servers/b4f99a06-df16-4bff-b028-70add159b4ee" status: 200 len: 1510 microversion: 2.1 time: 0.115277 Oct 31 12:44:22.050739 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 574/1142] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:44:21 2022] GET /compute/v2.1/servers/b4f99a06-df16-4bff-b028-70add159b4ee => generated 1510 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 12:44:22.058261 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.compute.server_external_events [req-ff65a11f-99cd-4c7f-b883-a29f243abb66 req-9427fcf9-b0b8-46ed-8acd-a1cad4aa0803 service nova] Creating event network-vif-deleted:16976c96-0697-482f-bcc1-98d0bc00538f for instance b4f99a06-df16-4bff-b028-70add159b4ee on hv-cinder-79617 Oct 31 12:44:22.063676 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [req-ff65a11f-99cd-4c7f-b883-a29f243abb66 req-9427fcf9-b0b8-46ed-8acd-a1cad4aa0803 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049300 Oct 31 12:44:22.064259 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 569/1143] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Oct 31 12:44:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 12:44:23.073388 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-fec8c7f3-c9b3-40c9-902b-a707c2537152 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Calling method '>' {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:44:23.073991 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.compute.api [None req-fec8c7f3-c9b3-40c9-902b-a707c2537152 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] [instance: b4f99a06-df16-4bff-b028-70add159b4ee] Fetching instance by UUID {{(pid=125440) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 12:44:23.080476 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-fec8c7f3-c9b3-40c9-902b-a707c2537152 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:44:23.080945 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-fec8c7f3-c9b3-40c9-902b-a707c2537152 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:44:23.081368 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-fec8c7f3-c9b3-40c9-902b-a707c2537152 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:44:23.082049 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-fec8c7f3-c9b3-40c9-902b-a707c2537152 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Acquiring lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 12:44:23.082493 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-fec8c7f3-c9b3-40c9-902b-a707c2537152 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 12:44:23.082909 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG oslo_concurrency.lockutils [None req-fec8c7f3-c9b3-40c9-902b-a707c2537152 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Lock "2eb7acb6-deb5-48f6-9b89-94dcf9fe6ffa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 12:44:23.096144 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.wsgi [None req-fec8c7f3-c9b3-40c9-902b-a707c2537152 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] HTTP exception thrown: Instance b4f99a06-df16-4bff-b028-70add159b4ee could not be found. Oct 31 12:44:23.097752 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-fec8c7f3-c9b3-40c9-902b-a707c2537152 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Request method failure captured: Oct 31 12:44:23.097752 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: request: GET /compute/v2.1/servers/b4f99a06-df16-4bff-b028-70add159b4ee HTTP/1.1 Oct 31 12:44:23.097752 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: Accept: application/json Oct 31 12:44:23.097752 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: Accept-Encoding: identity Oct 31 12:44:23.097752 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: Connection: close Oct 31 12:44:23.097752 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: Content-Length: 0 Oct 31 12:44:23.097752 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: Content-Type: application/json Oct 31 12:44:23.097752 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: Host: 10.222.0.15 Oct 31 12:44:23.097752 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: Openstack-System-Scope: None Oct 31 12:44:23.097752 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: User-Agent: python-urllib3/1.26.12 Oct 31 12:44:23.097752 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Auth-Token: gAAAAABjX8KUbPVE2I2umBefymCCVj6qtfIJV6k9WQinKqbHH_i664TNHABi9H7X2LGZkT8RsnLp1gPBPsnKncORBrZoE7duNSWM_7c2OuFkXctkYLVnyM7m54hCq0lQ7rcUlf-aEGOoObQFw-Jf1FZ_NG5y7h0PZXXJivngFbRzoTnm0woVAbc Oct 31 12:44:23.097752 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Domain-Id: None Oct 31 12:44:23.097752 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Domain-Name: None Oct 31 12:44:23.097752 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Identity-Status: Confirmed Oct 31 12:44:23.097752 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Is-Admin-Project: True Oct 31 12:44:23.097752 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Project-Domain-Id: default Oct 31 12:44:23.097752 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Project-Domain-Name: Default Oct 31 12:44:23.097752 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Project-Id: 0637756aceaf4644bf263b5b5d72d9ac Oct 31 12:44:23.097752 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Project-Name: tempest-TestMinimumBasicScenario-686953212 Oct 31 12:44:23.097752 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Role: reader,member Oct 31 12:44:23.097752 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Roles: reader,member Oct 31 12:44:23.099485 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/0637756aceaf4644bf263b5b5d72d9ac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_0637756aceaf4644bf263b5b5d72d9ac", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/0637756aceaf4644bf263b5b5d72d9ac"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/0637756aceaf4644bf263b5b5d72d9ac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Oct 31 12:44:23.099485 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Tenant: tempest-TestMinimumBasicScenario-686953212 Oct 31 12:44:23.099485 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Tenant-Id: 0637756aceaf4644bf263b5b5d72d9ac Oct 31 12:44:23.099485 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-Tenant-Name: tempest-TestMinimumBasicScenario-686953212 Oct 31 12:44:23.099485 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-User: tempest-TestMinimumBasicScenario-686953212-project Oct 31 12:44:23.099485 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-User-Domain-Id: default Oct 31 12:44:23.099485 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-User-Domain-Name: Default Oct 31 12:44:23.099485 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-User-Id: 5ddf1d02fa2644d280d9dee5b3101366 Oct 31 12:44:23.099485 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: X-User-Name: tempest-TestMinimumBasicScenario-686953212-project Oct 31 12:44:23.099485 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: method: > Oct 31 12:44:23.099485 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: exception: Instance b4f99a06-df16-4bff-b028-70add159b4ee could not be found. Oct 31 12:44:23.099485 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: action_args: {'id': 'b4f99a06-df16-4bff-b028-70add159b4ee'} Oct 31 12:44:23.100473 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: {{(pid=125440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 12:44:23.100473 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 12:44:23.100473 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 12:44:23.100473 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 12:44:23.100473 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 12:44:23.100473 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 12:44:23.100473 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 12:44:23.100473 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 12:44:23.100473 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 12:44:23.100473 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 12:44:23.100473 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b4f99a06-df16-4bff-b028-70add159b4ee could not be found. Oct 31 12:44:23.100473 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Oct 31 12:44:23.100473 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 12:44:23.100473 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Oct 31 12:44:23.100473 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 12:44:23.100473 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 12:44:23.100473 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 12:44:23.100473 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 12:44:23.100473 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 12:44:23.100473 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 12:44:23.102104 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 12:44:23.102104 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 12:44:23.102104 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 12:44:23.102104 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 12:44:23.102104 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 12:44:23.102104 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 12:44:23.102104 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 12:44:23.102104 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b4f99a06-df16-4bff-b028-70add159b4ee could not be found. Oct 31 12:44:23.102104 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Oct 31 12:44:23.102104 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 12:44:23.102104 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Oct 31 12:44:23.102104 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 12:44:23.102104 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 12:44:23.102104 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 12:44:23.102104 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 12:44:23.102104 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 12:44:23.102104 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b4f99a06-df16-4bff-b028-70add159b4ee could not be found. Oct 31 12:44:23.102104 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: ERROR nova.api.openstack.wsgi Oct 31 12:44:23.103666 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: DEBUG nova.api.openstack.wsgi [None req-fec8c7f3-c9b3-40c9-902b-a707c2537152 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Returning 404 to user: Instance b4f99a06-df16-4bff-b028-70add159b4ee could not be found. {{(pid=125440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 12:44:23.103666 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: INFO nova.api.openstack.requestlog [None req-fec8c7f3-c9b3-40c9-902b-a707c2537152 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] 10.222.0.15 "GET /compute/v2.1/servers/b4f99a06-df16-4bff-b028-70add159b4ee" status: 404 len: 111 microversion: 2.1 time: 0.029603 Oct 31 12:44:23.103666 dv-cinder-796170-6-iscsi devstack@n-api.service[125440]: [pid: 125440|app: 0|req: 575/1144] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Oct 31 12:44:23 2022] GET /compute/v2.1/servers/b4f99a06-df16-4bff-b028-70add159b4ee => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 12:44:23.109297 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: DEBUG nova.api.openstack.wsgi [None req-f25fbd3c-474e-4faa-9714-09054e04d361 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] Calling method '.version_select at 0x7f2aa5003820>' {{(pid=125441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 12:44:23.128220 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: INFO nova.api.openstack.requestlog [None req-f25fbd3c-474e-4faa-9714-09054e04d361 tempest-TestMinimumBasicScenario-686953212 tempest-TestMinimumBasicScenario-686953212-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-900841478" status: 202 len: 0 microversion: 2.1 time: 0.024117 Oct 31 12:44:23.128770 dv-cinder-796170-6-iscsi devstack@n-api.service[125441]: [pid: 125441|app: 0|req: 570/1145] 10.222.0.15 () {58 vars in 1269 bytes} [Mon Oct 31 12:44:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-900841478 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)